-- Logs begin at Wed 2022-07-20 18:35:51 UTC, end at Wed 2022-07-20 20:20:43 UTC. -- Jul 20 19:14:28.666013 dv-cinder-835384-16-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 20 19:14:28.675864 dv-cinder-835384-16-iscsi devstack@n-api.service[103226]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 20 19:14:28.677831 dv-cinder-835384-16-iscsi devstack@n-api.service[103226]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 20 19:14:28 2022] *** Jul 20 19:14:28.677831 dv-cinder-835384-16-iscsi devstack@n-api.service[103226]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 20 19:14:28.677831 dv-cinder-835384-16-iscsi devstack@n-api.service[103226]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 20 19:14:28.677831 dv-cinder-835384-16-iscsi devstack@n-api.service[103226]: nodename: dv-cinder-835384-16-iscsi Jul 20 19:14:28.677831 dv-cinder-835384-16-iscsi devstack@n-api.service[103226]: machine: x86_64 Jul 20 19:14:28.677831 dv-cinder-835384-16-iscsi devstack@n-api.service[103226]: clock source: unix Jul 20 19:14:28.677831 dv-cinder-835384-16-iscsi devstack@n-api.service[103226]: pcre jit disabled Jul 20 19:14:28.677831 dv-cinder-835384-16-iscsi devstack@n-api.service[103226]: detected number of CPU cores: 4 Jul 20 19:14:28.677831 dv-cinder-835384-16-iscsi devstack@n-api.service[103226]: current working directory: / Jul 20 19:14:28.677831 dv-cinder-835384-16-iscsi devstack@n-api.service[103226]: detected binary path: /usr/bin/uwsgi-core Jul 20 19:14:28.678556 dv-cinder-835384-16-iscsi devstack@n-api.service[103226]: your processes number limit is 47680 Jul 20 19:14:28.678556 dv-cinder-835384-16-iscsi devstack@n-api.service[103226]: your memory page size is 4096 bytes Jul 20 19:14:28.678556 dv-cinder-835384-16-iscsi devstack@n-api.service[103226]: detected max file descriptor number: 2048 Jul 20 19:14:28.678556 dv-cinder-835384-16-iscsi devstack@n-api.service[103226]: lock engine: pthread robust mutexes Jul 20 19:14:28.678556 dv-cinder-835384-16-iscsi devstack@n-api.service[103226]: thunder lock: enabled Jul 20 19:14:28.678556 dv-cinder-835384-16-iscsi devstack@n-api.service[103226]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 20 19:14:28.678556 dv-cinder-835384-16-iscsi devstack@n-api.service[103226]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 20 19:14:28.722775 dv-cinder-835384-16-iscsi devstack@n-api.service[103226]: Python main interpreter initialized at 0x5652c84679c0 Jul 20 19:14:28.722775 dv-cinder-835384-16-iscsi devstack@n-api.service[103226]: python threads support enabled Jul 20 19:14:28.722775 dv-cinder-835384-16-iscsi devstack@n-api.service[103226]: your server socket listen backlog is limited to 100 connections Jul 20 19:14:28.722775 dv-cinder-835384-16-iscsi devstack@n-api.service[103226]: your mercy for graceful operations on workers is 90 seconds Jul 20 19:14:28.723236 dv-cinder-835384-16-iscsi devstack@n-api.service[103226]: mapped 403077 bytes (393 KB) for 2 cores Jul 20 19:14:28.723236 dv-cinder-835384-16-iscsi devstack@n-api.service[103226]: *** Operational MODE: preforking *** Jul 20 19:14:28.723510 dv-cinder-835384-16-iscsi devstack@n-api.service[103226]: *** uWSGI is running in multiple interpreter mode *** Jul 20 19:14:28.723510 dv-cinder-835384-16-iscsi devstack@n-api.service[103226]: spawned uWSGI master process (pid: 103226) Jul 20 19:14:28.723632 dv-cinder-835384-16-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 20 19:14:28.726165 dv-cinder-835384-16-iscsi devstack@n-api.service[103226]: spawned uWSGI worker 1 (pid: 103227, cores: 1) Jul 20 19:14:28.726165 dv-cinder-835384-16-iscsi devstack@n-api.service[103226]: spawned uWSGI worker 2 (pid: 103228, cores: 1) Jul 20 19:14:28.726165 dv-cinder-835384-16-iscsi devstack@n-api.service[103226]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 20 19:14:29.388522 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 20 19:14:29.398073 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 20 19:14:30.518219 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 19:14:30.518219 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: from cryptography.utils import int_from_bytes Jul 20 19:14:30.518814 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 19:14:30.518814 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: from cryptography.utils import int_from_bytes Jul 20 19:14:30.523831 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 19:14:30.523831 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: from cryptography.utils import int_from_bytes Jul 20 19:14:30.524316 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 19:14:30.524316 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: from cryptography.utils import int_from_bytes Jul 20 19:14:33.015924 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 19:14:33.016520 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 19:14:33.016691 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 19:14:33.017058 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 19:14:33.017163 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 19:14:33.017578 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 19:14:33.017673 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 19:14:33.017760 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.017949 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 19:14:33.018071 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.018303 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 19:14:33.018403 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.018552 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 19:14:33.018650 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.018931 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.019027 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.019249 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.019341 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.019562 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.019665 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.019872 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.019974 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.020192 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.020285 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.020451 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.020549 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.020766 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.020859 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.021086 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.021185 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835384-16-iscsi {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.021405 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.021501 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.021683 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.021784 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.021996 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.022133 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.022310 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835384-16-iscsi {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.022418 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.022621 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.022709 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.022918 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.023013 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.023217 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.023304 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.023527 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.023712 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.023821 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.024895 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.025044 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.025161 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.025255 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.025255 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.025459 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.025642 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.025730 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.025814 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.025898 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.025982 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.026076 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.026162 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.026241 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.026318 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.026442 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.026597 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.026742 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.026906 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.026994 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.027255 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.027353 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835384-16-iscsi {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.027569 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.027656 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.027869 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.028022 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.028196 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.028317 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835384-16-iscsi {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.028543 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.028661 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.028866 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.028980 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.029151 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.029261 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.029499 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.029625 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.029859 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.029975 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.030172 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.030277 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.030483 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.030589 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.031044 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.031173 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.031253 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.031408 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.031524 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.031741 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.031840 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.032036 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.032124 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.032345 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.032445 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.032656 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.032751 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.032953 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.033048 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.033252 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.033353 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.033502 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.033627 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.033826 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.033922 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.034147 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.034236 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.034441 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.034528 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.034687 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.034849 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.034970 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.035047 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.035247 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.035335 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.035565 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.035661 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.035877 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.035976 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.036125 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.036214 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.036369 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.036467 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.036679 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.036781 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.036995 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.037084 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.037296 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.037383 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.037626 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.037711 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.037911 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.038013 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.038208 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.038298 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.038502 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.038597 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.038801 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.038975 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.039124 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.039257 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.039395 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.039486 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.039703 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.039802 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.040007 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.040101 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.69 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.040320 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.040416 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.69 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.040616 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.040712 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.040927 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.041024 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.041261 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.041354 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.69 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.041560 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.69 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.041665 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.041862 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.041949 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.042195 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.042290 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.042497 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.042597 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.042796 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.042891 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.043099 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.043191 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.043408 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.043495 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.043707 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.043794 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.044005 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.044139 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.044270 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.044402 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.044524 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.044646 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.044829 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.044954 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.045146 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.045318 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.045444 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.045605 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.045764 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.045891 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.046069 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.046201 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.047130 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.047284 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.047426 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.047595 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.047768 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.048011 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.048155 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.048289 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.048417 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.048551 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.048675 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.048807 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.048937 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.049098 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.049234 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.049398 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.049552 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.049826 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.049972 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.050102 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.050224 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.050355 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.050484 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.050639 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.050780 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.050911 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.051039 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.051169 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.051292 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.051479 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.051624 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.051757 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.051879 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.052056 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.052191 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.052355 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.052488 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.052652 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.052787 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.052950 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.053078 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.053260 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.053386 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.053580 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.053708 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.053881 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.054017 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.054194 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.054320 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.054492 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.054627 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.054790 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.054916 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.055096 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.055234 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.055394 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.055530 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.055690 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.055816 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.055991 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.056117 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.056280 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.056417 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.056577 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.056710 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.056875 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.057000 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.057176 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.057310 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.057474 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.057662 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.057787 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.057913 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.058057 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.058248 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.058381 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.058503 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.058625 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.058746 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.058922 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.059056 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.059219 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.059347 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.059509 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.059634 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.059818 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.059945 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.060131 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.060258 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.060429 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.060567 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.060728 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.060863 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.061025 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.061151 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.061335 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:33.061474 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.061686 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.061815 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.062676 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.062847 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.062974 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.063269 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.063398 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.063590 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.063723 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.063904 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.064029 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.064215 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.064342 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.064527 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.064654 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.064831 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.064973 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.065141 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.065273 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.065463 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.065610 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.065796 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.065939 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.066103 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.066315 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.066448 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.066578 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.066708 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.066830 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.067008 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.067135 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.067331 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.067457 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.067644 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.067788 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.067951 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.068076 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.068263 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.068382 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.068569 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.068697 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.068879 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.068985 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.069199 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.069296 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.069523 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.069640 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.069834 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.069923 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.070154 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.070242 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.070466 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.070563 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.070785 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.070871 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.071103 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.071191 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.071418 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.071510 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.071720 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.071812 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.072027 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.072115 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.072331 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.072429 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.072652 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.072743 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.072952 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.073051 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.073253 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.073340 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.073588 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.073680 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.073896 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.073983 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.074201 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.074297 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.074503 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.074597 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.074806 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.074902 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.075107 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.075201 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.075418 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.075557 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.075727 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.075864 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.076030 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.076156 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.076332 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.076456 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.076637 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.076771 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.076938 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.077064 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.077241 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.077366 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.077587 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.077729 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.077917 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.078124 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.078293 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.078497 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.078624 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.078779 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.078937 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.079064 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.079251 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.079384 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.079564 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.079691 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.079877 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.080011 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.080184 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.080318 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.080498 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.080625 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.080810 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.080936 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.081114 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.081245 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.081420 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.081562 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.081761 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.081898 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.082062 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.082197 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.082367 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.082501 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.082671 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.082809 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.082995 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.083130 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.083275 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.083403 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.083580 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.083708 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.083882 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.084016 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.084190 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.084316 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.084485 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.084609 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.084782 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.084921 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.085089 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.085215 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.085393 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.085568 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.085719 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.085863 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.086025 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.086158 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.086328 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.086455 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.086644 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.086772 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.086948 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.087081 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.087256 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.087381 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.087567 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.087694 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.087879 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.088004 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.088176 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.088300 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.088548 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.088684 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.088807 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.088926 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.089079 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.089212 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.089413 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.089557 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.089683 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.089804 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.089985 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.090129 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.090284 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.090412 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.090581 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.090709 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.090883 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.091018 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.091178 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.091304 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.091478 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.091610 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.091774 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.091909 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.092071 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.092197 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.092367 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.092500 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.092681 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.092818 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.092991 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.093127 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.093295 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.093440 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.093788 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.093968 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.094129 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.094254 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.094411 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.094547 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.094730 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.094864 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.095042 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.095169 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.095607 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.095738 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.095922 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.096065 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.096234 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.096361 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.096553 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.096680 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.096864 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.096998 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.097182 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.097308 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.097493 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.097670 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.097835 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.097960 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.098143 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.098279 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.098457 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.098607 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.098803 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.098928 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.099053 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.099175 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.099354 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.099489 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.099672 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.099804 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.099977 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.100102 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.100292 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.100431 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.100591 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.100719 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.100901 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.101027 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.101223 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.101350 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.101560 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.101703 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.101871 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.101996 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.102184 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.102310 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.102487 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.102619 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.102797 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.102922 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.103101 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.103227 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.103406 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.103532 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.103709 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.103835 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.104012 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.104138 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.104323 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.104449 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.104626 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.104759 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.104938 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.105069 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.105241 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.105367 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.105581 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.105722 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.105888 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.106022 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.106198 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.106331 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.106494 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.106628 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.106801 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.106927 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.107109 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.107242 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.107421 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.107557 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.107728 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.107855 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.108029 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.108154 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.108336 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.108469 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.108636 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.109279 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.109647 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.109785 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.110174 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.110350 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.110477 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.110774 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.110941 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.111068 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.111380 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.111561 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.111688 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.111868 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.112003 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.112193 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.112328 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.112511 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.112638 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.112840 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.112972 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.113132 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.113266 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.113429 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.113610 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.113747 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.113873 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.114065 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.114192 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.114370 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.114497 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.114686 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.114814 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.115017 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.115181 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.115316 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.115439 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.115622 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.115748 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.115932 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.116065 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.116238 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.116372 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.116582 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.116731 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.116895 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.117023 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.117192 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.117324 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.117527 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.117666 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.117852 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.117979 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.118154 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.118280 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.118469 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.118603 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.118784 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.118918 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.119088 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.119212 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.119397 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.119673 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.119801 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.119924 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.120053 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.120183 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.120305 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.120439 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.120596 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.120722 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.120899 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.121034 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.121206 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.121341 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.121528 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.121658 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.121837 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.121965 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.122144 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.122278 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.122454 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.122579 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.122757 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.122888 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.123061 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.123196 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.123366 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.123498 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.123664 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.123937 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.124075 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.124269 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.124977 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.125228 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.125608 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.125736 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.126086 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.126219 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.126404 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.126531 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.126725 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.126861 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.127045 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.127170 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.127362 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.127489 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.127679 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.127823 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.127995 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.128129 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.128303 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.128429 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.128611 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.128749 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.128917 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.129042 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.129221 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.129354 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.129548 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.129762 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.129890 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.130020 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.130150 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.130271 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.130432 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.130560 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.130732 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.130868 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.131035 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.131161 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.131334 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.131467 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.131634 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.131771 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.131934 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.132060 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.132232 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.132358 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.132540 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.132676 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.132838 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.132964 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.133142 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.133268 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.133440 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.133586 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.133782 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.133908 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.134086 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.134211 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.134384 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.134510 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.134681 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.134817 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.134978 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.135104 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.135311 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.135439 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.135611 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.135737 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.135940 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.136080 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.136258 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.136384 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.136580 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.136706 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.136877 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.137011 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.137175 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.137302 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.137476 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.137635 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.137806 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.137945 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.138104 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.138232 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.138402 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.138529 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.138704 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.138839 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.139007 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.139142 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.139303 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.139429 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.139604 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.139745 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.139932 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.140114 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.140297 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.140425 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.140613 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.140833 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.140960 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.141142 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.141268 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.141448 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.141610 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.141831 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.141957 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.142147 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.142281 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.142451 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.142588 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.142753 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.142879 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.143051 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.143176 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.143357 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.143489 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.143659 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.143783 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.143954 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.144080 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.144276 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.144399 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.144526 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.144646 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.144836 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.144964 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.145133 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.145261 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.145430 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.145573 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.145750 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.145877 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.146084 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.146210 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.146389 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.146515 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.146693 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.146828 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.147004 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.147129 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.147309 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.147435 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.147611 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.147745 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.147904 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.148029 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.148206 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.148339 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.148503 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.148638 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.148798 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.148926 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.149100 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.149225 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.149413 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.149612 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.149756 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.150035 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.150035 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.150284 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.150416 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.150539 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.150661 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.150797 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.150920 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.151041 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.151171 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.151293 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.151454 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.151582 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.151750 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.151876 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.152044 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.152172 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.152339 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.152466 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.152633 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.152767 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.152927 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.153057 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.153242 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.153368 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.153565 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.153706 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.153867 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.153993 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.154164 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.154290 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.154460 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.154594 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.154795 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.154921 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.155093 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.155219 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.155432 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.155566 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.155796 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.155928 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.156093 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.156337 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.156468 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.156699 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.156828 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.157008 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.157141 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.157315 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.157448 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.157639 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.157764 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.157941 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.158067 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.158250 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.158384 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.158557 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.158683 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.158866 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.159000 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.159165 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.159301 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.159464 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.159591 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.159781 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.159908 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.160091 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.160225 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.160399 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.160511 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.160714 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.160822 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.161023 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.161139 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.161334 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.161444 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.161654 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.161751 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.161957 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.162055 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.162260 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.162348 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.162563 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.162651 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.162866 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.162955 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.163168 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.163262 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.163470 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.163564 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.163778 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.163927 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.164080 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.164209 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.164385 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.164511 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.164688 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.164815 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.164987 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.165113 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.165291 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.165425 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.165617 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.165746 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.165916 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.166042 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.166231 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.166370 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.166534 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.166658 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.166843 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.167008 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.167132 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.167265 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.167419 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.167545 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.167725 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.167851 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.168020 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.168155 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.168435 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.168560 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.168738 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.168870 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.169041 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.169168 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.169339 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.169473 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.169670 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.169798 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.169975 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.170103 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.170303 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.170430 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.170579 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.170704 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.170877 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.171003 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.171772 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.171906 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.172122 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.172295 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.172452 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.172686 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.172825 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.172995 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.173122 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.173319 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.173445 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.173677 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.173817 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.173986 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.174113 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.174307 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.174439 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.174603 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.174735 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.174903 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.175029 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.175203 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.175330 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.175520 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.175711 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.175838 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.176023 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.176158 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.176336 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.176516 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.176642 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.176822 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.176961 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.177122 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.177275 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.177553 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.177684 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.177857 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.177997 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.178169 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.178295 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.178486 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.178642 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.178802 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.178941 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.179118 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.179251 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.179417 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.179543 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.179724 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.179851 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.180027 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.180160 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.180347 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.180463 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.180661 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.180794 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.180963 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.181071 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.181270 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.181368 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.181591 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.181727 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.181911 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.182041 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.182226 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.182352 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.182532 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.182658 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.182847 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.182975 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.183251 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.183377 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.183561 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.183685 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.183880 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.183994 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.184161 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.184285 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.184479 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.184603 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.184779 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.184905 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.185079 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.185206 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.185382 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.185545 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.185714 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.185838 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.186014 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.186141 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.186318 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.186451 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.186617 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.186740 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.187500 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.187655 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.187832 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.188118 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.188245 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.188436 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.188561 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.188738 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.188863 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.189040 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.189166 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.189359 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.189484 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.189690 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.189835 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.189997 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.190129 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.190305 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.190444 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.190640 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.190779 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.190925 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.191051 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.191225 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.191352 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.191541 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.191682 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.191848 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.191975 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.192148 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.192274 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.192446 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.192582 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.192744 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.192870 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.193080 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.193206 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.193380 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.193528 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.193720 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.193847 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.194043 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.194169 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.194352 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.194479 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.194653 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.194778 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.194962 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.195088 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.195271 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.195405 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.195577 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.195704 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.195882 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.196008 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.196193 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.196320 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.196489 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.196615 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.196788 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.196923 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.197087 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.197212 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.197384 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.197527 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.197709 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.197849 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.198014 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.198141 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.198317 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.198453 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.198614 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.198754 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.198910 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.199036 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.199206 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.199339 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.199522 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.199663 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.199819 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.199946 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.200133 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.200260 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.200436 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.200564 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.200762 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.200889 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.201011 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.201133 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.201305 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.201433 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.201664 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.201804 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.201965 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.202100 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.202328 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.202487 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.202695 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.202821 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.203095 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.203233 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.203414 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.203625 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.203750 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.204044 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.204186 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.204319 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.204449 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.204572 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.204706 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.204861 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.204995 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.205170 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.205310 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.205479 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.205777 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.205905 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.206108 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.206248 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.206417 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.206543 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.206722 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.206857 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.207031 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.207168 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.207338 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.207465 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.207649 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.207773 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.207962 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.208171 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.208299 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.208499 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.208634 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.208813 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.208954 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.209125 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.209254 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.209435 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.209605 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.209772 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.209912 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.210081 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.210208 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.210389 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.210516 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.210698 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.210903 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.211038 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.211162 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.211285 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.211407 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.211606 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.211733 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.211920 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.212048 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.212238 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.212375 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.212569 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.212695 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.212878 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.213004 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.213187 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.213389 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.213535 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.213659 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.213819 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.213945 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.214132 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.214271 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.214448 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.214575 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.214747 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.214878 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.215054 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.215182 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.215360 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.215487 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.215666 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.215792 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.215970 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.216097 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.216291 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.216417 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.216596 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.216723 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.216903 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.217024 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.217207 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.217341 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.217563 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.217712 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.217837 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.218053 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.218199 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.218404 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.218850 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.219092 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.219092 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.219329 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.219460 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.219584 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.219708 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.219839 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.219995 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.220127 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.220282 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.220651 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.220840 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.221080 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.221216 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.221371 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.221527 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.221725 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.221867 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.222047 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.222212 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.222368 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.222495 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.222677 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.222816 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.222982 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.223107 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.223301 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.223425 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.223601 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.223737 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.223899 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.224134 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.224261 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.224482 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.224620 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.224778 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.224904 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.225091 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.225218 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.225394 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.225566 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.225720 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.225848 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.226035 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.226162 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.226338 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.226481 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.226649 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.226861 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.226989 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.227200 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.227326 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.227511 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.227639 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.227831 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.227965 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.228139 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.228274 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.228449 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.228576 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.228747 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.228880 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.229047 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.229183 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.229352 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.229477 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.229676 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.229813 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.229987 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.230127 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.230290 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.230415 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.230587 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.230718 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.230883 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.231033 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.231229 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.231356 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.231486 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.231609 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.231739 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.231863 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.232041 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.232168 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.232337 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.232463 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.232651 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.232776 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.232946 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.233079 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.233243 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.233370 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.233559 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.233691 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.234379 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.234635 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.234764 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.234986 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.235218 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.235346 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.235471 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.235648 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.235775 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.235953 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.236080 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.236353 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.236496 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.236629 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.236759 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.236895 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.237026 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.237149 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.237279 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.237428 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.237583 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.237753 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.237882 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.238060 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.238193 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.238403 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.238530 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.238724 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.238946 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.239074 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.239284 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.239412 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.239606 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.239734 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.239909 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.240034 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.240227 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.240360 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.240533 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.240668 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.240837 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.240965 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.241139 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.241373 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.241562 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.241690 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.241825 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.242010 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.242138 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.242337 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.242473 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.242651 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.242779 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.242978 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.243113 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.243310 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.243435 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.243586 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.243721 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.243882 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.244008 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.244181 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.244309 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.244495 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.244620 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.244797 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.244924 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.245103 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.245231 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.245407 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.245569 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.245739 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.245875 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.246044 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.246172 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.246349 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.246476 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.246651 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.246788 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.246955 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.247090 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.247295 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.247428 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.247607 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.247743 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.247919 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.248047 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.248220 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.248356 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.248529 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.248656 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.248836 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.248960 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.249167 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.249295 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.250149 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.250287 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.250416 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.250736 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.250887 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.251140 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.251287 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.251494 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.251620 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.251771 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.251907 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.252078 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.252206 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.252387 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.252521 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.252695 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.252822 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.253007 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.253134 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.253329 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.253462 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.253666 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.253815 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.253956 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.254081 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.254323 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.254457 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.254655 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.254787 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.254968 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.255093 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.255279 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.255406 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.255586 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.255720 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.255890 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.256016 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.256203 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.256330 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.256493 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.256623 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.256808 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.256934 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.257114 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.257238 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.257419 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.257583 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.257755 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.257881 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.258063 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.258195 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.258371 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.258499 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.258676 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.258801 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.258979 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.259111 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.259280 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.259407 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.259583 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.259707 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.259886 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.260011 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.260190 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.260315 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.260489 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.260616 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.260786 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.260921 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.261087 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.261219 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.261385 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.261559 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.261713 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.261856 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.262014 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.262141 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.262313 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.262438 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.262615 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.262749 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.262911 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.263036 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.263209 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.263335 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.263507 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.263641 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.263805 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.263938 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.264102 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.264227 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.264400 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.264534 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.264702 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.264829 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.265053 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.265186 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.265478 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.265751 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.266003 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.266279 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.266406 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.266654 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.266790 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.266985 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.267147 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.267308 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.267434 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.267625 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.267753 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.267941 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.268076 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.268247 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.268371 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.268561 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.268695 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.268866 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.269000 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.269180 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.269305 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.269494 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.269671 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.269826 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.269953 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.270134 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.270261 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.270458 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.270593 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.270763 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.270889 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.271069 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.271197 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.271374 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.271502 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.271680 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.271806 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.271983 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.272120 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.272290 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.272417 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.272607 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.272733 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.272925 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.273131 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.273259 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.273381 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.273533 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.273658 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.273854 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.273993 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.274164 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.274297 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.274474 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.274598 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.274780 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.274908 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.275095 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.275219 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.275398 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.275522 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.275701 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.275835 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.276003 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.276130 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.276307 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.276434 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.276609 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.276736 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.276918 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.277043 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.277219 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.277355 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.277534 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.277663 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.277856 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.277982 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.278164 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.278309 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.278487 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.278613 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.278806 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.278933 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.279089 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 19:14:33.279223 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.279420 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.279740 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.280080 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.280387 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.280845 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.281442 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.281797 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.282112 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.282417 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:33.282657 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 19:14:33.342848 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: INFO dbcounter [None req-c91acb14-6c34-4cff-9951-7c766039dfa2 None None] Registered counter for database nova_api Jul 20 19:14:33.352638 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: INFO dbcounter [None req-84886db3-ca47-4d2d-a408-74fc6e47b275 None None] Registered counter for database nova_api Jul 20 19:14:33.456128 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG oslo_db.sqlalchemy.engines [None req-c91acb14-6c34-4cff-9951-7c766039dfa2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103227) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 19:14:33.462863 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG dbcounter [-] [103227] Writer thread running {{(pid=103227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 19:14:33.464584 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG oslo_db.sqlalchemy.engines [None req-84886db3-ca47-4d2d-a408-74fc6e47b275 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103228) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 19:14:33.471363 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG dbcounter [-] [103228] Writer thread running {{(pid=103228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 19:14:33.519868 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.context [None req-c91acb14-6c34-4cff-9951-7c766039dfa2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),691618a6-9620-40ee-ad72-b687b651ed73(cell1) {{(pid=103227) load_cells /opt/stack/nova/nova/context.py:464}} Jul 20 19:14:33.523807 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG oslo_concurrency.lockutils [None req-c91acb14-6c34-4cff-9951-7c766039dfa2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:14:33.525402 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG oslo_concurrency.lockutils [None req-c91acb14-6c34-4cff-9951-7c766039dfa2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:14:33.526225 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG oslo_concurrency.lockutils [None req-c91acb14-6c34-4cff-9951-7c766039dfa2 None None] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:14:33.527105 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.context [None req-84886db3-ca47-4d2d-a408-74fc6e47b275 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),691618a6-9620-40ee-ad72-b687b651ed73(cell1) {{(pid=103228) load_cells /opt/stack/nova/nova/context.py:464}} Jul 20 19:14:33.528340 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG oslo_concurrency.lockutils [None req-c91acb14-6c34-4cff-9951-7c766039dfa2 None None] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:14:33.530357 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: INFO dbcounter [None req-c91acb14-6c34-4cff-9951-7c766039dfa2 None None] Registered counter for database nova_cell0 Jul 20 19:14:33.531074 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG oslo_concurrency.lockutils [None req-84886db3-ca47-4d2d-a408-74fc6e47b275 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:14:33.532668 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG oslo_concurrency.lockutils [None req-84886db3-ca47-4d2d-a408-74fc6e47b275 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:14:33.533574 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG oslo_concurrency.lockutils [None req-84886db3-ca47-4d2d-a408-74fc6e47b275 None None] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:14:33.534660 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: INFO dbcounter [None req-c91acb14-6c34-4cff-9951-7c766039dfa2 None None] Registered counter for database nova_cell1 Jul 20 19:14:33.535679 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG oslo_concurrency.lockutils [None req-84886db3-ca47-4d2d-a408-74fc6e47b275 None None] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:14:33.537679 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: INFO dbcounter [None req-84886db3-ca47-4d2d-a408-74fc6e47b275 None None] Registered counter for database nova_cell0 Jul 20 19:14:33.541557 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: INFO dbcounter [None req-84886db3-ca47-4d2d-a408-74fc6e47b275 None None] Registered counter for database nova_cell1 Jul 20 19:14:33.541820 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG oslo_db.sqlalchemy.engines [None req-c91acb14-6c34-4cff-9951-7c766039dfa2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103227) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 19:14:33.544433 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG oslo_db.sqlalchemy.engines [None req-c91acb14-6c34-4cff-9951-7c766039dfa2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103227) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 19:14:33.548891 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG dbcounter [-] [103227] Writer thread running {{(pid=103227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 19:14:33.549624 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG oslo_db.sqlalchemy.engines [None req-84886db3-ca47-4d2d-a408-74fc6e47b275 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103228) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 19:14:33.552531 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG dbcounter [-] [103227] Writer thread running {{(pid=103227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 19:14:33.553253 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG oslo_db.sqlalchemy.engines [None req-84886db3-ca47-4d2d-a408-74fc6e47b275 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103228) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 19:14:33.555284 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG dbcounter [-] [103228] Writer thread running {{(pid=103228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 19:14:33.697129 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG dbcounter [-] [103228] Writer thread running {{(pid=103228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 19:14:33.698978 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: INFO dbcounter [None req-c91acb14-6c34-4cff-9951-7c766039dfa2 None None] Registered counter for database nova_cell0 Jul 20 19:14:33.706293 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG oslo_db.sqlalchemy.engines [None req-c91acb14-6c34-4cff-9951-7c766039dfa2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103227) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 19:14:33.706910 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: INFO dbcounter [None req-84886db3-ca47-4d2d-a408-74fc6e47b275 None None] Registered counter for database nova_cell0 Jul 20 19:14:33.710590 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG dbcounter [-] [103227] Writer thread running {{(pid=103227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 19:14:33.713584 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG oslo_db.sqlalchemy.engines [None req-84886db3-ca47-4d2d-a408-74fc6e47b275 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103228) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 19:14:33.717863 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG dbcounter [-] [103228] Writer thread running {{(pid=103228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 19:14:34.045364 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: WARNING keystonemiddleware.auth_token [None req-c91acb14-6c34-4cff-9951-7c766039dfa2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 19:14:34.051263 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: WARNING keystonemiddleware.auth_token [None req-84886db3-ca47-4d2d-a408-74fc6e47b275 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 19:14:34.052789 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: WARNING keystonemiddleware.auth_token [None req-c91acb14-6c34-4cff-9951-7c766039dfa2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 19:14:34.058519 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: WARNING keystonemiddleware.auth_token [None req-84886db3-ca47-4d2d-a408-74fc6e47b275 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 19:14:34.392627 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: WARNING keystonemiddleware.auth_token [None req-c91acb14-6c34-4cff-9951-7c766039dfa2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 19:14:34.398579 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: WARNING keystonemiddleware.auth_token [None req-c91acb14-6c34-4cff-9951-7c766039dfa2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 19:14:34.401469 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: WARNING keystonemiddleware.auth_token [None req-84886db3-ca47-4d2d-a408-74fc6e47b275 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 19:14:34.403754 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5652c84679c0 pid: 103227 (default app) Jul 20 19:14:34.406030 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi [None req-c91acb14-6c34-4cff-9951-7c766039dfa2 None None] Calling method '>' {{(pid=103227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:14:34.407213 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: INFO nova.api.openstack.requestlog [None req-c91acb14-6c34-4cff-9951-7c766039dfa2 None None] 10.222.0.69 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001939 Jul 20 19:14:34.407439 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: WARNING keystonemiddleware.auth_token [None req-84886db3-ca47-4d2d-a408-74fc6e47b275 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 19:14:34.407614 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: [pid: 103227|app: 0|req: 1/1] 10.222.0.69 () {50 vars in 788 bytes} [Wed Jul 20 19:14:34 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:14:34.412678 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5652c84679c0 pid: 103228 (default app) Jul 20 19:15:52.540095 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi [None req-c91acb14-6c34-4cff-9951-7c766039dfa2 None None] Calling method '>' {{(pid=103227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:15:52.541169 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: INFO nova.api.openstack.requestlog [None req-c91acb14-6c34-4cff-9951-7c766039dfa2 None None] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Jul 20 19:15:52.541603 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: [pid: 103227|app: 0|req: 2/2] 10.222.0.69 () {54 vars in 930 bytes} [Wed Jul 20 19:15:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:15:52.554664 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG dbcounter [-] [103228] Writing DB stats nova_api:SELECT=3 {{(pid=103228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:52.556117 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG dbcounter [-] [103228] Writing DB stats nova_cell0:SELECT=3 {{(pid=103228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:52.556851 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG dbcounter [-] [103228] Writing DB stats nova_cell1:SELECT=3 {{(pid=103228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:52.558177 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG dbcounter [-] [103228] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:53.497117 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi [None req-c70e6c1b-92c4-4f0a-912b-5075f1c01e03 admin admin] Calling method '>' {{(pid=103228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:15:53.528890 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: INFO nova.api.openstack.requestlog [None req-c70e6c1b-92c4-4f0a-912b-5075f1c01e03 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.979403 Jul 20 19:15:53.541770 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: [pid: 103228|app: 0|req: 1/3] 10.222.0.69 () {60 vars in 1291 bytes} [Wed Jul 20 19:15:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:15:55.823926 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi [None req-c91acb14-6c34-4cff-9951-7c766039dfa2 None None] Calling method '>' {{(pid=103227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:15:55.825496 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: INFO nova.api.openstack.requestlog [None req-c91acb14-6c34-4cff-9951-7c766039dfa2 None None] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002335 Jul 20 19:15:55.825992 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: [pid: 103227|app: 0|req: 3/4] 10.222.0.69 () {54 vars in 930 bytes} [Wed Jul 20 19:15:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:15:56.265988 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi [None req-5f20ae74-4e73-4b44-b8dd-7231fc250425 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "ram": 256, "vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "c1", "name": "cirros256", "rxtx_factor": 1.0}} {{(pid=103228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:15:56.285317 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 19:15:56.285317 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: warnings.warn(msg) Jul 20 19:15:56.321490 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: INFO nova.api.openstack.requestlog [None req-5f20ae74-4e73-4b44-b8dd-7231fc250425 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.488522 Jul 20 19:15:56.322280 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: [pid: 103228|app: 0|req: 2/5] 10.222.0.69 () {64 vars in 1282 bytes} [Wed Jul 20 19:15:55 2022] POST /compute/v2.1/flavors => generated 407 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 19:15:56.336973 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG dbcounter [-] [103227] Writing DB stats nova_api:SELECT=3 {{(pid=103227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:56.338006 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG dbcounter [-] [103227] Writing DB stats nova_cell1:SELECT=3 {{(pid=103227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:56.338908 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG dbcounter [-] [103227] Writing DB stats nova_cell0:SELECT=3 {{(pid=103227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:56.339726 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG dbcounter [-] [103227] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:56.548878 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi [None req-b46adadb-3dd1-46b6-ac11-5dd7c179ce05 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:15:56.551543 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 19:15:56.551543 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: warnings.warn(msg) Jul 20 19:15:56.635552 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: INFO nova.api.openstack.requestlog [None req-b46adadb-3dd1-46b6-ac11-5dd7c179ce05 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.303788 Jul 20 19:15:56.645576 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: [pid: 103227|app: 0|req: 4/6] 10.222.0.69 () {64 vars in 1335 bytes} [Wed Jul 20 19:15:56 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:15:59.004274 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi [None req-5f20ae74-4e73-4b44-b8dd-7231fc250425 admin admin] Calling method '>' {{(pid=103228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:15:59.005951 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: INFO nova.api.openstack.requestlog [None req-5f20ae74-4e73-4b44-b8dd-7231fc250425 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002080 Jul 20 19:15:59.006520 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: [pid: 103228|app: 0|req: 3/7] 10.222.0.69 () {54 vars in 930 bytes} [Wed Jul 20 19:15:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:15:59.668022 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi [None req-261ade43-782e-43f9-80dd-0e45e46f281f admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 512, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "swap": 0, "disk": 5, "name": "ds512M", "vcpus": 1}} {{(pid=103227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:15:59.685981 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 19:15:59.685981 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: warnings.warn(msg) Jul 20 19:15:59.705617 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: INFO nova.api.openstack.requestlog [None req-261ade43-782e-43f9-80dd-0e45e46f281f admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.693010 Jul 20 19:15:59.706160 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: [pid: 103227|app: 0|req: 5/8] 10.222.0.69 () {64 vars in 1282 bytes} [Wed Jul 20 19:15:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 19:15:59.719542 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi [None req-655af5fe-124f-499e-b1c1-7f60047533f2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:15:59.721240 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 19:15:59.721240 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: warnings.warn(msg) Jul 20 19:15:59.756382 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: INFO nova.api.openstack.requestlog [None req-655af5fe-124f-499e-b1c1-7f60047533f2 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041134 Jul 20 19:15:59.757404 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: [pid: 103228|app: 0|req: 4/9] 10.222.0.69 () {64 vars in 1335 bytes} [Wed Jul 20 19:15:59 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:16:02.243297 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi [None req-261ade43-782e-43f9-80dd-0e45e46f281f admin admin] Calling method '>' {{(pid=103227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:16:02.244330 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: INFO nova.api.openstack.requestlog [None req-261ade43-782e-43f9-80dd-0e45e46f281f admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Jul 20 19:16:02.244773 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: [pid: 103227|app: 0|req: 6/10] 10.222.0.69 () {54 vars in 930 bytes} [Wed Jul 20 19:16:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:16:02.603907 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi [None req-da401cb6-1b35-43e9-a38b-ee574dc0b63f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "ram": 1024, "swap": 0, "disk": 10, "id": "d2", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=103228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:16:02.622808 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: INFO nova.api.openstack.requestlog [None req-da401cb6-1b35-43e9-a38b-ee574dc0b63f admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.371925 Jul 20 19:16:02.623353 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: [pid: 103228|app: 0|req: 5/11] 10.222.0.69 () {64 vars in 1282 bytes} [Wed Jul 20 19:16:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 19:16:02.635054 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi [None req-a1e8d76e-9fa9-4e8b-9250-4a240f3617ab admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:16:02.658456 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: INFO nova.api.openstack.requestlog [None req-a1e8d76e-9fa9-4e8b-9250-4a240f3617ab admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027026 Jul 20 19:16:02.659424 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: [pid: 103227|app: 0|req: 7/12] 10.222.0.69 () {64 vars in 1335 bytes} [Wed Jul 20 19:16:02 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:16:04.924863 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi [None req-da401cb6-1b35-43e9-a38b-ee574dc0b63f admin admin] Calling method '>' {{(pid=103228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:16:04.925894 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: INFO nova.api.openstack.requestlog [None req-da401cb6-1b35-43e9-a38b-ee574dc0b63f admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Jul 20 19:16:04.926306 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: [pid: 103228|app: 0|req: 6/13] 10.222.0.69 () {54 vars in 930 bytes} [Wed Jul 20 19:16:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:16:05.356006 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi [None req-356929ce-26fd-4829-b455-32a7825d2e7c admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "name": "ds2G", "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "disk": 10, "ram": 2048}} {{(pid=103227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:16:05.379677 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: INFO nova.api.openstack.requestlog [None req-356929ce-26fd-4829-b455-32a7825d2e7c admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.447091 Jul 20 19:16:05.380307 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: [pid: 103227|app: 0|req: 8/14] 10.222.0.69 () {64 vars in 1282 bytes} [Wed Jul 20 19:16:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 19:16:05.393413 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi [None req-7a27d0ba-3b86-4eee-8c93-1c5c4d3f5369 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:16:05.415573 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: INFO nova.api.openstack.requestlog [None req-7a27d0ba-3b86-4eee-8c93-1c5c4d3f5369 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026306 Jul 20 19:16:05.416145 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: [pid: 103228|app: 0|req: 7/15] 10.222.0.69 () {64 vars in 1335 bytes} [Wed Jul 20 19:16:05 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:16:07.706207 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi [None req-356929ce-26fd-4829-b455-32a7825d2e7c admin admin] Calling method '>' {{(pid=103227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:16:07.707222 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: INFO nova.api.openstack.requestlog [None req-356929ce-26fd-4829-b455-32a7825d2e7c admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jul 20 19:16:07.707637 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: [pid: 103227|app: 0|req: 9/16] 10.222.0.69 () {54 vars in 930 bytes} [Wed Jul 20 19:16:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:16:08.134500 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi [None req-7999cd63-4519-44cc-9b6a-5ffb8605ae0f admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "name": "ds4G", "rxtx_factor": 1.0, "id": "d4"}} {{(pid=103228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:16:08.153363 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: INFO nova.api.openstack.requestlog [None req-7999cd63-4519-44cc-9b6a-5ffb8605ae0f admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.439830 Jul 20 19:16:08.154240 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: [pid: 103228|app: 0|req: 8/17] 10.222.0.69 () {64 vars in 1282 bytes} [Wed Jul 20 19:16:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 19:16:08.167171 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi [None req-dcb19cb7-5fe1-47e4-b131-b65f10563089 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:16:08.191777 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: INFO nova.api.openstack.requestlog [None req-dcb19cb7-5fe1-47e4-b131-b65f10563089 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028936 Jul 20 19:16:08.192473 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: [pid: 103227|app: 0|req: 10/18] 10.222.0.69 () {64 vars in 1335 bytes} [Wed Jul 20 19:16:08 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:16:10.499067 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi [None req-7999cd63-4519-44cc-9b6a-5ffb8605ae0f admin admin] Calling method '>' {{(pid=103228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:16:10.500011 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: INFO nova.api.openstack.requestlog [None req-7999cd63-4519-44cc-9b6a-5ffb8605ae0f admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Jul 20 19:16:10.500434 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: [pid: 103228|app: 0|req: 9/19] 10.222.0.69 () {54 vars in 930 bytes} [Wed Jul 20 19:16:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:16:10.943356 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi [None req-a115f33e-d820-4a05-8c43-15bac84a84bf admin admin] Calling method '>' {{(pid=103227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:16:10.967155 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: INFO nova.api.openstack.requestlog [None req-a115f33e-d820-4a05-8c43-15bac84a84bf admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.460565 Jul 20 19:16:10.967690 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: [pid: 103227|app: 0|req: 11/20] 10.222.0.69 () {60 vars in 1291 bytes} [Wed Jul 20 19:16:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:16:13.281218 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi [None req-7999cd63-4519-44cc-9b6a-5ffb8605ae0f admin admin] Calling method '>' {{(pid=103228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:16:13.282262 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: INFO nova.api.openstack.requestlog [None req-7999cd63-4519-44cc-9b6a-5ffb8605ae0f admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Jul 20 19:16:13.282655 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: [pid: 103228|app: 0|req: 10/21] 10.222.0.69 () {54 vars in 930 bytes} [Wed Jul 20 19:16:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:16:13.719583 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi [None req-421b82de-d173-4eff-8134-56683f4a2385 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "vcpus": 1, "ram": 512, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "1", "swap": 0, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:16:13.740725 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: INFO nova.api.openstack.requestlog [None req-421b82de-d173-4eff-8134-56683f4a2385 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.451946 Jul 20 19:16:13.741705 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: [pid: 103227|app: 0|req: 12/22] 10.222.0.69 () {64 vars in 1282 bytes} [Wed Jul 20 19:16:13 2022] POST /compute/v2.1/flavors => generated 402 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 19:16:13.754691 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi [None req-bfb63bfd-8231-4bed-a384-48dfe643b87b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:16:13.779026 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: INFO nova.api.openstack.requestlog [None req-bfb63bfd-8231-4bed-a384-48dfe643b87b admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028103 Jul 20 19:16:13.779618 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: [pid: 103228|app: 0|req: 11/23] 10.222.0.69 () {64 vars in 1332 bytes} [Wed Jul 20 19:16:13 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:16:16.012778 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi [None req-421b82de-d173-4eff-8134-56683f4a2385 admin admin] Calling method '>' {{(pid=103227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:16:16.013804 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: INFO nova.api.openstack.requestlog [None req-421b82de-d173-4eff-8134-56683f4a2385 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jul 20 19:16:16.014370 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: [pid: 103227|app: 0|req: 13/24] 10.222.0.69 () {54 vars in 930 bytes} [Wed Jul 20 19:16:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:16:16.426382 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi [None req-33246e0c-4d25-46e9-a278-c0d25038955b admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "name": "m1.small", "ram": 2048, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "disk": 20, "vcpus": 1}} {{(pid=103228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:16:16.444776 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: INFO nova.api.openstack.requestlog [None req-33246e0c-4d25-46e9-a278-c0d25038955b admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.424767 Jul 20 19:16:16.445259 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: [pid: 103228|app: 0|req: 12/25] 10.222.0.69 () {64 vars in 1282 bytes} [Wed Jul 20 19:16:16 2022] POST /compute/v2.1/flavors => generated 405 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 19:16:16.457502 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi [None req-db67b5e6-8d4c-4070-a0f7-7ff49479da57 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:16:16.479992 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: INFO nova.api.openstack.requestlog [None req-db67b5e6-8d4c-4070-a0f7-7ff49479da57 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025978 Jul 20 19:16:16.480579 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: [pid: 103227|app: 0|req: 14/26] 10.222.0.69 () {64 vars in 1332 bytes} [Wed Jul 20 19:16:16 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:16:18.735802 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi [None req-33246e0c-4d25-46e9-a278-c0d25038955b admin admin] Calling method '>' {{(pid=103228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:16:18.737031 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: INFO nova.api.openstack.requestlog [None req-33246e0c-4d25-46e9-a278-c0d25038955b admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001648 Jul 20 19:16:18.737539 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: [pid: 103228|app: 0|req: 13/27] 10.222.0.69 () {54 vars in 930 bytes} [Wed Jul 20 19:16:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:16:19.152069 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi [None req-c2114646-8de4-4a96-bee1-e0aaff67330b admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "id": "3", "vcpus": 2, "name": "m1.medium", "disk": 40, "rxtx_factor": 1.0, "swap": 0}} {{(pid=103227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:16:19.170218 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: INFO nova.api.openstack.requestlog [None req-c2114646-8de4-4a96-bee1-e0aaff67330b admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.426520 Jul 20 19:16:19.170779 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: [pid: 103227|app: 0|req: 15/28] 10.222.0.69 () {64 vars in 1282 bytes} [Wed Jul 20 19:16:18 2022] POST /compute/v2.1/flavors => generated 406 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 19:16:19.183285 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi [None req-d619f515-4f9f-424d-afc0-3dbeb9080cd9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:16:19.205992 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: INFO nova.api.openstack.requestlog [None req-d619f515-4f9f-424d-afc0-3dbeb9080cd9 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027037 Jul 20 19:16:19.206576 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: [pid: 103228|app: 0|req: 14/29] 10.222.0.69 () {64 vars in 1332 bytes} [Wed Jul 20 19:16:19 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:16:21.523300 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi [None req-c2114646-8de4-4a96-bee1-e0aaff67330b admin admin] Calling method '>' {{(pid=103227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:16:21.525040 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: INFO nova.api.openstack.requestlog [None req-c2114646-8de4-4a96-bee1-e0aaff67330b admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002256 Jul 20 19:16:21.526584 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: [pid: 103227|app: 0|req: 16/30] 10.222.0.69 () {54 vars in 930 bytes} [Wed Jul 20 19:16:21 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:16:21.998030 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi [None req-903436cc-0997-46a7-9091-3115f10d997e admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 8192, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "id": "4", "swap": 0, "disk": 80, "os-flavor-access:is_public": true}} {{(pid=103228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:16:22.069309 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: INFO nova.api.openstack.requestlog [None req-903436cc-0997-46a7-9091-3115f10d997e admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.536348 Jul 20 19:16:22.070628 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: [pid: 103228|app: 0|req: 15/31] 10.222.0.69 () {64 vars in 1282 bytes} [Wed Jul 20 19:16:21 2022] POST /compute/v2.1/flavors => generated 405 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 19:16:22.084070 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi [None req-25534fdb-7380-4a20-9c3c-45a11b623e6b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:16:22.108752 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: INFO nova.api.openstack.requestlog [None req-25534fdb-7380-4a20-9c3c-45a11b623e6b admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028602 Jul 20 19:16:22.109340 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: [pid: 103227|app: 0|req: 17/32] 10.222.0.69 () {64 vars in 1332 bytes} [Wed Jul 20 19:16:22 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:16:24.381973 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi [None req-903436cc-0997-46a7-9091-3115f10d997e admin admin] Calling method '>' {{(pid=103228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:16:24.383073 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: INFO nova.api.openstack.requestlog [None req-903436cc-0997-46a7-9091-3115f10d997e admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001584 Jul 20 19:16:24.383556 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: [pid: 103228|app: 0|req: 16/33] 10.222.0.69 () {54 vars in 930 bytes} [Wed Jul 20 19:16:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:16:24.842032 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi [None req-4e09973c-2397-4e1e-8e1a-50562884920d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "ram": 16384, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "5", "disk": 160, "vcpus": 8}} {{(pid=103227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:16:24.864002 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: INFO nova.api.openstack.requestlog [None req-4e09973c-2397-4e1e-8e1a-50562884920d admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.473696 Jul 20 19:16:24.865319 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: [pid: 103227|app: 0|req: 18/34] 10.222.0.69 () {64 vars in 1282 bytes} [Wed Jul 20 19:16:24 2022] POST /compute/v2.1/flavors => generated 408 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 19:16:24.879102 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi [None req-65d0472a-b3f4-497f-b975-f15eca035cd4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:16:24.883762 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG dbcounter [-] [103228] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:24.914851 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: INFO nova.api.openstack.requestlog [None req-65d0472a-b3f4-497f-b975-f15eca035cd4 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040149 Jul 20 19:16:24.925610 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: [pid: 103228|app: 0|req: 17/35] 10.222.0.69 () {64 vars in 1332 bytes} [Wed Jul 20 19:16:24 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:16:45.271697 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi [None req-4e09973c-2397-4e1e-8e1a-50562884920d admin admin] Calling method '>' {{(pid=103227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:16:45.272700 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: INFO nova.api.openstack.requestlog [None req-4e09973c-2397-4e1e-8e1a-50562884920d admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jul 20 19:16:45.273097 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: [pid: 103227|app: 0|req: 19/36] 10.222.0.69 () {54 vars in 930 bytes} [Wed Jul 20 19:16:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:16:45.283719 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG dbcounter [-] [103228] Writing DB stats nova_api:SELECT=5,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:45.664167 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi [None req-ed1fc33a-9a6d-4ba5-8dd6-09487e100f80 admin admin] Calling method '>' {{(pid=103228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:16:45.681288 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: INFO nova.api.openstack.requestlog [None req-ed1fc33a-9a6d-4ba5-8dd6-09487e100f80 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.401917 Jul 20 19:16:45.681854 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: [pid: 103228|app: 0|req: 18/37] 10.222.0.69 () {60 vars in 1291 bytes} [Wed Jul 20 19:16:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:16:46.758102 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi [None req-4e09973c-2397-4e1e-8e1a-50562884920d admin admin] Calling method '>' {{(pid=103227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:16:46.759143 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: INFO nova.api.openstack.requestlog [None req-4e09973c-2397-4e1e-8e1a-50562884920d admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Jul 20 19:16:46.759573 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: [pid: 103227|app: 0|req: 20/38] 10.222.0.69 () {56 vars in 1074 bytes} [Wed Jul 20 19:16:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:16:47.293538 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi [None req-329b0643-854c-4ad4-980e-05601a5535cf admin admin] Calling method '>' {{(pid=103228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:16:47.299765 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: INFO nova.api.openstack.wsgi [None req-329b0643-854c-4ad4-980e-05601a5535cf admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 20 19:16:47.303391 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi [None req-329b0643-854c-4ad4-980e-05601a5535cf admin admin] Request method failure captured: Jul 20 19:16:47.303391 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 20 19:16:47.303391 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: Accept: application/json Jul 20 19:16:47.303391 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: Accept-Encoding: gzip, deflate Jul 20 19:16:47.303391 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: Connection: keep-alive Jul 20 19:16:47.303391 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: Content-Length: 0 Jul 20 19:16:47.303391 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: Host: 10.222.0.69 Jul 20 19:16:47.303391 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: Openstack-Api-Version: compute 2.90 Jul 20 19:16:47.303391 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: Openstack-System-Scope: None Jul 20 19:16:47.303391 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: User-Agent: python-novaclient Jul 20 19:16:47.303391 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: X-Auth-Token: gAAAAABi2FSeH6ao2MCG_w8Ru1R86gRvPoSYFO9E5Dpk0AZsu7elTdwa5h4LShvrb9aPdbTmeN-18qUZUxTUSuzNh50xsgKnPPPyazxfPtfirhPJBaZEzs3DYcYmh6ZLSubBv4nrme1c6wUa6c3NxElXMP3Zrud0EKKoQ0G8FUaBTBDUv3_gd5o Jul 20 19:16:47.303391 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: X-Domain-Id: None Jul 20 19:16:47.303391 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: X-Domain-Name: None Jul 20 19:16:47.303391 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: X-Identity-Status: Confirmed Jul 20 19:16:47.303391 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: X-Is-Admin-Project: True Jul 20 19:16:47.303391 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 19:16:47.303391 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: X-Project-Domain-Id: default Jul 20 19:16:47.303391 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: X-Project-Domain-Name: Default Jul 20 19:16:47.303391 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: X-Project-Id: 1a14d1da63be4e14a0cb08d341815ffe Jul 20 19:16:47.303391 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: X-Project-Name: admin Jul 20 19:16:47.303391 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: X-Role: reader,admin,member Jul 20 19:16:47.303391 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: X-Roles: reader,admin,member Jul 20 19:16:47.305108 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1a14d1da63be4e14a0cb08d341815ffe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1a14d1da63be4e14a0cb08d341815ffe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_1a14d1da63be4e14a0cb08d341815ffe", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/1a14d1da63be4e14a0cb08d341815ffe"}]}] Jul 20 19:16:47.305108 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: X-Tenant: admin Jul 20 19:16:47.305108 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: X-Tenant-Id: 1a14d1da63be4e14a0cb08d341815ffe Jul 20 19:16:47.305108 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: X-Tenant-Name: admin Jul 20 19:16:47.305108 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: X-User: admin Jul 20 19:16:47.305108 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: X-User-Domain-Id: default Jul 20 19:16:47.305108 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: X-User-Domain-Name: Default Jul 20 19:16:47.305108 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: X-User-Id: c9cf50bf3f924b6dac930c74893f5fb5 Jul 20 19:16:47.305108 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: X-User-Name: admin Jul 20 19:16:47.305108 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: method: > Jul 20 19:16:47.305108 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: exception: Flavor 42 could not be found. Jul 20 19:16:47.305108 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: action_args: {'id': '42'} Jul 20 19:16:47.305108 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: {{(pid=103228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:16:47.305108 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:16:47.306164 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 19:16:47.306164 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 19:16:47.306164 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 19:16:47.306164 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 19:16:47.306164 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 19:16:47.306164 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 19:16:47.306164 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 19:16:47.306164 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 19:16:47.306164 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 19:16:47.306164 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:16:47.306164 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 19:16:47.306164 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 19:16:47.306164 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 20 19:16:47.306164 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi Jul 20 19:16:47.306164 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:16:47.306164 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi Jul 20 19:16:47.306164 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:16:47.306164 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:16:47.306164 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:16:47.308044 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:16:47.308044 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:16:47.308044 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:16:47.308044 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:16:47.308044 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 19:16:47.308044 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:16:47.308044 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 20 19:16:47.308044 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi Jul 20 19:16:47.308044 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:16:47.308044 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi Jul 20 19:16:47.308044 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:16:47.308044 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:16:47.308044 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:16:47.308044 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:16:47.308044 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:16:47.308044 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 20 19:16:47.308044 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi Jul 20 19:16:47.308044 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi [None req-329b0643-854c-4ad4-980e-05601a5535cf admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:16:47.309901 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: INFO nova.api.openstack.requestlog [None req-329b0643-854c-4ad4-980e-05601a5535cf admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.404922 Jul 20 19:16:47.309901 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: [pid: 103228|app: 0|req: 19/39] 10.222.0.69 () {60 vars in 1190 bytes} [Wed Jul 20 19:16:46 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 406 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 19:16:47.315742 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi [None req-9923b67c-b9df-4d4c-ba01-f65fe5176aa4 admin admin] Calling method '>' {{(pid=103227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:16:47.319333 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG dbcounter [-] [103227] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:47.344180 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: INFO nova.api.openstack.requestlog [None req-9923b67c-b9df-4d4c-ba01-f65fe5176aa4 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.032426 Jul 20 19:16:47.345024 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: [pid: 103227|app: 0|req: 21/40] 10.222.0.69 () {60 vars in 1210 bytes} [Wed Jul 20 19:16:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:16:47.356478 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi [None req-4398999e-d4df-4a56-9b83-8bf322607ede admin admin] Calling method '>' {{(pid=103228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:16:47.378178 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: INFO nova.api.openstack.requestlog [None req-4398999e-d4df-4a56-9b83-8bf322607ede admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026694 Jul 20 19:16:47.378734 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: [pid: 103228|app: 0|req: 20/41] 10.222.0.69 () {60 vars in 1210 bytes} [Wed Jul 20 19:16:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:16:47.388781 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi [None req-a211c670-fbfc-4876-b317-0910456558c6 admin admin] Calling method '>' {{(pid=103227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:16:47.395356 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: INFO nova.api.openstack.wsgi [None req-a211c670-fbfc-4876-b317-0910456558c6 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 20 19:16:47.398636 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi [None req-a211c670-fbfc-4876-b317-0910456558c6 admin admin] Request method failure captured: Jul 20 19:16:47.398636 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 20 19:16:47.398636 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: Accept: application/json Jul 20 19:16:47.398636 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: Accept-Encoding: gzip, deflate Jul 20 19:16:47.398636 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: Connection: keep-alive Jul 20 19:16:47.398636 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: Content-Length: 0 Jul 20 19:16:47.398636 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: Host: 10.222.0.69 Jul 20 19:16:47.398636 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: Openstack-Api-Version: compute 2.90 Jul 20 19:16:47.398636 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: Openstack-System-Scope: None Jul 20 19:16:47.398636 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: User-Agent: python-novaclient Jul 20 19:16:47.398636 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: X-Auth-Token: gAAAAABi2FSeH6ao2MCG_w8Ru1R86gRvPoSYFO9E5Dpk0AZsu7elTdwa5h4LShvrb9aPdbTmeN-18qUZUxTUSuzNh50xsgKnPPPyazxfPtfirhPJBaZEzs3DYcYmh6ZLSubBv4nrme1c6wUa6c3NxElXMP3Zrud0EKKoQ0G8FUaBTBDUv3_gd5o Jul 20 19:16:47.398636 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: X-Domain-Id: None Jul 20 19:16:47.398636 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: X-Domain-Name: None Jul 20 19:16:47.398636 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: X-Identity-Status: Confirmed Jul 20 19:16:47.398636 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: X-Is-Admin-Project: True Jul 20 19:16:47.398636 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 19:16:47.398636 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: X-Project-Domain-Id: default Jul 20 19:16:47.398636 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: X-Project-Domain-Name: Default Jul 20 19:16:47.398636 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: X-Project-Id: 1a14d1da63be4e14a0cb08d341815ffe Jul 20 19:16:47.398636 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: X-Project-Name: admin Jul 20 19:16:47.398636 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: X-Role: reader,admin,member Jul 20 19:16:47.398636 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: X-Roles: reader,admin,member Jul 20 19:16:47.400163 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1a14d1da63be4e14a0cb08d341815ffe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1a14d1da63be4e14a0cb08d341815ffe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_1a14d1da63be4e14a0cb08d341815ffe", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/1a14d1da63be4e14a0cb08d341815ffe"}]}] Jul 20 19:16:47.400163 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: X-Tenant: admin Jul 20 19:16:47.400163 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: X-Tenant-Id: 1a14d1da63be4e14a0cb08d341815ffe Jul 20 19:16:47.400163 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: X-Tenant-Name: admin Jul 20 19:16:47.400163 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: X-User: admin Jul 20 19:16:47.400163 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: X-User-Domain-Id: default Jul 20 19:16:47.400163 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: X-User-Domain-Name: Default Jul 20 19:16:47.400163 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: X-User-Id: c9cf50bf3f924b6dac930c74893f5fb5 Jul 20 19:16:47.400163 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: X-User-Name: admin Jul 20 19:16:47.400163 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: method: > Jul 20 19:16:47.400163 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: exception: Flavor 42 could not be found. Jul 20 19:16:47.400163 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: action_args: {'id': '42'} Jul 20 19:16:47.400163 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: {{(pid=103227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:16:47.400163 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:16:47.401483 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 19:16:47.401483 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 19:16:47.401483 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 19:16:47.401483 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 19:16:47.401483 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 19:16:47.401483 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 19:16:47.401483 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 19:16:47.401483 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 19:16:47.401483 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 19:16:47.401483 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:16:47.401483 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 19:16:47.401483 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 19:16:47.401483 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 20 19:16:47.401483 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi Jul 20 19:16:47.401483 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:16:47.401483 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi Jul 20 19:16:47.401483 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:16:47.401483 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:16:47.401483 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:16:47.402953 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:16:47.402953 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:16:47.402953 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:16:47.402953 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:16:47.402953 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 19:16:47.402953 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:16:47.402953 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 20 19:16:47.402953 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi Jul 20 19:16:47.402953 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:16:47.402953 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi Jul 20 19:16:47.402953 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:16:47.402953 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:16:47.402953 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:16:47.402953 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:16:47.402953 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:16:47.402953 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 20 19:16:47.402953 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi Jul 20 19:16:47.402953 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi [None req-a211c670-fbfc-4876-b317-0910456558c6 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103227) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:16:47.404276 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: INFO nova.api.openstack.requestlog [None req-a211c670-fbfc-4876-b317-0910456558c6 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015553 Jul 20 19:16:47.404276 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: [pid: 103227|app: 0|req: 22/42] 10.222.0.69 () {60 vars in 1190 bytes} [Wed Jul 20 19:16:47 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 20 19:16:48.366413 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi [None req-4398999e-d4df-4a56-9b83-8bf322607ede admin admin] Calling method '>' {{(pid=103228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:16:48.367419 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: INFO nova.api.openstack.requestlog [None req-4398999e-d4df-4a56-9b83-8bf322607ede admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jul 20 19:16:48.367819 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: [pid: 103228|app: 0|req: 21/43] 10.222.0.69 () {56 vars in 1074 bytes} [Wed Jul 20 19:16:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:16:48.895759 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi [None req-e90f3bf7-d2ec-4c09-ad14-1f33283a8c27 admin admin] Calling method '>' {{(pid=103227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:16:48.901631 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: INFO nova.api.openstack.wsgi [None req-e90f3bf7-d2ec-4c09-ad14-1f33283a8c27 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 20 19:16:48.903146 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi [None req-e90f3bf7-d2ec-4c09-ad14-1f33283a8c27 admin admin] Request method failure captured: Jul 20 19:16:48.903146 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 20 19:16:48.903146 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: Accept: application/json Jul 20 19:16:48.903146 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: Accept-Encoding: gzip, deflate Jul 20 19:16:48.903146 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: Connection: keep-alive Jul 20 19:16:48.903146 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: Content-Length: 0 Jul 20 19:16:48.903146 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: Host: 10.222.0.69 Jul 20 19:16:48.903146 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: Openstack-Api-Version: compute 2.90 Jul 20 19:16:48.903146 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: Openstack-System-Scope: None Jul 20 19:16:48.903146 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: User-Agent: python-novaclient Jul 20 19:16:48.903146 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: X-Auth-Token: gAAAAABi2FSgz9z1fsYihXu6Tng84_oQmvP_mPcvmadJM9s3tKdPK2NbRYe5-y-aOWvF2FED-ym1Dz18NXALdzTYDvO4NERPAN4os2A5vgvzKrOmG9dT353Qzorhp0ZaI20iF77wmVoblENdYIoeaWR7x-tnQsykp_J82Z3l0H3qLzQWMgnEbHc Jul 20 19:16:48.903146 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: X-Domain-Id: None Jul 20 19:16:48.903146 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: X-Domain-Name: None Jul 20 19:16:48.903146 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: X-Identity-Status: Confirmed Jul 20 19:16:48.903146 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: X-Is-Admin-Project: True Jul 20 19:16:48.903146 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 19:16:48.903146 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: X-Project-Domain-Id: default Jul 20 19:16:48.903146 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: X-Project-Domain-Name: Default Jul 20 19:16:48.903146 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: X-Project-Id: 1a14d1da63be4e14a0cb08d341815ffe Jul 20 19:16:48.903146 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: X-Project-Name: admin Jul 20 19:16:48.903146 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: X-Role: reader,admin,member Jul 20 19:16:48.903146 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: X-Roles: reader,admin,member Jul 20 19:16:48.904657 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1a14d1da63be4e14a0cb08d341815ffe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1a14d1da63be4e14a0cb08d341815ffe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_1a14d1da63be4e14a0cb08d341815ffe", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/1a14d1da63be4e14a0cb08d341815ffe"}]}] Jul 20 19:16:48.904657 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: X-Tenant: admin Jul 20 19:16:48.904657 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: X-Tenant-Id: 1a14d1da63be4e14a0cb08d341815ffe Jul 20 19:16:48.904657 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: X-Tenant-Name: admin Jul 20 19:16:48.904657 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: X-User: admin Jul 20 19:16:48.904657 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: X-User-Domain-Id: default Jul 20 19:16:48.904657 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: X-User-Domain-Name: Default Jul 20 19:16:48.904657 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: X-User-Id: c9cf50bf3f924b6dac930c74893f5fb5 Jul 20 19:16:48.904657 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: X-User-Name: admin Jul 20 19:16:48.904657 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: method: > Jul 20 19:16:48.904657 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: exception: Flavor 84 could not be found. Jul 20 19:16:48.904657 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: action_args: {'id': '84'} Jul 20 19:16:48.904657 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: {{(pid=103227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:16:48.904657 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:16:48.905742 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 19:16:48.905742 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 19:16:48.905742 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 19:16:48.905742 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 19:16:48.905742 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 19:16:48.905742 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 19:16:48.905742 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 19:16:48.905742 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 19:16:48.905742 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 19:16:48.905742 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:16:48.905742 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 19:16:48.905742 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 19:16:48.905742 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 20 19:16:48.905742 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi Jul 20 19:16:48.905742 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:16:48.905742 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi Jul 20 19:16:48.905742 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:16:48.905742 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:16:48.905742 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:16:48.907147 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:16:48.907147 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:16:48.907147 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:16:48.907147 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:16:48.907147 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 19:16:48.907147 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:16:48.907147 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 20 19:16:48.907147 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi Jul 20 19:16:48.907147 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:16:48.907147 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi Jul 20 19:16:48.907147 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:16:48.907147 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:16:48.907147 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:16:48.907147 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:16:48.907147 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:16:48.907147 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 20 19:16:48.907147 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi Jul 20 19:16:48.907147 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi [None req-e90f3bf7-d2ec-4c09-ad14-1f33283a8c27 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103227) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:16:48.908441 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: INFO nova.api.openstack.requestlog [None req-e90f3bf7-d2ec-4c09-ad14-1f33283a8c27 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.399411 Jul 20 19:16:48.908441 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: [pid: 103227|app: 0|req: 23/44] 10.222.0.69 () {60 vars in 1190 bytes} [Wed Jul 20 19:16:48 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 19:16:48.914210 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi [None req-4aca6485-1422-4efc-aa41-0f833fbaeb3f admin admin] Calling method '>' {{(pid=103228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:16:48.928601 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: INFO nova.api.openstack.requestlog [None req-4aca6485-1422-4efc-aa41-0f833fbaeb3f admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017919 Jul 20 19:16:48.929150 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: [pid: 103228|app: 0|req: 22/45] 10.222.0.69 () {60 vars in 1210 bytes} [Wed Jul 20 19:16:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:16:48.939057 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi [None req-7efe648c-f92b-4577-860f-d1e1c24409b2 admin admin] Calling method '>' {{(pid=103227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:16:48.953809 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: INFO nova.api.openstack.requestlog [None req-7efe648c-f92b-4577-860f-d1e1c24409b2 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018293 Jul 20 19:16:48.954540 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: [pid: 103227|app: 0|req: 24/46] 10.222.0.69 () {60 vars in 1210 bytes} [Wed Jul 20 19:16:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:16:48.964448 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi [None req-8b6aa7b3-c4dc-41aa-abcc-ee81094a49a5 admin admin] Calling method '>' {{(pid=103228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:16:48.970153 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: INFO nova.api.openstack.wsgi [None req-8b6aa7b3-c4dc-41aa-abcc-ee81094a49a5 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 20 19:16:48.971660 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi [None req-8b6aa7b3-c4dc-41aa-abcc-ee81094a49a5 admin admin] Request method failure captured: Jul 20 19:16:48.971660 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 20 19:16:48.971660 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: Accept: application/json Jul 20 19:16:48.971660 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: Accept-Encoding: gzip, deflate Jul 20 19:16:48.971660 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: Connection: keep-alive Jul 20 19:16:48.971660 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: Content-Length: 0 Jul 20 19:16:48.971660 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: Host: 10.222.0.69 Jul 20 19:16:48.971660 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: Openstack-Api-Version: compute 2.90 Jul 20 19:16:48.971660 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: Openstack-System-Scope: None Jul 20 19:16:48.971660 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: User-Agent: python-novaclient Jul 20 19:16:48.971660 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: X-Auth-Token: gAAAAABi2FSgz9z1fsYihXu6Tng84_oQmvP_mPcvmadJM9s3tKdPK2NbRYe5-y-aOWvF2FED-ym1Dz18NXALdzTYDvO4NERPAN4os2A5vgvzKrOmG9dT353Qzorhp0ZaI20iF77wmVoblENdYIoeaWR7x-tnQsykp_J82Z3l0H3qLzQWMgnEbHc Jul 20 19:16:48.971660 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: X-Domain-Id: None Jul 20 19:16:48.971660 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: X-Domain-Name: None Jul 20 19:16:48.971660 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: X-Identity-Status: Confirmed Jul 20 19:16:48.971660 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: X-Is-Admin-Project: True Jul 20 19:16:48.971660 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 19:16:48.971660 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: X-Project-Domain-Id: default Jul 20 19:16:48.971660 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: X-Project-Domain-Name: Default Jul 20 19:16:48.971660 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: X-Project-Id: 1a14d1da63be4e14a0cb08d341815ffe Jul 20 19:16:48.971660 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: X-Project-Name: admin Jul 20 19:16:48.971660 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: X-Role: reader,admin,member Jul 20 19:16:48.971660 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: X-Roles: reader,admin,member Jul 20 19:16:48.973177 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1a14d1da63be4e14a0cb08d341815ffe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1a14d1da63be4e14a0cb08d341815ffe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_1a14d1da63be4e14a0cb08d341815ffe", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/1a14d1da63be4e14a0cb08d341815ffe"}]}] Jul 20 19:16:48.973177 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: X-Tenant: admin Jul 20 19:16:48.973177 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: X-Tenant-Id: 1a14d1da63be4e14a0cb08d341815ffe Jul 20 19:16:48.973177 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: X-Tenant-Name: admin Jul 20 19:16:48.973177 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: X-User: admin Jul 20 19:16:48.973177 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: X-User-Domain-Id: default Jul 20 19:16:48.973177 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: X-User-Domain-Name: Default Jul 20 19:16:48.973177 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: X-User-Id: c9cf50bf3f924b6dac930c74893f5fb5 Jul 20 19:16:48.973177 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: X-User-Name: admin Jul 20 19:16:48.973177 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: method: > Jul 20 19:16:48.973177 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: exception: Flavor 84 could not be found. Jul 20 19:16:48.973177 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: action_args: {'id': '84'} Jul 20 19:16:48.973177 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: {{(pid=103228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:16:48.973177 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:16:48.974220 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 19:16:48.974220 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 19:16:48.974220 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 19:16:48.974220 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 19:16:48.974220 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 19:16:48.974220 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 19:16:48.974220 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 19:16:48.974220 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 19:16:48.974220 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 19:16:48.974220 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:16:48.974220 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 19:16:48.974220 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 19:16:48.974220 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 20 19:16:48.974220 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi Jul 20 19:16:48.974220 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:16:48.974220 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi Jul 20 19:16:48.974220 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:16:48.974220 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:16:48.974220 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:16:48.975546 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:16:48.975546 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:16:48.975546 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:16:48.975546 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:16:48.975546 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 19:16:48.975546 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:16:48.975546 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 20 19:16:48.975546 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi Jul 20 19:16:48.975546 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:16:48.975546 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi Jul 20 19:16:48.975546 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:16:48.975546 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:16:48.975546 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:16:48.975546 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:16:48.975546 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:16:48.975546 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 20 19:16:48.975546 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi Jul 20 19:16:48.975546 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi [None req-8b6aa7b3-c4dc-41aa-abcc-ee81094a49a5 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:16:48.976760 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: INFO nova.api.openstack.requestlog [None req-8b6aa7b3-c4dc-41aa-abcc-ee81094a49a5 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012847 Jul 20 19:16:48.976760 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: [pid: 103228|app: 0|req: 23/47] 10.222.0.69 () {60 vars in 1190 bytes} [Wed Jul 20 19:16:48 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 19:16:49.954135 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi [None req-7efe648c-f92b-4577-860f-d1e1c24409b2 admin admin] Calling method '>' {{(pid=103227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:16:49.955171 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: INFO nova.api.openstack.requestlog [None req-7efe648c-f92b-4577-860f-d1e1c24409b2 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Jul 20 19:16:49.955572 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: [pid: 103227|app: 0|req: 25/48] 10.222.0.69 () {56 vars in 1074 bytes} [Wed Jul 20 19:16:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:16:50.523906 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi [None req-f1e7c912-2438-4ae3-9de1-15359e3606b3 admin admin] Calling method '>' {{(pid=103228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:16:50.530524 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: INFO nova.api.openstack.wsgi [None req-f1e7c912-2438-4ae3-9de1-15359e3606b3 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 20 19:16:50.532027 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi [None req-f1e7c912-2438-4ae3-9de1-15359e3606b3 admin admin] Request method failure captured: Jul 20 19:16:50.532027 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 20 19:16:50.532027 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: Accept: application/json Jul 20 19:16:50.532027 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: Accept-Encoding: gzip, deflate Jul 20 19:16:50.532027 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: Connection: keep-alive Jul 20 19:16:50.532027 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: Content-Length: 0 Jul 20 19:16:50.532027 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: Host: 10.222.0.69 Jul 20 19:16:50.532027 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: Openstack-Api-Version: compute 2.90 Jul 20 19:16:50.532027 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: Openstack-System-Scope: None Jul 20 19:16:50.532027 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: User-Agent: python-novaclient Jul 20 19:16:50.532027 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: X-Auth-Token: gAAAAABi2FShjoIlDYq8V6X1uCdSLuGXDIN9SySeZym4n3GMiBLjT0TRCaGZ61QL-imN7Go7j9UTVwxn9gVmpWzLCDFAgD6cQPhp3lGjVDiQeGhMz51eiBjUr_YDJvfz5AIl_JJEOQlH7So-A5_WWQkqkp0lO-EQZliuzhUy0H70V6mDoRFywcM Jul 20 19:16:50.532027 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: X-Domain-Id: None Jul 20 19:16:50.532027 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: X-Domain-Name: None Jul 20 19:16:50.532027 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: X-Identity-Status: Confirmed Jul 20 19:16:50.532027 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: X-Is-Admin-Project: True Jul 20 19:16:50.532027 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 19:16:50.532027 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: X-Project-Domain-Id: default Jul 20 19:16:50.532027 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: X-Project-Domain-Name: Default Jul 20 19:16:50.532027 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: X-Project-Id: 1a14d1da63be4e14a0cb08d341815ffe Jul 20 19:16:50.532027 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: X-Project-Name: admin Jul 20 19:16:50.532027 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: X-Role: reader,admin,member Jul 20 19:16:50.532027 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: X-Roles: reader,admin,member Jul 20 19:16:50.533724 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1a14d1da63be4e14a0cb08d341815ffe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1a14d1da63be4e14a0cb08d341815ffe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_1a14d1da63be4e14a0cb08d341815ffe", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/1a14d1da63be4e14a0cb08d341815ffe"}]}] Jul 20 19:16:50.533724 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: X-Tenant: admin Jul 20 19:16:50.533724 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: X-Tenant-Id: 1a14d1da63be4e14a0cb08d341815ffe Jul 20 19:16:50.533724 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: X-Tenant-Name: admin Jul 20 19:16:50.533724 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: X-User: admin Jul 20 19:16:50.533724 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: X-User-Domain-Id: default Jul 20 19:16:50.533724 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: X-User-Domain-Name: Default Jul 20 19:16:50.533724 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: X-User-Id: c9cf50bf3f924b6dac930c74893f5fb5 Jul 20 19:16:50.533724 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: X-User-Name: admin Jul 20 19:16:50.533724 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: method: > Jul 20 19:16:50.533724 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: exception: Flavor 451 could not be found. Jul 20 19:16:50.533724 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: action_args: {'id': '451'} Jul 20 19:16:50.533724 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: {{(pid=103228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:16:50.533724 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:16:50.534607 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 19:16:50.534607 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 19:16:50.534607 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 19:16:50.534607 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 19:16:50.534607 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 19:16:50.534607 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 19:16:50.534607 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 19:16:50.534607 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 19:16:50.534607 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 19:16:50.534607 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:16:50.534607 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 19:16:50.534607 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 19:16:50.534607 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 20 19:16:50.534607 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi Jul 20 19:16:50.534607 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:16:50.534607 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi Jul 20 19:16:50.534607 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:16:50.534607 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:16:50.534607 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:16:50.535736 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:16:50.535736 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:16:50.535736 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:16:50.535736 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:16:50.535736 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 19:16:50.535736 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:16:50.535736 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 20 19:16:50.535736 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi Jul 20 19:16:50.535736 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:16:50.535736 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi Jul 20 19:16:50.535736 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:16:50.535736 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:16:50.535736 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:16:50.535736 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:16:50.535736 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:16:50.535736 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 20 19:16:50.535736 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: ERROR nova.api.openstack.wsgi Jul 20 19:16:50.535736 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi [None req-f1e7c912-2438-4ae3-9de1-15359e3606b3 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:16:50.536765 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: INFO nova.api.openstack.requestlog [None req-f1e7c912-2438-4ae3-9de1-15359e3606b3 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.436008 Jul 20 19:16:50.536765 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: [pid: 103228|app: 0|req: 24/49] 10.222.0.69 () {60 vars in 1193 bytes} [Wed Jul 20 19:16:50 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 437 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 19:16:50.543660 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi [None req-46199465-9c03-4689-b4c7-438c6ba51d59 admin admin] Calling method '>' {{(pid=103227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:16:50.557953 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: INFO nova.api.openstack.requestlog [None req-46199465-9c03-4689-b4c7-438c6ba51d59 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017715 Jul 20 19:16:50.558543 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: [pid: 103227|app: 0|req: 26/50] 10.222.0.69 () {60 vars in 1210 bytes} [Wed Jul 20 19:16:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:16:50.568219 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi [None req-28e0bdfa-0519-44b9-a8c8-1d799c8bce31 admin admin] Calling method '>' {{(pid=103228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:16:50.583163 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: INFO nova.api.openstack.requestlog [None req-28e0bdfa-0519-44b9-a8c8-1d799c8bce31 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018601 Jul 20 19:16:50.583708 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: [pid: 103228|app: 0|req: 25/51] 10.222.0.69 () {60 vars in 1210 bytes} [Wed Jul 20 19:16:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:16:50.593210 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi [None req-877643eb-d24d-4c33-967a-cb531ef934f7 admin admin] Calling method '>' {{(pid=103227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:16:50.598823 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: INFO nova.api.openstack.wsgi [None req-877643eb-d24d-4c33-967a-cb531ef934f7 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 20 19:16:50.600313 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi [None req-877643eb-d24d-4c33-967a-cb531ef934f7 admin admin] Request method failure captured: Jul 20 19:16:50.600313 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 20 19:16:50.600313 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: Accept: application/json Jul 20 19:16:50.600313 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: Accept-Encoding: gzip, deflate Jul 20 19:16:50.600313 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: Connection: keep-alive Jul 20 19:16:50.600313 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: Content-Length: 0 Jul 20 19:16:50.600313 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: Host: 10.222.0.69 Jul 20 19:16:50.600313 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: Openstack-Api-Version: compute 2.90 Jul 20 19:16:50.600313 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: Openstack-System-Scope: None Jul 20 19:16:50.600313 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: User-Agent: python-novaclient Jul 20 19:16:50.600313 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: X-Auth-Token: gAAAAABi2FShjoIlDYq8V6X1uCdSLuGXDIN9SySeZym4n3GMiBLjT0TRCaGZ61QL-imN7Go7j9UTVwxn9gVmpWzLCDFAgD6cQPhp3lGjVDiQeGhMz51eiBjUr_YDJvfz5AIl_JJEOQlH7So-A5_WWQkqkp0lO-EQZliuzhUy0H70V6mDoRFywcM Jul 20 19:16:50.600313 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: X-Domain-Id: None Jul 20 19:16:50.600313 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: X-Domain-Name: None Jul 20 19:16:50.600313 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: X-Identity-Status: Confirmed Jul 20 19:16:50.600313 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: X-Is-Admin-Project: True Jul 20 19:16:50.600313 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 19:16:50.600313 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: X-Project-Domain-Id: default Jul 20 19:16:50.600313 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: X-Project-Domain-Name: Default Jul 20 19:16:50.600313 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: X-Project-Id: 1a14d1da63be4e14a0cb08d341815ffe Jul 20 19:16:50.600313 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: X-Project-Name: admin Jul 20 19:16:50.600313 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: X-Role: reader,admin,member Jul 20 19:16:50.600313 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: X-Roles: reader,admin,member Jul 20 19:16:50.601873 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1a14d1da63be4e14a0cb08d341815ffe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1a14d1da63be4e14a0cb08d341815ffe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_1a14d1da63be4e14a0cb08d341815ffe", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/1a14d1da63be4e14a0cb08d341815ffe"}]}] Jul 20 19:16:50.601873 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: X-Tenant: admin Jul 20 19:16:50.601873 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: X-Tenant-Id: 1a14d1da63be4e14a0cb08d341815ffe Jul 20 19:16:50.601873 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: X-Tenant-Name: admin Jul 20 19:16:50.601873 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: X-User: admin Jul 20 19:16:50.601873 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: X-User-Domain-Id: default Jul 20 19:16:50.601873 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: X-User-Domain-Name: Default Jul 20 19:16:50.601873 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: X-User-Id: c9cf50bf3f924b6dac930c74893f5fb5 Jul 20 19:16:50.601873 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: X-User-Name: admin Jul 20 19:16:50.601873 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: method: > Jul 20 19:16:50.601873 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: exception: Flavor 451 could not be found. Jul 20 19:16:50.601873 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: action_args: {'id': '451'} Jul 20 19:16:50.601873 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: {{(pid=103227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:16:50.601873 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:16:50.602792 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 19:16:50.602792 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 19:16:50.602792 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 19:16:50.602792 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 19:16:50.602792 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 19:16:50.602792 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 19:16:50.602792 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 19:16:50.602792 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 19:16:50.602792 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 19:16:50.602792 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:16:50.602792 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 19:16:50.602792 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 19:16:50.602792 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 20 19:16:50.602792 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi Jul 20 19:16:50.602792 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:16:50.602792 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi Jul 20 19:16:50.602792 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:16:50.602792 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:16:50.602792 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:16:50.604703 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:16:50.604703 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:16:50.604703 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:16:50.604703 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:16:50.604703 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 19:16:50.604703 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:16:50.604703 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 20 19:16:50.604703 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi Jul 20 19:16:50.604703 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:16:50.604703 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi Jul 20 19:16:50.604703 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:16:50.604703 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:16:50.604703 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:16:50.604703 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:16:50.604703 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:16:50.604703 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 20 19:16:50.604703 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: ERROR nova.api.openstack.wsgi Jul 20 19:16:50.604703 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi [None req-877643eb-d24d-4c33-967a-cb531ef934f7 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103227) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:16:50.605944 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: INFO nova.api.openstack.requestlog [None req-877643eb-d24d-4c33-967a-cb531ef934f7 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012029 Jul 20 19:16:50.605944 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: [pid: 103227|app: 0|req: 27/52] 10.222.0.69 () {60 vars in 1193 bytes} [Wed Jul 20 19:16:50 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 19:16:51.578586 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi [None req-28e0bdfa-0519-44b9-a8c8-1d799c8bce31 admin admin] Calling method '>' {{(pid=103228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:16:51.579516 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: INFO nova.api.openstack.requestlog [None req-28e0bdfa-0519-44b9-a8c8-1d799c8bce31 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Jul 20 19:16:51.579909 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: [pid: 103228|app: 0|req: 26/53] 10.222.0.69 () {56 vars in 1074 bytes} [Wed Jul 20 19:16:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:16:52.102673 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi [None req-7fc52c55-fcce-420e-a947-a2448bf28335 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:16:52.121559 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: INFO nova.api.openstack.requestlog [None req-7fc52c55-fcce-420e-a947-a2448bf28335 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.400581 Jul 20 19:16:52.122177 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: [pid: 103227|app: 0|req: 28/54] 10.222.0.69 () {64 vars in 1235 bytes} [Wed Jul 20 19:16:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 19:16:53.104672 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi [None req-28e0bdfa-0519-44b9-a8c8-1d799c8bce31 admin admin] Calling method '>' {{(pid=103228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:16:53.105708 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: INFO nova.api.openstack.requestlog [None req-28e0bdfa-0519-44b9-a8c8-1d799c8bce31 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001615 Jul 20 19:16:53.106111 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: [pid: 103228|app: 0|req: 27/55] 10.222.0.69 () {56 vars in 1074 bytes} [Wed Jul 20 19:16:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:16:53.638083 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi [None req-b01ce0c2-6132-4390-a63a-cadad02a42ac admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:16:53.655678 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: INFO nova.api.openstack.requestlog [None req-b01ce0c2-6132-4390-a63a-cadad02a42ac admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.408356 Jul 20 19:16:53.656232 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: [pid: 103227|app: 0|req: 29/56] 10.222.0.69 () {64 vars in 1235 bytes} [Wed Jul 20 19:16:53 2022] POST /compute/v2.1/flavors => generated 405 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 19:16:54.631826 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi [None req-28e0bdfa-0519-44b9-a8c8-1d799c8bce31 admin admin] Calling method '>' {{(pid=103228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:16:54.632835 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: INFO nova.api.openstack.requestlog [None req-28e0bdfa-0519-44b9-a8c8-1d799c8bce31 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Jul 20 19:16:54.633238 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: [pid: 103228|app: 0|req: 28/57] 10.222.0.69 () {56 vars in 1074 bytes} [Wed Jul 20 19:16:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:16:55.194580 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi [None req-0655080f-89bd-44a7-b8c9-3e145c4ee409 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:16:55.213786 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: INFO nova.api.openstack.requestlog [None req-0655080f-89bd-44a7-b8c9-3e145c4ee409 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.441419 Jul 20 19:16:55.214353 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: [pid: 103227|app: 0|req: 30/58] 10.222.0.69 () {64 vars in 1235 bytes} [Wed Jul 20 19:16:54 2022] POST /compute/v2.1/flavors => generated 407 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 19:16:56.203076 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi [None req-28e0bdfa-0519-44b9-a8c8-1d799c8bce31 admin admin] Calling method '>' {{(pid=103228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:16:56.204067 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: INFO nova.api.openstack.requestlog [None req-28e0bdfa-0519-44b9-a8c8-1d799c8bce31 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Jul 20 19:16:56.204461 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: [pid: 103228|app: 0|req: 29/59] 10.222.0.69 () {56 vars in 1074 bytes} [Wed Jul 20 19:16:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:16:56.726420 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi [None req-4ca9fe47-931b-490c-8cf0-3a5750ff3cf5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:16:56.745330 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: INFO nova.api.openstack.requestlog [None req-4ca9fe47-931b-490c-8cf0-3a5750ff3cf5 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.403435 Jul 20 19:16:56.745911 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: [pid: 103227|app: 0|req: 31/60] 10.222.0.69 () {64 vars in 1235 bytes} [Wed Jul 20 19:16:56 2022] POST /compute/v2.1/flavors => generated 409 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 19:16:57.742294 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi [None req-28e0bdfa-0519-44b9-a8c8-1d799c8bce31 admin admin] Calling method '>' {{(pid=103228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:16:57.743296 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: INFO nova.api.openstack.requestlog [None req-28e0bdfa-0519-44b9-a8c8-1d799c8bce31 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Jul 20 19:16:57.743693 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: [pid: 103228|app: 0|req: 30/61] 10.222.0.69 () {56 vars in 1074 bytes} [Wed Jul 20 19:16:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:16:58.313731 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi [None req-d2bb2fbd-e95c-44ee-befa-aeca88e1ea55 admin admin] Calling method '>' {{(pid=103227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:16:58.335848 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: INFO nova.api.openstack.requestlog [None req-d2bb2fbd-e95c-44ee-befa-aeca88e1ea55 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.449687 Jul 20 19:16:58.336399 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: [pid: 103227|app: 0|req: 32/62] 10.222.0.69 () {60 vars in 1202 bytes} [Wed Jul 20 19:16:57 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:17:50.795195 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi [None req-28e0bdfa-0519-44b9-a8c8-1d799c8bce31 admin admin] Calling method '>' {{(pid=103228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:17:50.796201 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: INFO nova.api.openstack.requestlog [None req-28e0bdfa-0519-44b9-a8c8-1d799c8bce31 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Jul 20 19:17:50.796600 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: [pid: 103228|app: 0|req: 31/63] 10.222.0.69 () {54 vars in 930 bytes} [Wed Jul 20 19:17:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:17:50.807121 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG dbcounter [-] [103227] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:51.188901 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi [None req-456d1beb-f1eb-4525-b062-ff33456e5cf3 admin admin] Calling method '>' {{(pid=103227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:17:51.208326 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: INFO nova.api.openstack.requestlog [None req-456d1beb-f1eb-4525-b062-ff33456e5cf3 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.405865 Jul 20 19:17:51.208804 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: [pid: 103227|app: 0|req: 33/64] 10.222.0.69 () {60 vars in 1291 bytes} [Wed Jul 20 19:17:50 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:17:51.230406 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG dbcounter [-] [103228] Writing DB stats nova_api:SELECT=14 {{(pid=103228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:51.234489 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi [None req-9dcaac7a-fbbe-461b-9839-e2807d134ec5 admin admin] Calling method '>' {{(pid=103228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:17:51.242123 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: INFO nova.api.openstack.requestlog [None req-9dcaac7a-fbbe-461b-9839-e2807d134ec5 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013143 Jul 20 19:17:51.242792 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: [pid: 103228|app: 0|req: 32/65] 10.222.0.69 () {60 vars in 1282 bytes} [Wed Jul 20 19:17:51 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:17:51.254432 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi [None req-26ed6c52-8c72-4407-861a-e7e1efb64eaf admin admin] Calling method '>' {{(pid=103227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:17:51.262878 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: INFO nova.api.openstack.requestlog [None req-26ed6c52-8c72-4407-861a-e7e1efb64eaf admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012038 Jul 20 19:17:51.263399 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: [pid: 103227|app: 0|req: 34/66] 10.222.0.69 () {60 vars in 1285 bytes} [Wed Jul 20 19:17:51 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:17:51.275815 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi [None req-fd979be4-c807-4830-a6d5-c3beae5534b9 admin admin] Calling method '>' {{(pid=103228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:17:51.283388 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: INFO nova.api.openstack.requestlog [None req-fd979be4-c807-4830-a6d5-c3beae5534b9 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011996 Jul 20 19:17:51.283900 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: [pid: 103228|app: 0|req: 33/67] 10.222.0.69 () {60 vars in 1285 bytes} [Wed Jul 20 19:17:51 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:17:51.295087 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi [None req-029bb804-3255-474c-9a8f-dc59d0676b55 admin admin] Calling method '>' {{(pid=103227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:17:51.302538 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: INFO nova.api.openstack.requestlog [None req-029bb804-3255-474c-9a8f-dc59d0676b55 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010973 Jul 20 19:17:51.303047 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: [pid: 103227|app: 0|req: 35/68] 10.222.0.69 () {60 vars in 1282 bytes} [Wed Jul 20 19:17:51 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:21:26.122246 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi [None req-fd979be4-c807-4830-a6d5-c3beae5534b9 admin admin] Calling method '>' {{(pid=103228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:21:26.123327 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: INFO nova.api.openstack.requestlog [None req-fd979be4-c807-4830-a6d5-c3beae5534b9 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Jul 20 19:21:26.123726 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: [pid: 103228|app: 0|req: 34/69] 10.222.0.69 () {56 vars in 1074 bytes} [Wed Jul 20 19:21:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:21:26.265783 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG dbcounter [-] [103227] Writing DB stats nova_api:SELECT=6 {{(pid=103227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:21:26.422873 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi [None req-ca4dde90-4e91-48ac-a321-db9aa2d2e992 admin admin] Calling method '>' {{(pid=103227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:21:26.424037 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 19:21:26.424037 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: warnings.warn(msg) Jul 20 19:21:26.425228 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG oslo_concurrency.lockutils [None req-ca4dde90-4e91-48ac-a321-db9aa2d2e992 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:21:26.425699 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG oslo_concurrency.lockutils [None req-ca4dde90-4e91-48ac-a321-db9aa2d2e992 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:21:26.426479 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG oslo_concurrency.lockutils [None req-ca4dde90-4e91-48ac-a321-db9aa2d2e992 admin admin] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:21:26.426901 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG oslo_concurrency.lockutils [None req-ca4dde90-4e91-48ac-a321-db9aa2d2e992 admin admin] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:21:26.461114 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: INFO nova.api.openstack.requestlog [None req-ca4dde90-4e91-48ac-a321-db9aa2d2e992 admin admin] 10.222.0.69 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.196630 Jul 20 19:21:26.461699 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: [pid: 103227|app: 0|req: 36/70] 10.222.0.69 () {60 vars in 1193 bytes} [Wed Jul 20 19:21:26 2022] GET /compute/v2.1/os-services => generated 794 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 19:21:27.315936 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi [None req-fd979be4-c807-4830-a6d5-c3beae5534b9 admin admin] Calling method '>' {{(pid=103228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:21:27.317579 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: INFO nova.api.openstack.requestlog [None req-fd979be4-c807-4830-a6d5-c3beae5534b9 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002020 Jul 20 19:21:27.317985 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: [pid: 103228|app: 0|req: 35/71] 10.222.0.69 () {56 vars in 1074 bytes} [Wed Jul 20 19:21:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:21:27.515140 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi [None req-2d62fac9-3698-4e06-a0da-eb0f572164d6 admin admin] Calling method '>' {{(pid=103227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:21:27.516314 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 19:21:27.516314 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: warnings.warn(msg) Jul 20 19:21:27.517503 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG oslo_concurrency.lockutils [None req-2d62fac9-3698-4e06-a0da-eb0f572164d6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:21:27.518148 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG oslo_concurrency.lockutils [None req-2d62fac9-3698-4e06-a0da-eb0f572164d6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:21:27.518806 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG oslo_concurrency.lockutils [None req-2d62fac9-3698-4e06-a0da-eb0f572164d6 admin admin] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:21:27.519232 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG oslo_concurrency.lockutils [None req-2d62fac9-3698-4e06-a0da-eb0f572164d6 admin admin] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:21:27.539282 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: INFO nova.api.openstack.requestlog [None req-2d62fac9-3698-4e06-a0da-eb0f572164d6 admin admin] 10.222.0.69 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.077059 Jul 20 19:21:27.539762 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: [pid: 103227|app: 0|req: 37/72] 10.222.0.69 () {60 vars in 1193 bytes} [Wed Jul 20 19:21:27 2022] GET /compute/v2.1/os-services => generated 794 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 19:21:38.763114 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi [None req-fd979be4-c807-4830-a6d5-c3beae5534b9 admin admin] Calling method '>' {{(pid=103228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:21:38.764105 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: INFO nova.api.openstack.requestlog [None req-fd979be4-c807-4830-a6d5-c3beae5534b9 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001402 Jul 20 19:21:38.764490 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: [pid: 103228|app: 0|req: 36/73] 10.222.0.69 () {56 vars in 1074 bytes} [Wed Jul 20 19:21:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:21:38.908246 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG dbcounter [-] [103227] Writing DB stats nova_cell0:SELECT=4 {{(pid=103227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:21:38.908966 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG dbcounter [-] [103227] Writing DB stats nova_cell1:SELECT=4 {{(pid=103227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:21:38.909740 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG dbcounter [-] [103227] Writing DB stats nova_api:SELECT=8 {{(pid=103227) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:21:38.958026 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi [None req-0042c479-3104-47d3-96d6-5a3188140743 admin admin] Calling method '>' {{(pid=103227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:21:38.959226 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 19:21:38.959226 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: warnings.warn(msg) Jul 20 19:21:38.960396 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG oslo_concurrency.lockutils [None req-0042c479-3104-47d3-96d6-5a3188140743 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:21:38.960830 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG oslo_concurrency.lockutils [None req-0042c479-3104-47d3-96d6-5a3188140743 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:21:38.962218 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG oslo_concurrency.lockutils [None req-0042c479-3104-47d3-96d6-5a3188140743 admin admin] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:21:38.962781 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG oslo_concurrency.lockutils [None req-0042c479-3104-47d3-96d6-5a3188140743 admin admin] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:21:38.988497 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: INFO nova.api.openstack.requestlog [None req-0042c479-3104-47d3-96d6-5a3188140743 admin admin] 10.222.0.69 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.084557 Jul 20 19:21:38.988978 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: [pid: 103227|app: 0|req: 38/74] 10.222.0.69 () {60 vars in 1193 bytes} [Wed Jul 20 19:21:38 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:21:39.837087 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: DEBUG nova.api.openstack.wsgi [None req-fd979be4-c807-4830-a6d5-c3beae5534b9 admin admin] Calling method '>' {{(pid=103228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:21:39.838122 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: INFO nova.api.openstack.requestlog [None req-fd979be4-c807-4830-a6d5-c3beae5534b9 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jul 20 19:21:39.838512 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: [pid: 103228|app: 0|req: 37/75] 10.222.0.69 () {56 vars in 1074 bytes} [Wed Jul 20 19:21:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:21:40.031292 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG nova.api.openstack.wsgi [None req-7718b3b0-d1d2-4ff1-a51a-11f89cfc315e admin admin] Calling method '>' {{(pid=103227) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:21:40.032492 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 19:21:40.032492 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: warnings.warn(msg) Jul 20 19:21:40.033744 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG oslo_concurrency.lockutils [None req-7718b3b0-d1d2-4ff1-a51a-11f89cfc315e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:21:40.034187 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG oslo_concurrency.lockutils [None req-7718b3b0-d1d2-4ff1-a51a-11f89cfc315e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:21:40.034988 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG oslo_concurrency.lockutils [None req-7718b3b0-d1d2-4ff1-a51a-11f89cfc315e admin admin] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:21:40.035417 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: DEBUG oslo_concurrency.lockutils [None req-7718b3b0-d1d2-4ff1-a51a-11f89cfc315e admin admin] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103227) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:21:40.057949 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: INFO nova.api.openstack.requestlog [None req-7718b3b0-d1d2-4ff1-a51a-11f89cfc315e admin admin] 10.222.0.69 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.077990 Jul 20 19:21:40.058432 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: [pid: 103227|app: 0|req: 39/76] 10.222.0.69 () {60 vars in 1193 bytes} [Wed Jul 20 19:21:39 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:22:43.107116 dv-cinder-835384-16-iscsi devstack@n-api.service[103226]: Wed Jul 20 19:22:43 2022 - graceful shutdown triggered... Jul 20 19:22:43.107619 dv-cinder-835384-16-iscsi devstack@n-api.service[103228]: Gracefully killing worker 2 (pid: 103228)... Jul 20 19:22:43.107982 dv-cinder-835384-16-iscsi devstack@n-api.service[103227]: Gracefully killing worker 1 (pid: 103227)... Jul 20 19:22:43.109386 dv-cinder-835384-16-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 20 19:22:44.108212 dv-cinder-835384-16-iscsi devstack@n-api.service[103226]: worker 1 buried after 1 seconds Jul 20 19:22:44.108965 dv-cinder-835384-16-iscsi devstack@n-api.service[103226]: worker 2 buried after 1 seconds Jul 20 19:22:44.108965 dv-cinder-835384-16-iscsi devstack@n-api.service[103226]: goodbye to uWSGI. Jul 20 19:22:44.110334 dv-cinder-835384-16-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 20 19:22:44.111017 dv-cinder-835384-16-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 20 19:22:44.114427 dv-cinder-835384-16-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 20 19:22:44.123667 dv-cinder-835384-16-iscsi devstack@n-api.service[117740]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 20 19:22:44.126441 dv-cinder-835384-16-iscsi devstack@n-api.service[117740]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 20 19:22:44 2022] *** Jul 20 19:22:44.126665 dv-cinder-835384-16-iscsi devstack@n-api.service[117740]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 20 19:22:44.126857 dv-cinder-835384-16-iscsi devstack@n-api.service[117740]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 20 19:22:44.127031 dv-cinder-835384-16-iscsi devstack@n-api.service[117740]: nodename: dv-cinder-835384-16-iscsi Jul 20 19:22:44.127200 dv-cinder-835384-16-iscsi devstack@n-api.service[117740]: machine: x86_64 Jul 20 19:22:44.127381 dv-cinder-835384-16-iscsi devstack@n-api.service[117740]: clock source: unix Jul 20 19:22:44.127548 dv-cinder-835384-16-iscsi devstack@n-api.service[117740]: pcre jit disabled Jul 20 19:22:44.127727 dv-cinder-835384-16-iscsi devstack@n-api.service[117740]: detected number of CPU cores: 4 Jul 20 19:22:44.127890 dv-cinder-835384-16-iscsi devstack@n-api.service[117740]: current working directory: / Jul 20 19:22:44.128054 dv-cinder-835384-16-iscsi devstack@n-api.service[117740]: detected binary path: /usr/bin/uwsgi-core Jul 20 19:22:44.128224 dv-cinder-835384-16-iscsi devstack@n-api.service[117740]: your processes number limit is 47680 Jul 20 19:22:44.128391 dv-cinder-835384-16-iscsi devstack@n-api.service[117740]: your memory page size is 4096 bytes Jul 20 19:22:44.128566 dv-cinder-835384-16-iscsi devstack@n-api.service[117740]: detected max file descriptor number: 2048 Jul 20 19:22:44.128744 dv-cinder-835384-16-iscsi devstack@n-api.service[117740]: lock engine: pthread robust mutexes Jul 20 19:22:44.129089 dv-cinder-835384-16-iscsi devstack@n-api.service[117740]: thunder lock: enabled Jul 20 19:22:44.129455 dv-cinder-835384-16-iscsi devstack@n-api.service[117740]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 20 19:22:44.129743 dv-cinder-835384-16-iscsi devstack@n-api.service[117740]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 20 19:22:44.175393 dv-cinder-835384-16-iscsi devstack@n-api.service[117740]: Python main interpreter initialized at 0x55bae6eca9c0 Jul 20 19:22:44.175393 dv-cinder-835384-16-iscsi devstack@n-api.service[117740]: python threads support enabled Jul 20 19:22:44.175393 dv-cinder-835384-16-iscsi devstack@n-api.service[117740]: your server socket listen backlog is limited to 100 connections Jul 20 19:22:44.175393 dv-cinder-835384-16-iscsi devstack@n-api.service[117740]: your mercy for graceful operations on workers is 90 seconds Jul 20 19:22:44.175980 dv-cinder-835384-16-iscsi devstack@n-api.service[117740]: mapped 403077 bytes (393 KB) for 2 cores Jul 20 19:22:44.175980 dv-cinder-835384-16-iscsi devstack@n-api.service[117740]: *** Operational MODE: preforking *** Jul 20 19:22:44.176194 dv-cinder-835384-16-iscsi devstack@n-api.service[117740]: *** uWSGI is running in multiple interpreter mode *** Jul 20 19:22:44.176194 dv-cinder-835384-16-iscsi devstack@n-api.service[117740]: spawned uWSGI master process (pid: 117740) Jul 20 19:22:44.176320 dv-cinder-835384-16-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 20 19:22:44.176926 dv-cinder-835384-16-iscsi devstack@n-api.service[117740]: spawned uWSGI worker 1 (pid: 117761, cores: 1) Jul 20 19:22:44.177243 dv-cinder-835384-16-iscsi devstack@n-api.service[117740]: spawned uWSGI worker 2 (pid: 117762, cores: 1) Jul 20 19:22:44.177409 dv-cinder-835384-16-iscsi devstack@n-api.service[117740]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 20 19:22:44.860352 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 20 19:22:45.063155 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 20 19:22:46.064637 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 19:22:46.064637 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: from cryptography.utils import int_from_bytes Jul 20 19:22:46.065340 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 19:22:46.065340 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: from cryptography.utils import int_from_bytes Jul 20 19:22:46.426895 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 19:22:46.426895 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: from cryptography.utils import int_from_bytes Jul 20 19:22:46.427503 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 19:22:46.427503 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: from cryptography.utils import int_from_bytes Jul 20 19:22:48.445905 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 19:22:48.446824 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 19:22:48.446824 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 19:22:48.448153 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 19:22:48.448153 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 19:22:48.448153 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.448153 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.448543 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.448679 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.449060 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.449468 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.449842 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.450153 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.450493 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.450757 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.451080 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.451407 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835384-16-iscsi {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.451732 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.452046 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.452357 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.452679 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.452984 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.453306 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.453646 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.454150 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.455575 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.455575 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.455575 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.459658 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.460007 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.460346 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.461048 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.461048 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.461461 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.461758 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.462183 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835384-16-iscsi {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.462515 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.462843 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.463170 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.463604 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.464512 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.465163 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.465685 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.466114 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.466443 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.466798 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.467133 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.467473 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.467804 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.468362 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.468689 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.469008 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.469336 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.469681 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.469997 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.470255 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.470573 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.470902 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.471229 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.471559 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.471818 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.472076 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.472403 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.472728 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.473045 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.473363 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.473701 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.474018 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.474334 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.474646 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.474958 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.475270 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.475596 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.475916 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.476243 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.476555 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.476878 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.477282 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.69 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.477590 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.69 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.477909 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.478253 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.478578 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.478892 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.479217 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.480312 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.480668 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.481051 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.481374 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.481733 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.482079 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.482393 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.482652 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.482963 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.483277 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.483627 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.483944 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.484259 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.484574 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.485065 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.485429 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.485761 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.486341 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.486467 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.486695 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.487006 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.487323 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.487641 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.487960 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.488286 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.488629 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.488929 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.489346 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.489571 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.489887 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.490216 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.490532 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.490844 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.491480 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.491813 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.492127 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.492452 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.492770 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.493094 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.493420 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.493759 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.494073 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.494397 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.494719 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.495098 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.495418 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.495723 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.496032 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.496355 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.496662 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.496971 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.497274 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.497628 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.497956 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.498270 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.498583 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.498895 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.499218 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.499564 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.499905 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.500255 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.500575 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.500918 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.501256 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.501604 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.501922 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.502244 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.503232 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.503562 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.503883 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.504204 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.504534 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.504862 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.505199 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.505539 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.505867 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.506246 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.506568 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.506894 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.507227 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.507554 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.507876 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.508222 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.508572 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.508934 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.509269 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.509624 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.509942 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.510257 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.511124 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.511463 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.511894 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.512703 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.513041 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.513366 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.513713 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.514033 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.514355 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.514675 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.515021 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.515361 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.515685 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.516004 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.516547 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.516869 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.517188 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.517540 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.517840 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.518157 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.518470 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.518786 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.519095 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.519422 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.519759 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.520071 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.520410 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.520718 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.521212 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.521542 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.521861 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.522367 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.522724 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.523063 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.523379 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.523713 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.524033 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.524347 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.524680 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.524991 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.525303 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.525659 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.525979 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.526938 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.527360 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.527689 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.528018 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.528347 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.528668 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.529009 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.529349 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.529686 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.530024 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.530359 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.530682 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.531013 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.531384 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.531698 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.532013 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.532323 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.532632 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.532940 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.533248 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.533732 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.534073 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.534354 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.534683 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.534999 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.535305 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.535675 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.535988 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.536337 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.536648 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.536997 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.537336 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.537691 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.538020 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.538343 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.538665 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.539085 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.539298 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.539615 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.539935 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.540260 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.540575 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.540903 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.541219 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.541590 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.541934 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.542267 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.542581 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.542896 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.543244 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.543578 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.543900 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.544232 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.544549 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.544865 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.545179 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.545495 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.545831 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.546167 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.546501 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.546817 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.547142 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.550688 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.550688 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.550688 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.550688 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.550688 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.550688 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.550688 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.550688 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.553103 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.553103 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.553103 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.553103 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.553103 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.553103 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.553103 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.553103 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.554282 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.554282 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.554282 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.554282 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.554282 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.554282 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.554282 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.555271 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.555271 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.555271 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.555701 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.555844 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.557808 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.557808 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.557808 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.557808 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.557808 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.557808 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.558714 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.558714 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.559014 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.559855 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.559855 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.559855 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.560321 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.561023 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.561023 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.561545 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.561949 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.562282 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.562915 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.563155 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.563558 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.563931 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.564397 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.564942 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.565163 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.568195 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.568195 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.568195 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.568195 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.568195 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.568195 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.568195 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.573901 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.574400 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.574921 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.575550 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.576172 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.576713 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.577079 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.577445 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.577824 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.578158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.578489 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.578812 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.579131 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.579458 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.579779 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.580100 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.580416 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.580738 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.581052 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.581369 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.581711 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.582027 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.582354 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.582669 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.582993 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.583307 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.583645 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.583965 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.584278 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.584593 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.584906 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.585259 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.585616 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.585987 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.586277 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.586632 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.586945 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.587257 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.587591 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.587901 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.588213 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.588550 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.589443 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.589793 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.590106 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.590445 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.590767 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.591089 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.591405 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.591719 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.592034 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.592654 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.592980 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.593606 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.593878 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.594295 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.594781 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.595045 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.595378 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.595630 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.595856 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.596159 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.596471 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.597851 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.598180 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.598513 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.598842 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.599163 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.599508 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.599834 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.600151 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.600465 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.600785 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.601547 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.601547 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.601821 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.602151 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.602485 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.602794 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.603112 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.603424 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.603742 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.604055 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.604380 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.604698 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.605013 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.605410 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.605641 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.605948 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.606276 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.606588 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.606900 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.607211 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.607518 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.607872 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.608181 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.608546 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.608856 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.609175 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.609501 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.609845 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.610164 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.610482 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.610793 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.611114 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.611431 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.611749 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.612059 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.612367 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.612722 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.613048 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.613378 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.613729 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.614039 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.614386 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.614701 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.615018 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.615335 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.615658 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.615969 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.616283 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.616608 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.617030 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.617296 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.617573 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.618401 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.618401 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.618912 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.618912 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.619406 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.619670 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.619911 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.620182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.620790 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.620790 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.621262 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.621493 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.621921 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.623802 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.623802 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.623802 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.623802 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.623802 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.624986 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.624986 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.624986 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.624986 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.625985 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.625985 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.625985 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.626769 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.626769 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.626769 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.627471 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.627471 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.627932 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.627932 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.633684 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.633684 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.633684 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.633684 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.633684 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.633684 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.633684 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.633684 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.635527 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.635527 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.635527 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.635527 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.635527 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.635527 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.635527 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.635527 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.637498 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.637498 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.637498 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.637498 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.637498 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.637498 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.637498 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.637498 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.638928 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.638928 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.638928 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.638928 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.638928 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.638928 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.638928 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.639959 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.639959 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.639959 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.640416 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.640561 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.640768 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.641087 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.641402 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.641753 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.642065 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.642420 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.642733 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.643033 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.643352 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.643684 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.644011 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.644322 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.644653 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.644968 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.645280 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.645631 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.645993 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.646352 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.646662 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.646991 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.647327 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.647662 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.647974 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.648315 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.648661 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.648971 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.649294 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.649647 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.649960 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.650267 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.650585 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.650895 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.651234 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.652298 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.652594 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.652916 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.653378 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.653883 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.654223 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.654748 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.655102 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.655423 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.655738 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.656054 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.656366 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.656716 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.657026 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.657370 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.657721 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.658053 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.658389 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.658705 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.659036 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.659363 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.659684 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.660008 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.660332 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.660653 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.660976 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.661301 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.661655 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.661982 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.662304 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.662628 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.663200 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.663543 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.663864 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.664182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.664500 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.664821 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.665141 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.665457 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.665798 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.666115 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.666429 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.666764 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.667124 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.667459 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.667803 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.668133 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.668638 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.669082 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.669408 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.669831 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.670155 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.670471 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.670793 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.671126 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.671451 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.671773 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.672091 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.672409 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.672728 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.673046 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.673361 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.674679 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.675029 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.675377 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.675729 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.676093 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.676406 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.676735 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.677068 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.678257 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.678595 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.678945 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.679285 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.679622 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.679958 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.680288 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.680628 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.680944 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.681259 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.681618 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.681941 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.682258 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.682619 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.682939 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.683244 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.683753 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.684078 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.684638 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.684990 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.685317 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.685676 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.686009 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.686336 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.686863 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.687352 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.687799 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.688023 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.688392 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.688659 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.688913 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.689225 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.689570 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.689891 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.690202 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.690519 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.690915 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.691258 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.691572 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.691885 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.692197 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.692515 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.692826 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.693453 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.693869 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.694105 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.694432 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.694742 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.695344 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.695344 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.695680 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.696364 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.696364 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.696675 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.696950 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.697258 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.697591 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.697955 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.698764 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.699093 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.699412 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.699831 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.700193 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.700519 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.701102 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.701442 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.701817 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.702160 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.702497 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.702810 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.703121 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.703433 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.703772 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.704179 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.704394 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.704708 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.705025 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.705341 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.705682 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.705999 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.706314 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.706627 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.706939 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.707252 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.707565 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.707972 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.708291 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.708532 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.708858 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.709178 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.709501 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.709862 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.710178 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.710493 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.710805 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.711117 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.711437 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.711775 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.712093 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.712406 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.712840 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.713158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.713482 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.714736 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.714996 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.715334 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.715664 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.715984 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.716315 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.716635 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.716974 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.717325 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.717692 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.718459 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.718635 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.718974 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.719198 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.719513 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.719838 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.720158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.720467 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.720774 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.721089 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.721400 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.721737 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.722047 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.722356 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.722668 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.722974 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.723284 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.723592 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.723900 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.724208 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.724522 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.724894 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.725137 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.725447 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.725781 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.726090 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.726399 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.726736 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.727074 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.727395 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.727719 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.728036 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.728362 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.728753 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.728986 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.729310 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.729784 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.729995 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.730335 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.730648 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.730964 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.731278 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.731593 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.731904 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.732221 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.732554 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.732882 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.733193 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.733554 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.733866 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.734190 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.734517 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.734835 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.735164 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.735479 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.735795 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.736109 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.736425 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.736739 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.737060 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.737373 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.737717 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.738038 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.738359 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.738691 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.739021 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.739337 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.739667 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.740040 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.740337 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.740654 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.741004 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.741338 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.742183 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.742183 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.742500 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.742500 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 19:22:48.825046 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 19:22:48.825921 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 19:22:48.826658 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 19:22:48.827206 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 19:22:48.827631 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 19:22:48.828181 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.828678 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.829159 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.829685 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.830174 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.830661 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.831139 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.831691 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.832190 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.832604 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.833087 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.833601 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835384-16-iscsi {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.834092 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.834570 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.835038 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.835523 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.836012 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.836342 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.836656 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.837178 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.837498 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.837835 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.838419 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.838839 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.839665 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.839985 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.840281 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.840596 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.840927 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.841241 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.841682 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835384-16-iscsi {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.842009 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.842333 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.842650 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.843076 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.843646 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.843958 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.844280 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.844606 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.844918 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.845245 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.845586 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.845911 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.846229 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.846533 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.846843 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.847153 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.847473 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.847779 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.848086 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.848337 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.848648 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.848966 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.849288 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.849653 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.849911 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.850163 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.850480 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.850801 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.851115 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.851418 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.851725 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.852039 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.852347 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.852676 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.852960 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.853269 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.853608 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.853927 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.854249 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.854616 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.854937 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.855370 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.69 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.855684 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.69 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.855999 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.856342 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.856663 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.856974 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.857292 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.857656 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.857970 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.858280 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.858591 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.858911 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.859234 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.859541 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.859791 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.860094 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.860399 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.860793 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.861029 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.861336 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.861666 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.861976 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.862335 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.862594 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.862901 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.863211 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.863518 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.863821 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.864130 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.864467 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.864739 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.865058 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.865379 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.865709 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.866018 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.866324 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.866632 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.866952 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.867259 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.867565 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.867887 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.868193 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.868713 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.869254 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.869785 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.870919 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.871642 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.872042 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.872367 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.872696 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.873013 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.873327 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.873657 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.873968 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.874279 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.874589 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.874898 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.875207 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.875511 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.875832 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.876155 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.876468 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.876778 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.877087 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.877408 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:22:48.877774 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.878109 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.878454 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.878771 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.879107 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.879439 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.879759 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.880073 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.880389 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.880717 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.881033 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.881350 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.881682 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.882005 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.882325 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.882659 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.882978 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.883298 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.883619 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.883930 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.884259 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.884588 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.884912 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.885225 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.885614 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.886825 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.887283 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.887946 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.888192 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.888513 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.889194 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.889194 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.889472 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.889833 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.890154 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.890483 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.890801 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.891122 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.891440 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.891756 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.892072 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.892420 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.892741 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.893063 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.893381 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.893725 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.894045 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.894359 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.894672 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.894980 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.895286 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.895593 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.895904 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.896210 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.896531 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.896860 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.897169 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.897539 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.897838 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.898152 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.898465 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.898778 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.899086 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.899403 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.899717 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.900025 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.900352 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.900666 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.900974 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.901327 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.901761 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.902111 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.902438 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.902760 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.903077 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.903390 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.903707 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.904033 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.904349 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.904664 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.904796 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO dbcounter [None req-caa242b4-c0e0-4a43-b123-8d3cb8dd849a None None] Registered counter for database nova_api Jul 20 19:22:48.905000 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.905334 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.905667 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.905994 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.906321 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.906639 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.906946 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.907258 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.907563 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.907869 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.908175 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.908487 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.908821 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.909128 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.909436 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.909764 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.910071 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.910395 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.910708 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.911014 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.911326 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.911634 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.911978 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.912289 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.912633 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.912968 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.913290 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.913644 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.913953 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.914273 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.914586 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.914903 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.915219 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.915533 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.915856 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.916169 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.916491 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.916802 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.917244 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.917612 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.917940 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.918250 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.918573 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.918914 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.919249 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.919635 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.919893 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.920207 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.922830 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.922830 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.922830 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.922830 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.922830 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.922830 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.922830 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.922830 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.923455 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.923455 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.923722 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.924028 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.924336 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.924654 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.925173 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.925322 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.925657 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.925977 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.926304 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.926618 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.926928 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.927243 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.927551 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.927859 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.927998 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_db.sqlalchemy.engines [None req-caa242b4-c0e0-4a43-b123-8d3cb8dd849a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117761) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 19:22:48.928171 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.928489 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.928801 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.929110 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.929416 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.929755 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.930065 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.930372 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.930677 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.930990 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.931312 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.931726 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.931970 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.932289 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.933128 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.933438 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.933791 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.934225 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.934537 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.934847 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.935155 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.935505 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.935845 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.936119 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.936439 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.936761 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.937075 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.937396 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.937553 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writer thread running {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 19:22:48.937736 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.938049 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.938372 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.938688 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.938999 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.939313 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.939627 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.939970 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.940291 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.940802 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.941125 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.941441 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.941835 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.942091 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.942400 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.942721 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.943298 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.943633 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.943952 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.944276 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.944599 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.944920 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.945253 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.945605 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.946045 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.946257 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.946570 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.946877 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.947183 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.947493 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.947797 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.948161 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.949276 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.949606 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.949928 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.950236 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.950546 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.950857 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.951177 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.951487 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.951804 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.952130 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.952438 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.952751 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.953056 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.953363 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.953692 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.954039 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.954346 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.954685 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.955013 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.955354 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.955660 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.955967 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.956290 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.956597 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.956902 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.957205 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.957555 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.957854 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.958159 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.958471 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.958783 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.959095 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.959414 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.959705 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.960013 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.960317 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.960633 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.960941 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.961244 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.961564 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.961878 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.962235 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.962490 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.962800 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.963103 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.963419 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.963747 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.964052 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.964442 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.964762 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.965074 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.965378 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.965730 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.966044 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.966350 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.966655 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.966966 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.967270 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.967573 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.967881 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.968459 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.968775 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.969077 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.969388 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.969749 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.970013 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.970317 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.970625 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.970927 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.971230 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.971534 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.971839 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.972142 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.972467 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.972775 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.973078 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.973384 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.973712 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.974056 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.974360 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.974716 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.975021 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.975334 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.975653 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.975967 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.976277 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.976621 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.976925 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.977241 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.977570 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.977888 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.978195 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.978502 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.978824 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.979137 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.979499 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.979816 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.980140 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.980469 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.980767 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.981079 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.981391 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.981726 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.982037 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.982489 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.982665 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.982968 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.983280 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.983594 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.983905 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.984211 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.984521 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.984831 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.985136 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.985460 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.985813 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.986119 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.986429 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.986733 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.987043 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.987347 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.987781 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.988091 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.988399 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.988702 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.989010 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.989319 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.989656 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.989975 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.990276 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.990694 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.991005 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.991315 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.991625 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.991929 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.992237 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.992575 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.992864 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.993170 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.993474 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.993806 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.994129 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.994291 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.context [None req-caa242b4-c0e0-4a43-b123-8d3cb8dd849a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),691618a6-9620-40ee-ad72-b687b651ed73(cell1) {{(pid=117761) load_cells /opt/stack/nova/nova/context.py:464}} Jul 20 19:22:48.994453 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.994745 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.995815 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.996138 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.996448 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.996875 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.997182 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.997495 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.997839 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.998195 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.998486 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.998794 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.999109 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.999277 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-caa242b4-c0e0-4a43-b123-8d3cb8dd849a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:22:48.999445 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:48.999734 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.000081 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.000367 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.000662 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-caa242b4-c0e0-4a43-b123-8d3cb8dd849a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:22:49.000832 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.000981 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.001288 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.001450 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-caa242b4-c0e0-4a43-b123-8d3cb8dd849a None None] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:22:49.001648 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.001939 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.002269 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.002685 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.003093 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.003319 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.003473 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-caa242b4-c0e0-4a43-b123-8d3cb8dd849a None None] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:22:49.003643 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.003956 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.004263 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.004569 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.004879 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.005184 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.005412 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO dbcounter [None req-caa242b4-c0e0-4a43-b123-8d3cb8dd849a None None] Registered counter for database nova_cell0 Jul 20 19:22:49.005604 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.005826 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.006133 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.006447 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.006760 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.007068 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.007374 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.007816 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.007982 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.008305 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.008634 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.008954 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.009276 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.009486 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO dbcounter [None req-caa242b4-c0e0-4a43-b123-8d3cb8dd849a None None] Registered counter for database nova_cell1 Jul 20 19:22:49.009678 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.009929 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.010252 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.010583 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.011477 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.011788 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.012102 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.012491 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.013040 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.013397 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.015383 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.015383 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.015383 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.015383 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.015383 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.015383 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.016304 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.016304 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.016304 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.016558 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.016766 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.017108 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.017424 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.017748 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.018057 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.018359 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.018666 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.018974 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.019301 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.019605 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.019809 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_db.sqlalchemy.engines [None req-caa242b4-c0e0-4a43-b123-8d3cb8dd849a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117761) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 19:22:49.019936 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.020224 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.020570 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.020733 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_db.sqlalchemy.engines [None req-caa242b4-c0e0-4a43-b123-8d3cb8dd849a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117761) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 19:22:49.020896 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.021112 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.021456 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.021785 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.022118 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.022577 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.022749 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.023083 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.023391 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.023714 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.024360 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.024360 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.024656 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.024954 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.025303 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.025660 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.025900 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.026241 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.026598 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.026976 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.027486 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.027911 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writer thread running {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 19:22:49.028410 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.028744 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.029101 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.029334 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writer thread running {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 19:22:49.029617 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.029790 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.030089 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.030672 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.030890 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.031207 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.031750 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.031971 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.032345 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.032781 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.033140 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.033491 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.033908 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.034234 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.034624 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.034994 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.035256 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.035708 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.036017 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.036338 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.036661 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.036983 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.037302 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.037653 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.038018 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.038289 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.038694 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.038919 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.039237 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.039554 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.039884 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.040223 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.040546 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.040864 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.041178 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.041495 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.042128 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.042541 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.042882 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.043252 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.043547 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.043868 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.044192 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.044523 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.044834 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.045145 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.045459 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.045799 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.046107 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.046432 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.046747 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.047053 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.047375 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.047690 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.048221 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.048609 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.048930 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.049254 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.049602 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.049922 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.050231 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.050556 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.050972 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.051173 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.051493 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.051803 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.052114 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.052418 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.052731 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.053040 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.053360 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.053685 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.053992 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.054321 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.054627 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.054932 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.055237 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.055550 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.055854 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.056158 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.056464 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.056768 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.057078 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.057379 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.058245 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.058596 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.058984 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.059293 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.059604 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.059955 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.060281 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.060585 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.060889 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.061210 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.061533 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.061862 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.062181 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.062492 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.062840 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.063159 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.063705 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.064039 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.064360 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.064693 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.065025 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.065331 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.065671 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.065982 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.066309 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.066620 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.066934 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.067247 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.067560 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.067872 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.068186 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.068497 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.068837 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.069150 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.069459 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.069794 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.070104 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.070416 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.070729 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.071069 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.071391 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.071711 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.072028 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.072366 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.072658 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.072969 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.074261 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.074615 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.075283 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.075846 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.076245 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.076569 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.077013 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.077340 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.077698 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.078031 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.078347 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.078677 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.079004 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.079324 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.079650 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.079992 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.080302 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.080643 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.080980 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.081395 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.081640 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.081951 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.082258 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.082570 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.082890 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.083204 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.083512 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.083823 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.084139 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.084444 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.084750 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.085056 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.085363 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.085731 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.086040 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.086346 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.086652 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.086957 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.087261 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.087567 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.087879 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.088186 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.088520 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.089344 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.089710 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.090095 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.090317 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.090591 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.090905 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.091230 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.091555 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.091863 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.092175 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.092503 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.092822 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.093399 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.093730 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.094070 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.094385 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.094701 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.095015 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.095329 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.095644 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.095961 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.096290 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.096614 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.096924 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.097250 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.097593 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.097918 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.098238 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.098553 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.098886 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.099200 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.099516 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.099830 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.100140 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.100454 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.100773 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.101088 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.101406 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.101789 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.102097 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.102393 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.102720 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.103034 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.103361 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.103689 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.104043 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.104412 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.105301 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.105751 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.106091 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.106407 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.106716 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:22:49.106964 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 19:22:49.178404 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO dbcounter [None req-caa242b4-c0e0-4a43-b123-8d3cb8dd849a None None] Registered counter for database nova_cell0 Jul 20 19:22:49.186374 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_db.sqlalchemy.engines [None req-caa242b4-c0e0-4a43-b123-8d3cb8dd849a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117761) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 19:22:49.191454 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writer thread running {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 19:22:49.262042 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO dbcounter [None req-707c26d8-81c4-41a3-b75b-209be96723cd None None] Registered counter for database nova_api Jul 20 19:22:49.282437 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_db.sqlalchemy.engines [None req-707c26d8-81c4-41a3-b75b-209be96723cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117762) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 19:22:49.289043 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writer thread running {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 19:22:49.347545 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.context [None req-707c26d8-81c4-41a3-b75b-209be96723cd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),691618a6-9620-40ee-ad72-b687b651ed73(cell1) {{(pid=117762) load_cells /opt/stack/nova/nova/context.py:464}} Jul 20 19:22:49.351447 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-707c26d8-81c4-41a3-b75b-209be96723cd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:22:49.353047 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-707c26d8-81c4-41a3-b75b-209be96723cd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:22:49.356852 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-707c26d8-81c4-41a3-b75b-209be96723cd None None] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:22:49.356852 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-707c26d8-81c4-41a3-b75b-209be96723cd None None] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:22:49.358486 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO dbcounter [None req-707c26d8-81c4-41a3-b75b-209be96723cd None None] Registered counter for database nova_cell0 Jul 20 19:22:49.364007 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO dbcounter [None req-707c26d8-81c4-41a3-b75b-209be96723cd None None] Registered counter for database nova_cell1 Jul 20 19:22:49.372447 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_db.sqlalchemy.engines [None req-707c26d8-81c4-41a3-b75b-209be96723cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117762) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 19:22:49.376221 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_db.sqlalchemy.engines [None req-707c26d8-81c4-41a3-b75b-209be96723cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117762) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 19:22:49.384818 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writer thread running {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 19:22:49.387654 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writer thread running {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 19:22:49.520959 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: WARNING keystonemiddleware.auth_token [None req-caa242b4-c0e0-4a43-b123-8d3cb8dd849a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 19:22:49.528646 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: WARNING keystonemiddleware.auth_token [None req-caa242b4-c0e0-4a43-b123-8d3cb8dd849a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 19:22:49.536264 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO dbcounter [None req-707c26d8-81c4-41a3-b75b-209be96723cd None None] Registered counter for database nova_cell0 Jul 20 19:22:49.543807 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_db.sqlalchemy.engines [None req-707c26d8-81c4-41a3-b75b-209be96723cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117762) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 19:22:49.548937 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writer thread running {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 19:22:49.876399 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: WARNING keystonemiddleware.auth_token [None req-707c26d8-81c4-41a3-b75b-209be96723cd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 19:22:49.879951 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: WARNING keystonemiddleware.auth_token [None req-caa242b4-c0e0-4a43-b123-8d3cb8dd849a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 19:22:49.883868 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: WARNING keystonemiddleware.auth_token [None req-707c26d8-81c4-41a3-b75b-209be96723cd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 19:22:49.886277 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: WARNING keystonemiddleware.auth_token [None req-caa242b4-c0e0-4a43-b123-8d3cb8dd849a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 19:22:49.892586 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55bae6eca9c0 pid: 117761 (default app) Jul 20 19:22:50.228976 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: WARNING keystonemiddleware.auth_token [None req-707c26d8-81c4-41a3-b75b-209be96723cd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 19:22:50.235270 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: WARNING keystonemiddleware.auth_token [None req-707c26d8-81c4-41a3-b75b-209be96723cd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 19:22:50.240585 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bae6eca9c0 pid: 117762 (default app) Jul 20 19:23:31.822827 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_api:SELECT=3 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:23:31.824605 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=3 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:23:31.825601 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell0:SELECT=3 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:23:31.826608 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell0:SELECT=3 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:23:32.284311 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_api:SELECT=3 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:23:32.288193 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_cell1:SELECT=3 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:23:32.298120 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_cell0:SELECT=3 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:23:32.299028 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_cell0:SELECT=3 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:23:33.842449 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-6998cc18-d9b4-4899-a7e4-21b4a0192764 tempest-VolumesGetTestJSON-1626251268 tempest-VolumesGetTestJSON-1626251268-project] Action: 'create', calling method: .version_select at 0x7ff60c17dca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-156944868", "metadata": {"Type": "work"}}} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:23:33.965702 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-9467b497-5b93-4469-a528-9b8bd564b47e tempest-VolumesSnapshotsTestJSON-179055845 tempest-VolumesSnapshotsTestJSON-179055845-project] Action: 'create', calling method: .version_select at 0x7ff60c0c3c10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1897463046"}} {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:23:36.117325 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-6998cc18-d9b4-4899-a7e4-21b4a0192764 tempest-VolumesGetTestJSON-1626251268 tempest-VolumesGetTestJSON-1626251268-project] 10.222.0.69 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 4.305495 Jul 20 19:23:36.126845 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1/1] 10.222.0.69 () {60 vars in 1155 bytes} [Wed Jul 20 19:23:31 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 4310 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 20 19:23:36.133057 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e209f5b8-8a7e-455f-b1bf-56d3087e84d7 tempest-VolumesGetTestJSON-1626251268 tempest-VolumesGetTestJSON-1626251268-project] Calling method '.version_select at 0x7ff60bfd0af0>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:23:36.936917 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-9467b497-5b93-4469-a528-9b8bd564b47e tempest-VolumesSnapshotsTestJSON-179055845 tempest-VolumesSnapshotsTestJSON-179055845-project] 10.222.0.69 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 4.662381 Jul 20 19:23:36.937962 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 1/2] 10.222.0.69 () {60 vars in 1154 bytes} [Wed Jul 20 19:23:32 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 4665 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 20 19:23:36.952546 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-d85d3621-e6f7-4f93-97f5-47096d4324b8 tempest-VolumesSnapshotsTestJSON-179055845 tempest-VolumesSnapshotsTestJSON-179055845-project] Calling method '.version_select at 0x7ff60bf90a60>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:23:37.051596 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e209f5b8-8a7e-455f-b1bf-56d3087e84d7 tempest-VolumesGetTestJSON-1626251268 tempest-VolumesGetTestJSON-1626251268-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/6449bb46-0a2b-4320-b4b1-c777f24bbf79" status: 200 len: 352 microversion: 2.1 time: 0.923037 Jul 20 19:23:37.052231 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 2/3] 10.222.0.69 () {58 vars in 1244 bytes} [Wed Jul 20 19:23:36 2022] GET /compute/v2.1/os-volumes/6449bb46-0a2b-4320-b4b1-c777f24bbf79 => generated 352 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:23:37.169294 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-d85d3621-e6f7-4f93-97f5-47096d4324b8 tempest-VolumesSnapshotsTestJSON-179055845 tempest-VolumesSnapshotsTestJSON-179055845-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/3987cb7a-fb9c-41d0-ac2c-410058d3e565" status: 200 len: 345 microversion: 2.1 time: 0.221889 Jul 20 19:23:37.170154 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 2/4] 10.222.0.69 () {58 vars in 1244 bytes} [Wed Jul 20 19:23:36 2022] GET /compute/v2.1/os-volumes/3987cb7a-fb9c-41d0-ac2c-410058d3e565 => generated 345 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:23:38.066679 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-b9fc19db-0de6-4aa3-a225-742520e16506 tempest-VolumesGetTestJSON-1626251268 tempest-VolumesGetTestJSON-1626251268-project] Calling method '.version_select at 0x7ff60bfd0d30>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:23:38.186830 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-88bc600a-ad07-42fc-ae20-9bcc6331f39f tempest-VolumesSnapshotsTestJSON-179055845 tempest-VolumesSnapshotsTestJSON-179055845-project] Calling method '.version_select at 0x7ff60bf90d30>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:23:38.230520 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-b9fc19db-0de6-4aa3-a225-742520e16506 tempest-VolumesGetTestJSON-1626251268 tempest-VolumesGetTestJSON-1626251268-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/6449bb46-0a2b-4320-b4b1-c777f24bbf79" status: 200 len: 353 microversion: 2.1 time: 0.167925 Jul 20 19:23:38.231268 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 3/5] 10.222.0.69 () {58 vars in 1244 bytes} [Wed Jul 20 19:23:38 2022] GET /compute/v2.1/os-volumes/6449bb46-0a2b-4320-b4b1-c777f24bbf79 => generated 353 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:23:38.244449 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-0223f1d3-2e3f-4992-93b6-ecd4264b6a01 tempest-VolumesGetTestJSON-1626251268 tempest-VolumesGetTestJSON-1626251268-project] Calling method '.version_select at 0x7ff60bff3280>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:23:38.293006 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-88bc600a-ad07-42fc-ae20-9bcc6331f39f tempest-VolumesSnapshotsTestJSON-179055845 tempest-VolumesSnapshotsTestJSON-179055845-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/3987cb7a-fb9c-41d0-ac2c-410058d3e565" status: 200 len: 346 microversion: 2.1 time: 0.114978 Jul 20 19:23:38.293977 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 3/6] 10.222.0.69 () {58 vars in 1244 bytes} [Wed Jul 20 19:23:38 2022] GET /compute/v2.1/os-volumes/3987cb7a-fb9c-41d0-ac2c-410058d3e565 => generated 346 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:23:38.307641 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-71792ddc-e332-4cb5-ab35-14da3875be22 tempest-VolumesSnapshotsTestJSON-179055845 tempest-VolumesSnapshotsTestJSON-179055845-project] Action: 'create', calling method: .version_select at 0x7ff60bfaa160>, body: {"snapshot": {"volume_id": "3987cb7a-fb9c-41d0-ac2c-410058d3e565", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-892805239"}} {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:23:38.332558 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-0223f1d3-2e3f-4992-93b6-ecd4264b6a01 tempest-VolumesGetTestJSON-1626251268 tempest-VolumesGetTestJSON-1626251268-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/6449bb46-0a2b-4320-b4b1-c777f24bbf79" status: 200 len: 353 microversion: 2.1 time: 0.092811 Jul 20 19:23:38.335293 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 4/7] 10.222.0.69 () {58 vars in 1244 bytes} [Wed Jul 20 19:23:38 2022] GET /compute/v2.1/os-volumes/6449bb46-0a2b-4320-b4b1-c777f24bbf79 => generated 353 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:23:38.356156 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-b8c3cab8-0143-491e-9dc1-c2ce3c9a1054 tempest-VolumesGetTestJSON-1626251268 tempest-VolumesGetTestJSON-1626251268-project] Calling method '.version_select at 0x7ff60bff3940>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:23:38.598902 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-b8c3cab8-0143-491e-9dc1-c2ce3c9a1054 tempest-VolumesGetTestJSON-1626251268 tempest-VolumesGetTestJSON-1626251268-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/6449bb46-0a2b-4320-b4b1-c777f24bbf79" status: 202 len: 0 microversion: 2.1 time: 0.248942 Jul 20 19:23:38.603460 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 5/8] 10.222.0.69 () {58 vars in 1247 bytes} [Wed Jul 20 19:23:38 2022] DELETE /compute/v2.1/os-volumes/6449bb46-0a2b-4320-b4b1-c777f24bbf79 => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 19:23:38.608419 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4bb89525-56cd-4820-bca2-c864a4d5a024 tempest-VolumesGetTestJSON-1626251268 tempest-VolumesGetTestJSON-1626251268-project] Calling method '.version_select at 0x7ff60bfd09d0>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:23:38.807205 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-4bb89525-56cd-4820-bca2-c864a4d5a024 tempest-VolumesGetTestJSON-1626251268 tempest-VolumesGetTestJSON-1626251268-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/6449bb46-0a2b-4320-b4b1-c777f24bbf79" status: 200 len: 352 microversion: 2.1 time: 0.200178 Jul 20 19:23:38.809745 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 6/9] 10.222.0.69 () {58 vars in 1244 bytes} [Wed Jul 20 19:23:38 2022] GET /compute/v2.1/os-volumes/6449bb46-0a2b-4320-b4b1-c777f24bbf79 => generated 352 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:23:38.838193 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-71792ddc-e332-4cb5-ab35-14da3875be22 tempest-VolumesSnapshotsTestJSON-179055845 tempest-VolumesSnapshotsTestJSON-179055845-project] 10.222.0.69 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.537045 Jul 20 19:23:38.838979 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 4/10] 10.222.0.69 () {60 vars in 1161 bytes} [Wed Jul 20 19:23:38 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:23:38.850990 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-1476d29a-1bee-4004-9366-85e30accdd34 tempest-VolumesSnapshotsTestJSON-179055845 tempest-VolumesSnapshotsTestJSON-179055845-project] Calling method '.version_select at 0x7ff60bff3ca0>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:23:38.934179 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-1476d29a-1bee-4004-9366-85e30accdd34 tempest-VolumesSnapshotsTestJSON-179055845 tempest-VolumesSnapshotsTestJSON-179055845-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/fb9d5d86-d74c-48e2-97c9-8992aa41df57" status: 200 len: 286 microversion: 2.1 time: 0.088439 Jul 20 19:23:38.935136 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 7/11] 10.222.0.69 () {58 vars in 1250 bytes} [Wed Jul 20 19:23:38 2022] GET /compute/v2.1/os-snapshots/fb9d5d86-d74c-48e2-97c9-8992aa41df57 => generated 286 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:23:38.946523 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-814cae42-ac5d-4916-ba68-43ee182012c5 tempest-VolumesSnapshotsTestJSON-179055845 tempest-VolumesSnapshotsTestJSON-179055845-project] Calling method '.version_select at 0x7ff60bfaad30>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:23:39.111367 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-814cae42-ac5d-4916-ba68-43ee182012c5 tempest-VolumesSnapshotsTestJSON-179055845 tempest-VolumesSnapshotsTestJSON-179055845-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.169861 Jul 20 19:23:39.118112 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 5/12] 10.222.0.69 () {58 vars in 1139 bytes} [Wed Jul 20 19:23:38 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:23:39.124972 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-202d2c9a-f0e8-475b-bbff-2a9949b3d8cc tempest-VolumesSnapshotsTestJSON-179055845 tempest-VolumesSnapshotsTestJSON-179055845-project] Calling method '.version_select at 0x7ff60bff33a0>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:23:39.215827 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-202d2c9a-f0e8-475b-bbff-2a9949b3d8cc tempest-VolumesSnapshotsTestJSON-179055845 tempest-VolumesSnapshotsTestJSON-179055845-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/fb9d5d86-d74c-48e2-97c9-8992aa41df57" status: 200 len: 286 microversion: 2.1 time: 0.095804 Jul 20 19:23:39.218061 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 8/13] 10.222.0.69 () {58 vars in 1250 bytes} [Wed Jul 20 19:23:39 2022] GET /compute/v2.1/os-snapshots/fb9d5d86-d74c-48e2-97c9-8992aa41df57 => generated 286 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:23:39.821267 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-a4ce97d6-98ae-4e5c-8b51-714c9d955396 tempest-VolumesGetTestJSON-1626251268 tempest-VolumesGetTestJSON-1626251268-project] Calling method '.version_select at 0x7ff60bfaa790>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:23:40.037131 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.wsgi [None req-a4ce97d6-98ae-4e5c-8b51-714c9d955396 tempest-VolumesGetTestJSON-1626251268 tempest-VolumesGetTestJSON-1626251268-project] HTTP exception thrown: Volume 6449bb46-0a2b-4320-b4b1-c777f24bbf79 could not be found. Jul 20 19:23:40.042801 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-a4ce97d6-98ae-4e5c-8b51-714c9d955396 tempest-VolumesGetTestJSON-1626251268 tempest-VolumesGetTestJSON-1626251268-project] Request method failure captured: Jul 20 19:23:40.042801 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: request: GET /compute/v2.1/os-volumes/6449bb46-0a2b-4320-b4b1-c777f24bbf79 HTTP/1.1 Jul 20 19:23:40.042801 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: Accept: application/json Jul 20 19:23:40.042801 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: Accept-Encoding: identity Jul 20 19:23:40.042801 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: Connection: close Jul 20 19:23:40.042801 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: Content-Length: 0 Jul 20 19:23:40.042801 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: Content-Type: application/json Jul 20 19:23:40.042801 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: Host: 10.222.0.69 Jul 20 19:23:40.042801 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: Openstack-System-Scope: None Jul 20 19:23:40.042801 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: User-Agent: python-urllib3/1.26.9 Jul 20 19:23:40.042801 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Auth-Token: gAAAAABi2FYzcazCZyuwAHsb6MKxFe4cNS6dy4auMUff8mZhUTcwGoYSua9CkQ2rQEcyFY8QVID-ounXuPqBueGaAJZuIU9tXneZXbu1MsxZWe6WC5vcxNdaHev4nl55xwoZ5aIxCVqigb_ksvPDqLz4K5a3UezC_UoWXT9QZVh4QT0HIMaZswY Jul 20 19:23:40.042801 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Domain-Id: None Jul 20 19:23:40.042801 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Domain-Name: None Jul 20 19:23:40.042801 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Identity-Status: Confirmed Jul 20 19:23:40.042801 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Is-Admin-Project: True Jul 20 19:23:40.042801 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Project-Domain-Id: default Jul 20 19:23:40.042801 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Project-Domain-Name: Default Jul 20 19:23:40.042801 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Project-Id: 7fedcb34f863465890f3b64591063546 Jul 20 19:23:40.042801 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Project-Name: tempest-VolumesGetTestJSON-1626251268 Jul 20 19:23:40.042801 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Role: reader,member Jul 20 19:23:40.042801 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Roles: reader,member Jul 20 19:23:40.044079 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7fedcb34f863465890f3b64591063546"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7fedcb34f863465890f3b64591063546"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_7fedcb34f863465890f3b64591063546", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/7fedcb34f863465890f3b64591063546"}]}] Jul 20 19:23:40.044079 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Tenant: tempest-VolumesGetTestJSON-1626251268 Jul 20 19:23:40.044079 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Tenant-Id: 7fedcb34f863465890f3b64591063546 Jul 20 19:23:40.044079 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Tenant-Name: tempest-VolumesGetTestJSON-1626251268 Jul 20 19:23:40.044079 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-User: tempest-VolumesGetTestJSON-1626251268-project Jul 20 19:23:40.044079 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-User-Domain-Id: default Jul 20 19:23:40.044079 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-User-Domain-Name: Default Jul 20 19:23:40.044079 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-User-Id: d3f8f0bd2cbb4ae9b51990b6efec2b92 Jul 20 19:23:40.044079 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-User-Name: tempest-VolumesGetTestJSON-1626251268-project Jul 20 19:23:40.044079 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: method: Jul 20 19:23:40.044079 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: exception: Volume 6449bb46-0a2b-4320-b4b1-c777f24bbf79 could not be found. Jul 20 19:23:40.044079 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: action_args: {'id': '6449bb46-0a2b-4320-b4b1-c777f24bbf79'} Jul 20 19:23:40.044079 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:23:40.044787 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:23:40.044787 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 19:23:40.044787 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 19:23:40.044787 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 19:23:40.044787 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 19:23:40.044787 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 19:23:40.044787 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 19:23:40.044787 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 19:23:40.044787 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 19:23:40.044787 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 19:23:40.044787 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 19:23:40.044787 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 19:23:40.044787 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 19:23:40.044787 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 19:23:40.044787 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 19:23:40.044787 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6449bb46-0a2b-4320-b4b1-c777f24bbf79 could not be found. (HTTP 404) (Request-ID: req-e7635652-cd06-43ad-a3c2-1142bbf0cf19) Jul 20 19:23:40.044787 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Jul 20 19:23:40.044787 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:23:40.044787 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Jul 20 19:23:40.045867 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:23:40.045867 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 20 19:23:40.045867 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 20 19:23:40.045867 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 19:23:40.045867 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 19:23:40.045867 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 19:23:40.045867 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 19:23:40.045867 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 19:23:40.045867 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 19:23:40.045867 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 19:23:40.045867 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 19:23:40.045867 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 19:23:40.045867 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 19:23:40.045867 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 19:23:40.045867 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 19:23:40.045867 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 19:23:40.045867 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 19:23:40.045867 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 19:23:40.045867 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 19:23:40.046805 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 19:23:40.046805 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 19:23:40.046805 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 19:23:40.046805 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 19:23:40.046805 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6449bb46-0a2b-4320-b4b1-c777f24bbf79 could not be found. Jul 20 19:23:40.046805 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Jul 20 19:23:40.046805 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:23:40.046805 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Jul 20 19:23:40.046805 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:23:40.046805 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:23:40.046805 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:23:40.046805 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:23:40.046805 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:23:40.046805 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 19:23:40.046805 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 19:23:40.046805 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:23:40.046805 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:23:40.046805 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 20 19:23:40.046805 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:23:40.047818 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6449bb46-0a2b-4320-b4b1-c777f24bbf79 could not be found. Jul 20 19:23:40.047818 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Jul 20 19:23:40.047818 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:23:40.047818 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Jul 20 19:23:40.047818 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:23:40.047818 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:23:40.047818 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:23:40.047818 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:23:40.047818 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:23:40.047818 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6449bb46-0a2b-4320-b4b1-c777f24bbf79 could not be found. Jul 20 19:23:40.047818 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Jul 20 19:23:40.050660 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-a4ce97d6-98ae-4e5c-8b51-714c9d955396 tempest-VolumesGetTestJSON-1626251268 tempest-VolumesGetTestJSON-1626251268-project] Returning 404 to user: Volume 6449bb46-0a2b-4320-b4b1-c777f24bbf79 could not be found. {{(pid=117762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:23:40.051946 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-a4ce97d6-98ae-4e5c-8b51-714c9d955396 tempest-VolumesGetTestJSON-1626251268 tempest-VolumesGetTestJSON-1626251268-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/6449bb46-0a2b-4320-b4b1-c777f24bbf79" status: 404 len: 109 microversion: 2.1 time: 0.235414 Jul 20 19:23:40.054762 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 6/14] 10.222.0.69 () {58 vars in 1244 bytes} [Wed Jul 20 19:23:39 2022] GET /compute/v2.1/os-volumes/6449bb46-0a2b-4320-b4b1-c777f24bbf79 => generated 109 bytes in 237 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:23:40.233063 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-14a809b0-5cd5-47c6-a48b-cf6f6c00b378 tempest-VolumesSnapshotsTestJSON-179055845 tempest-VolumesSnapshotsTestJSON-179055845-project] Calling method '.version_select at 0x7ff60bfd0c10>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:23:40.347994 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-14a809b0-5cd5-47c6-a48b-cf6f6c00b378 tempest-VolumesSnapshotsTestJSON-179055845 tempest-VolumesSnapshotsTestJSON-179055845-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/fb9d5d86-d74c-48e2-97c9-8992aa41df57" status: 200 len: 286 microversion: 2.1 time: 0.121401 Jul 20 19:23:40.349884 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 9/15] 10.222.0.69 () {58 vars in 1250 bytes} [Wed Jul 20 19:23:40 2022] GET /compute/v2.1/os-snapshots/fb9d5d86-d74c-48e2-97c9-8992aa41df57 => generated 286 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:23:41.360764 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-3914856c-d024-499b-a6ca-61a0fc687bba tempest-VolumesSnapshotsTestJSON-179055845 tempest-VolumesSnapshotsTestJSON-179055845-project] Calling method '.version_select at 0x7ff60bfaac10>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:23:41.415476 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-3914856c-d024-499b-a6ca-61a0fc687bba tempest-VolumesSnapshotsTestJSON-179055845 tempest-VolumesSnapshotsTestJSON-179055845-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/fb9d5d86-d74c-48e2-97c9-8992aa41df57" status: 200 len: 286 microversion: 2.1 time: 0.058840 Jul 20 19:23:41.421321 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 7/16] 10.222.0.69 () {58 vars in 1250 bytes} [Wed Jul 20 19:23:41 2022] GET /compute/v2.1/os-snapshots/fb9d5d86-d74c-48e2-97c9-8992aa41df57 => generated 286 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:23:42.429716 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-f3c063c0-4b4e-4309-b703-44d3bc49e5fe tempest-VolumesSnapshotsTestJSON-179055845 tempest-VolumesSnapshotsTestJSON-179055845-project] Calling method '.version_select at 0x7ff60bf7e4c0>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:23:42.488728 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-81066611-8de7-46e3-8630-e16744c5bfdc tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1651967893", "imageRef": "59575804-e013-4dec-af24-b6c2dbbce73a", "flavorRef": "452", "networks": [{"uuid": "4b1f7d87-e103-414e-bca2-097f65286491"}]}} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:23:42.506161 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-f3c063c0-4b4e-4309-b703-44d3bc49e5fe tempest-VolumesSnapshotsTestJSON-179055845 tempest-VolumesSnapshotsTestJSON-179055845-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/fb9d5d86-d74c-48e2-97c9-8992aa41df57" status: 200 len: 286 microversion: 2.1 time: 0.081148 Jul 20 19:23:42.507185 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 8/17] 10.222.0.69 () {58 vars in 1250 bytes} [Wed Jul 20 19:23:42 2022] GET /compute/v2.1/os-snapshots/fb9d5d86-d74c-48e2-97c9-8992aa41df57 => generated 286 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:23:42.764172 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.network.neutron [None req-81066611-8de7-46e3-8630-e16744c5bfdc tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] validate_networks() for [('4b1f7d87-e103-414e-bca2-097f65286491', None, None, None, None, None)] {{(pid=117761) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 19:23:43.520750 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-df059026-c1b9-488b-866b-2419040af217 tempest-VolumesSnapshotsTestJSON-179055845 tempest-VolumesSnapshotsTestJSON-179055845-project] Calling method '.version_select at 0x7ff60bf7eb80>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:23:43.594287 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-df059026-c1b9-488b-866b-2419040af217 tempest-VolumesSnapshotsTestJSON-179055845 tempest-VolumesSnapshotsTestJSON-179055845-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/fb9d5d86-d74c-48e2-97c9-8992aa41df57" status: 200 len: 286 microversion: 2.1 time: 0.077735 Jul 20 19:23:43.599584 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 9/18] 10.222.0.69 () {58 vars in 1250 bytes} [Wed Jul 20 19:23:43 2022] GET /compute/v2.1/os-snapshots/fb9d5d86-d74c-48e2-97c9-8992aa41df57 => generated 286 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:23:44.607699 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-5965c946-6005-4748-9695-14e789376d8f tempest-VolumesSnapshotsTestJSON-179055845 tempest-VolumesSnapshotsTestJSON-179055845-project] Calling method '.version_select at 0x7ff60bf1a280>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:23:44.612215 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.virt.hardware [None req-81066611-8de7-46e3-8630-e16744c5bfdc tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Flavor limits 0:0:0 {{(pid=117761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 19:23:44.613109 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.virt.hardware [None req-81066611-8de7-46e3-8630-e16744c5bfdc tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Image limits 0:0:0 {{(pid=117761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 19:23:44.613930 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.virt.hardware [None req-81066611-8de7-46e3-8630-e16744c5bfdc tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Flavor pref 0:0:0 {{(pid=117761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 19:23:44.614480 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.virt.hardware [None req-81066611-8de7-46e3-8630-e16744c5bfdc tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Image pref 0:0:0 {{(pid=117761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 19:23:44.615025 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.virt.hardware [None req-81066611-8de7-46e3-8630-e16744c5bfdc tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 19:23:44.655069 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-81066611-8de7-46e3-8630-e16744c5bfdc tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:23:44.655701 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-81066611-8de7-46e3-8630-e16744c5bfdc tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:23:44.658745 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-81066611-8de7-46e3-8630-e16744c5bfdc tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:23:44.660402 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-81066611-8de7-46e3-8630-e16744c5bfdc tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:23:44.689127 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-5965c946-6005-4748-9695-14e789376d8f tempest-VolumesSnapshotsTestJSON-179055845 tempest-VolumesSnapshotsTestJSON-179055845-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/fb9d5d86-d74c-48e2-97c9-8992aa41df57" status: 200 len: 286 microversion: 2.1 time: 0.085544 Jul 20 19:23:44.689714 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 10/19] 10.222.0.69 () {58 vars in 1250 bytes} [Wed Jul 20 19:23:44 2022] GET /compute/v2.1/os-snapshots/fb9d5d86-d74c-48e2-97c9-8992aa41df57 => generated 286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:23:44.784119 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.quota [None req-81066611-8de7-46e3-8630-e16744c5bfdc tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Getting quotas for project 05e0691b14804cc5b4fe120fc5dea871. Resources: {'cores', 'ram', 'instances'} {{(pid=117761) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:23:44.798998 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.quota [None req-81066611-8de7-46e3-8630-e16744c5bfdc tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Getting quotas for user beb901faa8e9410484f83e47e5bcfa8c and project 05e0691b14804cc5b4fe120fc5dea871. Resources: {'cores', 'ram', 'instances'} {{(pid=117761) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:23:44.858300 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-81066611-8de7-46e3-8630-e16744c5bfdc tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Going to run 1 instances... {{(pid=117761) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 19:23:44.861290 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-81066611-8de7-46e3-8630-e16744c5bfdc tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] [instance: 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='59575804-e013-4dec-af24-b6c2dbbce73a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117761) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 19:23:45.046153 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-81066611-8de7-46e3-8630-e16744c5bfdc tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.857158 Jul 20 19:23:45.047133 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 10/20] 10.222.0.69 () {60 vars in 1146 bytes} [Wed Jul 20 19:23:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2859 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 19:23:45.059006 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-44ceead6-55ac-4ce1-9bf6-e4b9030c5bc8 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:23:45.060205 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-44ceead6-55ac-4ce1-9bf6-e4b9030c5bc8 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] [instance: 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:23:45.391373 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-44ceead6-55ac-4ce1-9bf6-e4b9030c5bc8 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb901faa8e9410484f83e47e5bcfa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e0691b14804cc5b4fe120fc5dea871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:23:45.437556 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-44ceead6-55ac-4ce1-9bf6-e4b9030c5bc8 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] 10.222.0.69 "GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c" status: 200 len: 1215 microversion: 2.1 time: 0.383583 Jul 20 19:23:45.447891 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 11/21] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:23:45 2022] GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c => generated 1215 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:23:45.701633 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-3039d3f5-9187-4cda-bf65-9c063fcb78a3 tempest-VolumesSnapshotsTestJSON-179055845 tempest-VolumesSnapshotsTestJSON-179055845-project] Calling method '.version_select at 0x7ff60bef6700>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:23:45.776377 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-3039d3f5-9187-4cda-bf65-9c063fcb78a3 tempest-VolumesSnapshotsTestJSON-179055845 tempest-VolumesSnapshotsTestJSON-179055845-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/fb9d5d86-d74c-48e2-97c9-8992aa41df57" status: 200 len: 286 microversion: 2.1 time: 0.079200 Jul 20 19:23:45.777484 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 11/22] 10.222.0.69 () {58 vars in 1250 bytes} [Wed Jul 20 19:23:45 2022] GET /compute/v2.1/os-snapshots/fb9d5d86-d74c-48e2-97c9-8992aa41df57 => generated 286 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:23:46.455176 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-15c75bd8-904c-4300-89e9-f3387a01ec3c tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:23:46.456545 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-15c75bd8-904c-4300-89e9-f3387a01ec3c tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] [instance: 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:23:46.877777 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ba877c91-21d6-4d94-9a2f-f678075313c0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Action: 'create', calling method: .version_select at 0x7ff60bef6dc0>, body: {"keypair": {"name": "tempest-keypair-543896985", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAe6mB2YIhZSXVvPcgLCUPYuXD/2EJ1/ykIgt92dwAP1DmxwXlfwrnG/2+qmW9O9MGuiYdCPF/xnemR7XsQIgIicn/yq5kgalESb69JEvdV2khvKzmAyWFMYJn46pSr76g=="}} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:23:46.887873 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-15c75bd8-904c-4300-89e9-f3387a01ec3c tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb901faa8e9410484f83e47e5bcfa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e0691b14804cc5b4fe120fc5dea871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:23:46.897051 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-15c75bd8-904c-4300-89e9-f3387a01ec3c tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] 10.222.0.69 "GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c" status: 200 len: 1215 microversion: 2.1 time: 0.445722 Jul 20 19:23:46.902537 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 12/23] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:23:46 2022] GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c => generated 1215 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:23:46.916648 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-2477ae93-3c6a-44d3-b853-1e7e12cc564f tempest-VolumesSnapshotsTestJSON-179055845 tempest-VolumesSnapshotsTestJSON-179055845-project] Calling method '.version_select at 0x7ff60bed5f70>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:23:47.027226 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.quota [None req-ba877c91-21d6-4d94-9a2f-f678075313c0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Getting quotas for project e6e0bccb45a24af3918f7db2c60de33d. Resources: {'key_pairs'} {{(pid=117761) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:23:47.027702 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-2477ae93-3c6a-44d3-b853-1e7e12cc564f tempest-VolumesSnapshotsTestJSON-179055845 tempest-VolumesSnapshotsTestJSON-179055845-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/fb9d5d86-d74c-48e2-97c9-8992aa41df57" status: 200 len: 287 microversion: 2.1 time: 0.122555 Jul 20 19:23:47.029535 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 13/24] 10.222.0.69 () {58 vars in 1250 bytes} [Wed Jul 20 19:23:46 2022] GET /compute/v2.1/os-snapshots/fb9d5d86-d74c-48e2-97c9-8992aa41df57 => generated 287 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:23:47.038308 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.quota [None req-ba877c91-21d6-4d94-9a2f-f678075313c0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Getting quotas for user 343e480dd5ee4389ba430129cd7daaa4 and project e6e0bccb45a24af3918f7db2c60de33d. Resources: {'key_pairs'} {{(pid=117761) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:23:47.044628 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-6f1b6bf9-53cd-4535-abd5-61eeb673ad9b tempest-VolumesSnapshotsTestJSON-179055845 tempest-VolumesSnapshotsTestJSON-179055845-project] Calling method '.version_select at 0x7ff60becb670>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:23:47.159303 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ba877c91-21d6-4d94-9a2f-f678075313c0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.483760 Jul 20 19:23:47.162362 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 12/25] 10.222.0.69 () {62 vars in 1199 bytes} [Wed Jul 20 19:23:46 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 489 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 20 19:23:47.227703 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-6f1b6bf9-53cd-4535-abd5-61eeb673ad9b tempest-VolumesSnapshotsTestJSON-179055845 tempest-VolumesSnapshotsTestJSON-179055845-project] 10.222.0.69 "DELETE /compute/v2.1/os-snapshots/fb9d5d86-d74c-48e2-97c9-8992aa41df57" status: 202 len: 0 microversion: 2.1 time: 0.189623 Jul 20 19:23:47.228741 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 14/26] 10.222.0.69 () {58 vars in 1253 bytes} [Wed Jul 20 19:23:47 2022] DELETE /compute/v2.1/os-snapshots/fb9d5d86-d74c-48e2-97c9-8992aa41df57 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 19:23:47.238919 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-68b5fc30-2c6e-4c83-8191-a5597d1bc542 tempest-VolumesSnapshotsTestJSON-179055845 tempest-VolumesSnapshotsTestJSON-179055845-project] Calling method '.version_select at 0x7ff60ae8d040>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:23:47.363692 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-68b5fc30-2c6e-4c83-8191-a5597d1bc542 tempest-VolumesSnapshotsTestJSON-179055845 tempest-VolumesSnapshotsTestJSON-179055845-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/fb9d5d86-d74c-48e2-97c9-8992aa41df57" status: 200 len: 286 microversion: 2.1 time: 0.129954 Jul 20 19:23:47.369346 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 13/27] 10.222.0.69 () {58 vars in 1250 bytes} [Wed Jul 20 19:23:47 2022] GET /compute/v2.1/os-snapshots/fb9d5d86-d74c-48e2-97c9-8992aa41df57 => generated 286 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:23:47.917358 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-e2e80990-ea5f-4372-bd92-49a3179c79e5 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:23:47.919885 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-e2e80990-ea5f-4372-bd92-49a3179c79e5 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] [instance: 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:23:47.932812 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e2e80990-ea5f-4372-bd92-49a3179c79e5 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:23:47.940019 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e2e80990-ea5f-4372-bd92-49a3179c79e5 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:23:47.942089 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e2e80990-ea5f-4372-bd92-49a3179c79e5 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:23:47.944161 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e2e80990-ea5f-4372-bd92-49a3179c79e5 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:23:48.288026 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-e2e80990-ea5f-4372-bd92-49a3179c79e5 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb901faa8e9410484f83e47e5bcfa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e0691b14804cc5b4fe120fc5dea871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:23:48.337100 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-e2e80990-ea5f-4372-bd92-49a3179c79e5 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] 10.222.0.69 "GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c" status: 200 len: 1219 microversion: 2.1 time: 0.425650 Jul 20 19:23:48.340403 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 15/28] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:23:47 2022] GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c => generated 1219 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:23:48.383801 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c56675d0-d554-41f2-b324-cd0e4932df11 tempest-VolumesSnapshotsTestJSON-179055845 tempest-VolumesSnapshotsTestJSON-179055845-project] Calling method '.version_select at 0x7ff60aeab550>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:23:48.452247 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c56675d0-d554-41f2-b324-cd0e4932df11 tempest-VolumesSnapshotsTestJSON-179055845 tempest-VolumesSnapshotsTestJSON-179055845-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/fb9d5d86-d74c-48e2-97c9-8992aa41df57" status: 200 len: 286 microversion: 2.1 time: 0.078843 Jul 20 19:23:48.452838 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 14/29] 10.222.0.69 () {58 vars in 1250 bytes} [Wed Jul 20 19:23:48 2022] GET /compute/v2.1/os-snapshots/fb9d5d86-d74c-48e2-97c9-8992aa41df57 => generated 286 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:23:49.359772 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-6092e24c-fdc0-425f-8550-cf159efdb226 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:23:49.360384 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-6092e24c-fdc0-425f-8550-cf159efdb226 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] [instance: 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:23:49.376609 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-6092e24c-fdc0-425f-8550-cf159efdb226 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:23:49.379461 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-6092e24c-fdc0-425f-8550-cf159efdb226 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:23:49.380458 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-6092e24c-fdc0-425f-8550-cf159efdb226 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:23:49.382063 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-6092e24c-fdc0-425f-8550-cf159efdb226 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:23:49.466305 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-346e478c-e46b-4ea6-8307-9402b52eefc3 tempest-VolumesSnapshotsTestJSON-179055845 tempest-VolumesSnapshotsTestJSON-179055845-project] Calling method '.version_select at 0x7ff60aeabc10>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:23:49.532287 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-346e478c-e46b-4ea6-8307-9402b52eefc3 tempest-VolumesSnapshotsTestJSON-179055845 tempest-VolumesSnapshotsTestJSON-179055845-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/fb9d5d86-d74c-48e2-97c9-8992aa41df57" status: 200 len: 286 microversion: 2.1 time: 0.070276 Jul 20 19:23:49.533624 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 15/30] 10.222.0.69 () {58 vars in 1250 bytes} [Wed Jul 20 19:23:49 2022] GET /compute/v2.1/os-snapshots/fb9d5d86-d74c-48e2-97c9-8992aa41df57 => generated 286 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:23:49.654773 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-6092e24c-fdc0-425f-8550-cf159efdb226 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb901faa8e9410484f83e47e5bcfa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e0691b14804cc5b4fe120fc5dea871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:23:49.668956 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-6092e24c-fdc0-425f-8550-cf159efdb226 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] 10.222.0.69 "GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c" status: 200 len: 1219 microversion: 2.1 time: 0.311493 Jul 20 19:23:49.671422 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 16/31] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:23:49 2022] GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c => generated 1219 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:23:50.547271 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-9c6ee1c5-77e7-4da5-99c6-1a82957cc8e7 tempest-VolumesSnapshotsTestJSON-179055845 tempest-VolumesSnapshotsTestJSON-179055845-project] Calling method '.version_select at 0x7ff60aeabb80>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:23:50.714559 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-9c6ee1c5-77e7-4da5-99c6-1a82957cc8e7 tempest-VolumesSnapshotsTestJSON-179055845 tempest-VolumesSnapshotsTestJSON-179055845-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/fb9d5d86-d74c-48e2-97c9-8992aa41df57" status: 200 len: 286 microversion: 2.1 time: 0.171214 Jul 20 19:23:50.715335 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 16/32] 10.222.0.69 () {58 vars in 1250 bytes} [Wed Jul 20 19:23:50 2022] GET /compute/v2.1/os-snapshots/fb9d5d86-d74c-48e2-97c9-8992aa41df57 => generated 286 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:23:50.726018 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-77bef20c-ef1a-449d-986e-2a1e5b6a7829 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:23:50.727504 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-77bef20c-ef1a-449d-986e-2a1e5b6a7829 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] [instance: 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:23:50.782151 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-77bef20c-ef1a-449d-986e-2a1e5b6a7829 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:23:50.782618 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-77bef20c-ef1a-449d-986e-2a1e5b6a7829 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:23:50.786746 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-77bef20c-ef1a-449d-986e-2a1e5b6a7829 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:23:50.787205 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-77bef20c-ef1a-449d-986e-2a1e5b6a7829 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:23:51.404345 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-77bef20c-ef1a-449d-986e-2a1e5b6a7829 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb901faa8e9410484f83e47e5bcfa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e0691b14804cc5b4fe120fc5dea871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:23:51.429073 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-77bef20c-ef1a-449d-986e-2a1e5b6a7829 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] 10.222.0.69 "GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c" status: 200 len: 1267 microversion: 2.1 time: 0.711879 Jul 20 19:23:51.430024 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 17/33] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:23:50 2022] GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c => generated 1267 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:23:51.460202 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-a7ded294-051d-426a-8fb0-1aad4f048a7e tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Action: 'create', calling method: .version_select at 0x7ff60be5a940>, body: {"keypair": {"name": "tempest-keypair-1960440461", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRTO0o+5A7PFNO8zqjja+pZ6dIwcoJO5SLZEvtmnIwCPKNEM/8npu7Ta8ZEHopfk0C/XE5VPYoS/PiEMxiRTaCsLnb1E1BOfkb90zclgQgKJPtfeyYepHQxYqWCgnIyKA=="}} {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:23:51.635864 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.quota [None req-a7ded294-051d-426a-8fb0-1aad4f048a7e tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Getting quotas for project d0ab510f529d4442bd0e379056c4c3e5. Resources: {'key_pairs'} {{(pid=117762) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:23:51.663125 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.quota [None req-a7ded294-051d-426a-8fb0-1aad4f048a7e tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Getting quotas for user 4d08da0ef69e4cf2abc6c18bbbc51a2f and project d0ab510f529d4442bd0e379056c4c3e5. Resources: {'key_pairs'} {{(pid=117762) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:23:51.805002 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-a7ded294-051d-426a-8fb0-1aad4f048a7e tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.205999 Jul 20 19:23:51.806289 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 17/34] 10.222.0.69 () {60 vars in 1158 bytes} [Wed Jul 20 19:23:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:23:51.824349 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-9b64a383-eae6-4b79-b19b-7091df67bdff tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-406688670", "imageRef": "59575804-e013-4dec-af24-b6c2dbbce73a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "38fecd6a-64fe-4f75-b0f6-54a5c956d554"}], "security_groups": [{"name": "tempest-securitygroup--499188185"}], "key_name": "tempest-keypair-543896985", "user_data": "}} {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:23:52.155740 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.network.neutron [None req-9b64a383-eae6-4b79-b19b-7091df67bdff tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] validate_networks() for [('38fecd6a-64fe-4f75-b0f6-54a5c956d554', None, None, None, None, None)] {{(pid=117762) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 19:23:52.430413 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-36dbcba4-0a61-4ff3-9cf3-c731c92b5441 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1749586279", "imageRef": "59575804-e013-4dec-af24-b6c2dbbce73a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:23:52.589348 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.network.neutron [None req-36dbcba4-0a61-4ff3-9cf3-c731c92b5441 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] validate_networks() for [('aef5723e-1807-4eb3-b101-2d519a5b7765', None, None, None, None, None)] {{(pid=117761) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 19:23:54.077241 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.virt.hardware [None req-36dbcba4-0a61-4ff3-9cf3-c731c92b5441 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Flavor limits 0:0:0 {{(pid=117761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 19:23:54.078077 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.virt.hardware [None req-36dbcba4-0a61-4ff3-9cf3-c731c92b5441 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Image limits 0:0:0 {{(pid=117761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 19:23:54.078680 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.virt.hardware [None req-36dbcba4-0a61-4ff3-9cf3-c731c92b5441 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Flavor pref 0:0:0 {{(pid=117761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 19:23:54.079345 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.virt.hardware [None req-36dbcba4-0a61-4ff3-9cf3-c731c92b5441 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Image pref 0:0:0 {{(pid=117761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 19:23:54.079883 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.virt.hardware [None req-36dbcba4-0a61-4ff3-9cf3-c731c92b5441 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 19:23:54.112965 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-36dbcba4-0a61-4ff3-9cf3-c731c92b5441 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:23:54.114747 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-36dbcba4-0a61-4ff3-9cf3-c731c92b5441 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:23:54.122798 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-36dbcba4-0a61-4ff3-9cf3-c731c92b5441 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:23:54.124575 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-36dbcba4-0a61-4ff3-9cf3-c731c92b5441 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:23:54.251719 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.quota [None req-36dbcba4-0a61-4ff3-9cf3-c731c92b5441 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Getting quotas for project 8821facab6ed48588d9d484b5e3d98ba. Resources: {'cores', 'ram', 'instances'} {{(pid=117761) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:23:54.275883 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.quota [None req-36dbcba4-0a61-4ff3-9cf3-c731c92b5441 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Getting quotas for user 9192f2842ca044f08e5f95f98f2e1b88 and project 8821facab6ed48588d9d484b5e3d98ba. Resources: {'cores', 'ram', 'instances'} {{(pid=117761) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:23:54.371333 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-36dbcba4-0a61-4ff3-9cf3-c731c92b5441 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Going to run 1 instances... {{(pid=117761) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 19:23:54.381808 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-36dbcba4-0a61-4ff3-9cf3-c731c92b5441 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 053acc99-052e-4247-a54a-2799958f10e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='59575804-e013-4dec-af24-b6c2dbbce73a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117761) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 19:23:54.664856 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-36dbcba4-0a61-4ff3-9cf3-c731c92b5441 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.233434 Jul 20 19:23:54.666549 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 18/35] 10.222.0.69 () {60 vars in 1146 bytes} [Wed Jul 20 19:23:51 2022] POST /compute/v2.1/servers => generated 383 bytes in 3236 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 19:23:54.706727 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-89d7037b-836b-474c-a71c-0f52b7a105ef tempest-VolumesSnapshotsTestJSON-179055845 tempest-VolumesSnapshotsTestJSON-179055845-project] Calling method '.version_select at 0x7ff60a5845e0>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:23:54.818183 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.wsgi [None req-89d7037b-836b-474c-a71c-0f52b7a105ef tempest-VolumesSnapshotsTestJSON-179055845 tempest-VolumesSnapshotsTestJSON-179055845-project] HTTP exception thrown: Snapshot fb9d5d86-d74c-48e2-97c9-8992aa41df57 could not be found. Jul 20 19:23:54.824898 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-89d7037b-836b-474c-a71c-0f52b7a105ef tempest-VolumesSnapshotsTestJSON-179055845 tempest-VolumesSnapshotsTestJSON-179055845-project] Request method failure captured: Jul 20 19:23:54.824898 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: GET /compute/v2.1/os-snapshots/fb9d5d86-d74c-48e2-97c9-8992aa41df57 HTTP/1.1 Jul 20 19:23:54.824898 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 19:23:54.824898 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 19:23:54.824898 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 19:23:54.824898 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 0 Jul 20 19:23:54.824898 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 19:23:54.824898 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 19:23:54.824898 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 19:23:54.824898 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 19:23:54.824898 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2FY05zsMPgdFgWFIc_w2cVSruqCJf_zvRwekqMtH88Jf2adPnHBYnlahwEOlB_cp1iZg3TMbUK6fqSGArHMCehNPogpzNuWv67jzjMggRJu6M2Vt1EEQHdZs-ZdEtenD1I_5Rx11orU-wvDBYiVgm18bXbEzh9yxHLY47N7BchEvlNU Jul 20 19:23:54.824898 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 19:23:54.824898 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 19:23:54.824898 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 19:23:54.824898 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 19:23:54.824898 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 19:23:54.824898 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 19:23:54.824898 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: f97d002af3ee402090e62737cf1e14b9 Jul 20 19:23:54.824898 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-179055845 Jul 20 19:23:54.824898 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 19:23:54.824898 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 19:23:54.826177 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f97d002af3ee402090e62737cf1e14b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f97d002af3ee402090e62737cf1e14b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f97d002af3ee402090e62737cf1e14b9", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f97d002af3ee402090e62737cf1e14b9"}]}] Jul 20 19:23:54.826177 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-VolumesSnapshotsTestJSON-179055845 Jul 20 19:23:54.826177 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: f97d002af3ee402090e62737cf1e14b9 Jul 20 19:23:54.826177 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-179055845 Jul 20 19:23:54.826177 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-VolumesSnapshotsTestJSON-179055845-project Jul 20 19:23:54.826177 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 19:23:54.826177 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 19:23:54.826177 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: 47478871f08e4c58be083739eb1ee56b Jul 20 19:23:54.826177 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-VolumesSnapshotsTestJSON-179055845-project Jul 20 19:23:54.826177 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: Jul 20 19:23:54.826177 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Snapshot fb9d5d86-d74c-48e2-97c9-8992aa41df57 could not be found. Jul 20 19:23:54.826177 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'id': 'fb9d5d86-d74c-48e2-97c9-8992aa41df57'} Jul 20 19:23:54.826177 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:23:54.826958 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:23:54.826958 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 20 19:23:54.826958 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 20 19:23:54.826958 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 20 19:23:54.826958 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 20 19:23:54.826958 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 20 19:23:54.826958 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 20 19:23:54.826958 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 19:23:54.826958 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 19:23:54.826958 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 19:23:54.826958 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 19:23:54.826958 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 19:23:54.826958 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 19:23:54.826958 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 19:23:54.826958 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 19:23:54.826958 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot fb9d5d86-d74c-48e2-97c9-8992aa41df57 could not be found. (HTTP 404) (Request-ID: req-89e8b159-54fa-4376-8758-cfbedf6027dd) Jul 20 19:23:54.826958 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:23:54.826958 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:23:54.828004 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:23:54.828004 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:23:54.828004 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 20 19:23:54.828004 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 20 19:23:54.828004 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 19:23:54.828004 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 19:23:54.828004 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 20 19:23:54.828004 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 20 19:23:54.828004 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 19:23:54.828004 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 19:23:54.828004 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 20 19:23:54.828004 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 20 19:23:54.828004 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 20 19:23:54.828004 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 20 19:23:54.828004 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 20 19:23:54.828004 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 20 19:23:54.828004 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 19:23:54.828004 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 19:23:54.828004 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 19:23:54.829024 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 19:23:54.829024 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 19:23:54.829024 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 19:23:54.829024 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 19:23:54.829024 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 19:23:54.829024 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot fb9d5d86-d74c-48e2-97c9-8992aa41df57 could not be found. Jul 20 19:23:54.829024 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:23:54.829024 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:23:54.829024 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:23:54.829024 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:23:54.829024 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:23:54.829024 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:23:54.829024 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:23:54.829024 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:23:54.829024 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 19:23:54.829024 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 19:23:54.829024 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:23:54.829024 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:23:54.829024 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 20 19:23:54.829024 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:23:54.830018 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot fb9d5d86-d74c-48e2-97c9-8992aa41df57 could not be found. Jul 20 19:23:54.830018 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:23:54.830018 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:23:54.830018 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:23:54.830018 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:23:54.830018 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:23:54.830018 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:23:54.830018 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:23:54.830018 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:23:54.830018 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot fb9d5d86-d74c-48e2-97c9-8992aa41df57 could not be found. Jul 20 19:23:54.830018 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:23:54.832811 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-89d7037b-836b-474c-a71c-0f52b7a105ef tempest-VolumesSnapshotsTestJSON-179055845 tempest-VolumesSnapshotsTestJSON-179055845-project] Returning 404 to user: Snapshot fb9d5d86-d74c-48e2-97c9-8992aa41df57 could not be found. {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:23:54.835394 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-89d7037b-836b-474c-a71c-0f52b7a105ef tempest-VolumesSnapshotsTestJSON-179055845 tempest-VolumesSnapshotsTestJSON-179055845-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/fb9d5d86-d74c-48e2-97c9-8992aa41df57" status: 404 len: 111 microversion: 2.1 time: 0.166217 Jul 20 19:23:54.838702 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 19/36] 10.222.0.69 () {58 vars in 1250 bytes} [Wed Jul 20 19:23:54 2022] GET /compute/v2.1/os-snapshots/fb9d5d86-d74c-48e2-97c9-8992aa41df57 => generated 111 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:23:54.853943 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-37f7277b-267a-44bd-9348-e38c6cf5bdf5 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:23:54.854967 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-37f7277b-267a-44bd-9348-e38c6cf5bdf5 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] [instance: 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:23:54.888905 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-37f7277b-267a-44bd-9348-e38c6cf5bdf5 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:23:54.889811 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-37f7277b-267a-44bd-9348-e38c6cf5bdf5 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:23:54.891896 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-37f7277b-267a-44bd-9348-e38c6cf5bdf5 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:23:54.894904 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-37f7277b-267a-44bd-9348-e38c6cf5bdf5 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:23:55.968352 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-37f7277b-267a-44bd-9348-e38c6cf5bdf5 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb901faa8e9410484f83e47e5bcfa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e0691b14804cc5b4fe120fc5dea871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:23:55.983234 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-37f7277b-267a-44bd-9348-e38c6cf5bdf5 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] 10.222.0.69 "GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c" status: 200 len: 1315 microversion: 2.1 time: 1.143158 Jul 20 19:23:55.983814 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 20/37] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:23:54 2022] GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c => generated 1315 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:23:55.999588 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-edd19aba-3c4d-45cd-8e66-a7ce5d28208f tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:23:56.001639 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-edd19aba-3c4d-45cd-8e66-a7ce5d28208f tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 053acc99-052e-4247-a54a-2799958f10e6] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:23:56.565130 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-edd19aba-3c4d-45cd-8e66-a7ce5d28208f tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:23:56.588468 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-edd19aba-3c4d-45cd-8e66-a7ce5d28208f tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6" status: 200 len: 1222 microversion: 2.1 time: 0.601256 Jul 20 19:23:56.589494 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 21/38] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:23:55 2022] GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6 => generated 1222 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:23:56.598444 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-df82e3e0-983e-4a05-b4dd-e0bc1c0cb78e tempest-VolumesSnapshotsTestJSON-179055845 tempest-VolumesSnapshotsTestJSON-179055845-project] Calling method '.version_select at 0x7ff60a635d30>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:23:56.815889 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-df82e3e0-983e-4a05-b4dd-e0bc1c0cb78e tempest-VolumesSnapshotsTestJSON-179055845 tempest-VolumesSnapshotsTestJSON-179055845-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/3987cb7a-fb9c-41d0-ac2c-410058d3e565" status: 202 len: 0 microversion: 2.1 time: 0.224902 Jul 20 19:23:56.816771 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 22/39] 10.222.0.69 () {58 vars in 1247 bytes} [Wed Jul 20 19:23:56 2022] DELETE /compute/v2.1/os-volumes/3987cb7a-fb9c-41d0-ac2c-410058d3e565 => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 19:23:56.829498 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-cf685205-0363-457a-a4dd-d18edf25bdb1 tempest-VolumesSnapshotsTestJSON-179055845 tempest-VolumesSnapshotsTestJSON-179055845-project] Calling method '.version_select at 0x7ff60a56b700>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:23:57.009754 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-cf685205-0363-457a-a4dd-d18edf25bdb1 tempest-VolumesSnapshotsTestJSON-179055845 tempest-VolumesSnapshotsTestJSON-179055845-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/3987cb7a-fb9c-41d0-ac2c-410058d3e565" status: 200 len: 345 microversion: 2.1 time: 0.186273 Jul 20 19:23:57.013081 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 23/40] 10.222.0.69 () {58 vars in 1244 bytes} [Wed Jul 20 19:23:56 2022] GET /compute/v2.1/os-volumes/3987cb7a-fb9c-41d0-ac2c-410058d3e565 => generated 345 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:23:57.023210 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-249d36eb-1ca6-42ab-9630-db8899b613a5 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-426708774", "imageRef": "59575804-e013-4dec-af24-b6c2dbbce73a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:23:57.291573 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.network.neutron [None req-249d36eb-1ca6-42ab-9630-db8899b613a5 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] validate_networks() for [('aef5723e-1807-4eb3-b101-2d519a5b7765', None, None, None, None, None)] {{(pid=117761) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 19:23:57.634692 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.virt.hardware [None req-9b64a383-eae6-4b79-b19b-7091df67bdff tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Flavor limits 0:0:0 {{(pid=117762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 19:23:57.635328 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.virt.hardware [None req-9b64a383-eae6-4b79-b19b-7091df67bdff tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Image limits 0:0:0 {{(pid=117762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 19:23:57.636284 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.virt.hardware [None req-9b64a383-eae6-4b79-b19b-7091df67bdff tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Flavor pref 0:0:0 {{(pid=117762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 19:23:57.636284 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.virt.hardware [None req-9b64a383-eae6-4b79-b19b-7091df67bdff tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Image pref 0:0:0 {{(pid=117762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 19:23:57.645490 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.virt.hardware [None req-9b64a383-eae6-4b79-b19b-7091df67bdff tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 19:23:57.653918 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9b64a383-eae6-4b79-b19b-7091df67bdff tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:23:57.668170 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9b64a383-eae6-4b79-b19b-7091df67bdff tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:23:57.668170 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9b64a383-eae6-4b79-b19b-7091df67bdff tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:23:57.677983 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9b64a383-eae6-4b79-b19b-7091df67bdff tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:23:57.782324 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.quota [None req-9b64a383-eae6-4b79-b19b-7091df67bdff tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Getting quotas for project e6e0bccb45a24af3918f7db2c60de33d. Resources: {'cores', 'ram', 'instances'} {{(pid=117762) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:23:57.797426 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.quota [None req-9b64a383-eae6-4b79-b19b-7091df67bdff tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Getting quotas for user 343e480dd5ee4389ba430129cd7daaa4 and project e6e0bccb45a24af3918f7db2c60de33d. Resources: {'cores', 'ram', 'instances'} {{(pid=117762) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:23:57.833889 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-9b64a383-eae6-4b79-b19b-7091df67bdff tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Going to run 1 instances... {{(pid=117762) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 19:23:57.848423 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-9b64a383-eae6-4b79-b19b-7091df67bdff tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='59575804-e013-4dec-af24-b6c2dbbce73a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117762) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 19:23:58.067119 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-9b64a383-eae6-4b79-b19b-7091df67bdff tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 6.259542 Jul 20 19:23:58.068020 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 18/41] 10.222.0.69 () {62 vars in 1187 bytes} [Wed Jul 20 19:23:51 2022] POST /compute/v2.1/servers => generated 401 bytes in 6261 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 19:23:58.095610 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-1f3de098-d764-41df-b0b8-22edc1ff6a13 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:23:58.096301 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-1f3de098-d764-41df-b0b8-22edc1ff6a13 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] [instance: 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:23:58.123498 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1f3de098-d764-41df-b0b8-22edc1ff6a13 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:23:58.124027 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1f3de098-d764-41df-b0b8-22edc1ff6a13 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:23:58.129865 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1f3de098-d764-41df-b0b8-22edc1ff6a13 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:23:58.131677 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1f3de098-d764-41df-b0b8-22edc1ff6a13 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:23:59.129337 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-1f3de098-d764-41df-b0b8-22edc1ff6a13 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb901faa8e9410484f83e47e5bcfa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e0691b14804cc5b4fe120fc5dea871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:23:59.145422 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-1f3de098-d764-41df-b0b8-22edc1ff6a13 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] 10.222.0.69 "GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c" status: 200 len: 1315 microversion: 2.1 time: 1.075782 Jul 20 19:23:59.153418 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 19/42] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:23:58 2022] GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c => generated 1315 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:23:59.176286 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-01146b5e-f673-4fda-9245-78ebabe07359 tempest-VolumesSnapshotsTestJSON-179055845 tempest-VolumesSnapshotsTestJSON-179055845-project] Calling method '.version_select at 0x7ff60b53a3a0>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:23:59.296676 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.wsgi [None req-01146b5e-f673-4fda-9245-78ebabe07359 tempest-VolumesSnapshotsTestJSON-179055845 tempest-VolumesSnapshotsTestJSON-179055845-project] HTTP exception thrown: Volume 3987cb7a-fb9c-41d0-ac2c-410058d3e565 could not be found. Jul 20 19:23:59.298931 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-01146b5e-f673-4fda-9245-78ebabe07359 tempest-VolumesSnapshotsTestJSON-179055845 tempest-VolumesSnapshotsTestJSON-179055845-project] Request method failure captured: Jul 20 19:23:59.298931 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: request: GET /compute/v2.1/os-volumes/3987cb7a-fb9c-41d0-ac2c-410058d3e565 HTTP/1.1 Jul 20 19:23:59.298931 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: Accept: application/json Jul 20 19:23:59.298931 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: Accept-Encoding: identity Jul 20 19:23:59.298931 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: Connection: close Jul 20 19:23:59.298931 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: Content-Length: 0 Jul 20 19:23:59.298931 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: Content-Type: application/json Jul 20 19:23:59.298931 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: Host: 10.222.0.69 Jul 20 19:23:59.298931 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: Openstack-System-Scope: None Jul 20 19:23:59.298931 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: User-Agent: python-urllib3/1.26.9 Jul 20 19:23:59.298931 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Auth-Token: gAAAAABi2FY05zsMPgdFgWFIc_w2cVSruqCJf_zvRwekqMtH88Jf2adPnHBYnlahwEOlB_cp1iZg3TMbUK6fqSGArHMCehNPogpzNuWv67jzjMggRJu6M2Vt1EEQHdZs-ZdEtenD1I_5Rx11orU-wvDBYiVgm18bXbEzh9yxHLY47N7BchEvlNU Jul 20 19:23:59.298931 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Domain-Id: None Jul 20 19:23:59.298931 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Domain-Name: None Jul 20 19:23:59.298931 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Identity-Status: Confirmed Jul 20 19:23:59.298931 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Is-Admin-Project: True Jul 20 19:23:59.298931 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Project-Domain-Id: default Jul 20 19:23:59.298931 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Project-Domain-Name: Default Jul 20 19:23:59.298931 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Project-Id: f97d002af3ee402090e62737cf1e14b9 Jul 20 19:23:59.298931 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-179055845 Jul 20 19:23:59.298931 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Role: reader,member Jul 20 19:23:59.298931 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Roles: reader,member Jul 20 19:23:59.300054 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f97d002af3ee402090e62737cf1e14b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f97d002af3ee402090e62737cf1e14b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f97d002af3ee402090e62737cf1e14b9", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f97d002af3ee402090e62737cf1e14b9"}]}] Jul 20 19:23:59.300054 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Tenant: tempest-VolumesSnapshotsTestJSON-179055845 Jul 20 19:23:59.300054 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Tenant-Id: f97d002af3ee402090e62737cf1e14b9 Jul 20 19:23:59.300054 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-179055845 Jul 20 19:23:59.300054 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-User: tempest-VolumesSnapshotsTestJSON-179055845-project Jul 20 19:23:59.300054 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-User-Domain-Id: default Jul 20 19:23:59.300054 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-User-Domain-Name: Default Jul 20 19:23:59.300054 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-User-Id: 47478871f08e4c58be083739eb1ee56b Jul 20 19:23:59.300054 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-User-Name: tempest-VolumesSnapshotsTestJSON-179055845-project Jul 20 19:23:59.300054 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: method: Jul 20 19:23:59.300054 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: exception: Volume 3987cb7a-fb9c-41d0-ac2c-410058d3e565 could not be found. Jul 20 19:23:59.300054 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: action_args: {'id': '3987cb7a-fb9c-41d0-ac2c-410058d3e565'} Jul 20 19:23:59.300054 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:23:59.300773 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:23:59.300773 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 19:23:59.300773 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 19:23:59.300773 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 19:23:59.300773 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 19:23:59.300773 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 19:23:59.300773 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 19:23:59.300773 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 19:23:59.300773 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 19:23:59.300773 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 19:23:59.300773 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 19:23:59.300773 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 19:23:59.300773 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 19:23:59.300773 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 19:23:59.300773 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 19:23:59.300773 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3987cb7a-fb9c-41d0-ac2c-410058d3e565 could not be found. (HTTP 404) (Request-ID: req-7bdea198-436c-4f1a-bb2c-3214418e6954) Jul 20 19:23:59.300773 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Jul 20 19:23:59.300773 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:23:59.300773 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Jul 20 19:23:59.301782 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:23:59.301782 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 20 19:23:59.301782 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 20 19:23:59.301782 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 19:23:59.301782 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 19:23:59.301782 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 19:23:59.301782 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 19:23:59.301782 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 19:23:59.301782 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 19:23:59.301782 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 19:23:59.301782 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 19:23:59.301782 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 19:23:59.301782 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 19:23:59.301782 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 19:23:59.301782 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 19:23:59.301782 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 19:23:59.301782 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 19:23:59.301782 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 19:23:59.301782 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 19:23:59.302696 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 19:23:59.302696 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 19:23:59.302696 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 19:23:59.302696 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 19:23:59.302696 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3987cb7a-fb9c-41d0-ac2c-410058d3e565 could not be found. Jul 20 19:23:59.302696 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Jul 20 19:23:59.302696 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:23:59.302696 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Jul 20 19:23:59.302696 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:23:59.302696 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:23:59.302696 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:23:59.302696 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:23:59.302696 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:23:59.302696 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 19:23:59.302696 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 19:23:59.302696 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:23:59.302696 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:23:59.302696 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 20 19:23:59.302696 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:23:59.303635 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3987cb7a-fb9c-41d0-ac2c-410058d3e565 could not be found. Jul 20 19:23:59.303635 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Jul 20 19:23:59.303635 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:23:59.303635 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Jul 20 19:23:59.303635 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:23:59.303635 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:23:59.303635 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:23:59.303635 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:23:59.303635 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:23:59.303635 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3987cb7a-fb9c-41d0-ac2c-410058d3e565 could not be found. Jul 20 19:23:59.303635 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Jul 20 19:23:59.303635 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-01146b5e-f673-4fda-9245-78ebabe07359 tempest-VolumesSnapshotsTestJSON-179055845 tempest-VolumesSnapshotsTestJSON-179055845-project] Returning 404 to user: Volume 3987cb7a-fb9c-41d0-ac2c-410058d3e565 could not be found. {{(pid=117762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:23:59.303635 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-01146b5e-f673-4fda-9245-78ebabe07359 tempest-VolumesSnapshotsTestJSON-179055845 tempest-VolumesSnapshotsTestJSON-179055845-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/3987cb7a-fb9c-41d0-ac2c-410058d3e565" status: 404 len: 109 microversion: 2.1 time: 0.143109 Jul 20 19:23:59.303635 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 20/43] 10.222.0.69 () {58 vars in 1244 bytes} [Wed Jul 20 19:23:59 2022] GET /compute/v2.1/os-volumes/3987cb7a-fb9c-41d0-ac2c-410058d3e565 => generated 109 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:23:59.330827 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-59671767-7af1-4031-86fb-39ac838f2dee tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:23:59.350488 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-59671767-7af1-4031-86fb-39ac838f2dee tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:23:59.612269 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-59671767-7af1-4031-86fb-39ac838f2dee tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:23:59.635096 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-59671767-7af1-4031-86fb-39ac838f2dee tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:23:59.646463 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-59671767-7af1-4031-86fb-39ac838f2dee tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:23:59.656587 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-59671767-7af1-4031-86fb-39ac838f2dee tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1280 microversion: 2.20 time: 0.352315 Jul 20 19:23:59.662499 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 21/44] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:23:59 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1280 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:23:59.681261 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-e088d3f7-0112-4233-891b-e3e0515a746d tempest-VolumesSnapshotsTestJSON-179055845 tempest-VolumesSnapshotsTestJSON-179055845-project] Calling method '.version_select at 0x7ff60b53a820>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:23:59.820775 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.wsgi [None req-e088d3f7-0112-4233-891b-e3e0515a746d tempest-VolumesSnapshotsTestJSON-179055845 tempest-VolumesSnapshotsTestJSON-179055845-project] HTTP exception thrown: Volume 3987cb7a-fb9c-41d0-ac2c-410058d3e565 could not be found. Jul 20 19:23:59.823102 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-e088d3f7-0112-4233-891b-e3e0515a746d tempest-VolumesSnapshotsTestJSON-179055845 tempest-VolumesSnapshotsTestJSON-179055845-project] Request method failure captured: Jul 20 19:23:59.823102 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: request: DELETE /compute/v2.1/os-volumes/3987cb7a-fb9c-41d0-ac2c-410058d3e565 HTTP/1.1 Jul 20 19:23:59.823102 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: Accept: application/json Jul 20 19:23:59.823102 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: Accept-Encoding: identity Jul 20 19:23:59.823102 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: Connection: close Jul 20 19:23:59.823102 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: Content-Length: 0 Jul 20 19:23:59.823102 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: Content-Type: application/json Jul 20 19:23:59.823102 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: Host: 10.222.0.69 Jul 20 19:23:59.823102 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: Openstack-System-Scope: None Jul 20 19:23:59.823102 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: User-Agent: python-urllib3/1.26.9 Jul 20 19:23:59.823102 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Auth-Token: gAAAAABi2FY05zsMPgdFgWFIc_w2cVSruqCJf_zvRwekqMtH88Jf2adPnHBYnlahwEOlB_cp1iZg3TMbUK6fqSGArHMCehNPogpzNuWv67jzjMggRJu6M2Vt1EEQHdZs-ZdEtenD1I_5Rx11orU-wvDBYiVgm18bXbEzh9yxHLY47N7BchEvlNU Jul 20 19:23:59.823102 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Domain-Id: None Jul 20 19:23:59.823102 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Domain-Name: None Jul 20 19:23:59.823102 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Identity-Status: Confirmed Jul 20 19:23:59.823102 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Is-Admin-Project: True Jul 20 19:23:59.823102 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Project-Domain-Id: default Jul 20 19:23:59.823102 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Project-Domain-Name: Default Jul 20 19:23:59.823102 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Project-Id: f97d002af3ee402090e62737cf1e14b9 Jul 20 19:23:59.823102 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-179055845 Jul 20 19:23:59.823102 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Role: reader,member Jul 20 19:23:59.823102 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Roles: reader,member Jul 20 19:23:59.824418 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f97d002af3ee402090e62737cf1e14b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f97d002af3ee402090e62737cf1e14b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f97d002af3ee402090e62737cf1e14b9", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f97d002af3ee402090e62737cf1e14b9"}]}] Jul 20 19:23:59.824418 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Tenant: tempest-VolumesSnapshotsTestJSON-179055845 Jul 20 19:23:59.824418 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Tenant-Id: f97d002af3ee402090e62737cf1e14b9 Jul 20 19:23:59.824418 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-179055845 Jul 20 19:23:59.824418 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-User: tempest-VolumesSnapshotsTestJSON-179055845-project Jul 20 19:23:59.824418 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-User-Domain-Id: default Jul 20 19:23:59.824418 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-User-Domain-Name: Default Jul 20 19:23:59.824418 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-User-Id: 47478871f08e4c58be083739eb1ee56b Jul 20 19:23:59.824418 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-User-Name: tempest-VolumesSnapshotsTestJSON-179055845-project Jul 20 19:23:59.824418 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: method: Jul 20 19:23:59.824418 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: exception: Volume 3987cb7a-fb9c-41d0-ac2c-410058d3e565 could not be found. Jul 20 19:23:59.824418 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: action_args: {'id': '3987cb7a-fb9c-41d0-ac2c-410058d3e565'} Jul 20 19:23:59.824418 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:23:59.825212 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:23:59.825212 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 19:23:59.825212 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 19:23:59.825212 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 19:23:59.825212 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 19:23:59.825212 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 19:23:59.825212 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 19:23:59.825212 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 19:23:59.825212 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 19:23:59.825212 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 19:23:59.825212 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 19:23:59.825212 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 19:23:59.825212 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 19:23:59.825212 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 19:23:59.825212 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 19:23:59.825212 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3987cb7a-fb9c-41d0-ac2c-410058d3e565 could not be found. (HTTP 404) (Request-ID: req-5d279166-b057-4dc7-8eb7-06a577d4757a) Jul 20 19:23:59.825212 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Jul 20 19:23:59.825212 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:23:59.825212 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Jul 20 19:23:59.827151 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:23:59.827151 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 20 19:23:59.827151 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 20 19:23:59.827151 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 19:23:59.827151 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 19:23:59.827151 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 19:23:59.827151 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 19:23:59.827151 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 19:23:59.827151 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 19:23:59.827151 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 19:23:59.827151 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 19:23:59.827151 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 19:23:59.827151 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 19:23:59.827151 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 19:23:59.827151 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 19:23:59.827151 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 19:23:59.827151 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 19:23:59.827151 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 19:23:59.827151 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 19:23:59.828156 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 19:23:59.828156 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 19:23:59.828156 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 19:23:59.828156 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 19:23:59.828156 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3987cb7a-fb9c-41d0-ac2c-410058d3e565 could not be found. Jul 20 19:23:59.828156 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Jul 20 19:23:59.828156 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:23:59.828156 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Jul 20 19:23:59.828156 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:23:59.828156 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:23:59.828156 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:23:59.828156 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:23:59.828156 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:23:59.828156 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 19:23:59.828156 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 19:23:59.828156 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:23:59.828156 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:23:59.828156 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 20 19:23:59.828156 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:23:59.829075 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3987cb7a-fb9c-41d0-ac2c-410058d3e565 could not be found. Jul 20 19:23:59.829075 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Jul 20 19:23:59.829075 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:23:59.829075 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Jul 20 19:23:59.829075 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:23:59.829075 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:23:59.829075 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:23:59.829075 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:23:59.829075 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:23:59.829075 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3987cb7a-fb9c-41d0-ac2c-410058d3e565 could not be found. Jul 20 19:23:59.829075 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Jul 20 19:23:59.831121 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-e088d3f7-0112-4233-891b-e3e0515a746d tempest-VolumesSnapshotsTestJSON-179055845 tempest-VolumesSnapshotsTestJSON-179055845-project] Returning 404 to user: Volume 3987cb7a-fb9c-41d0-ac2c-410058d3e565 could not be found. {{(pid=117762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:23:59.832121 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-e088d3f7-0112-4233-891b-e3e0515a746d tempest-VolumesSnapshotsTestJSON-179055845 tempest-VolumesSnapshotsTestJSON-179055845-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/3987cb7a-fb9c-41d0-ac2c-410058d3e565" status: 404 len: 109 microversion: 2.1 time: 0.167799 Jul 20 19:23:59.833257 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 22/45] 10.222.0.69 () {58 vars in 1247 bytes} [Wed Jul 20 19:23:59 2022] DELETE /compute/v2.1/os-volumes/3987cb7a-fb9c-41d0-ac2c-410058d3e565 => generated 109 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:23:59.843958 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-d73e1625-7d50-4ee5-abc5-55aa36503f34 tempest-VolumesSnapshotsTestJSON-179055845 tempest-VolumesSnapshotsTestJSON-179055845-project] Calling method '.version_select at 0x7ff60a4cbee0>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:23:59.952662 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.wsgi [None req-d73e1625-7d50-4ee5-abc5-55aa36503f34 tempest-VolumesSnapshotsTestJSON-179055845 tempest-VolumesSnapshotsTestJSON-179055845-project] HTTP exception thrown: Volume 3987cb7a-fb9c-41d0-ac2c-410058d3e565 could not be found. Jul 20 19:23:59.961136 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-d73e1625-7d50-4ee5-abc5-55aa36503f34 tempest-VolumesSnapshotsTestJSON-179055845 tempest-VolumesSnapshotsTestJSON-179055845-project] Request method failure captured: Jul 20 19:23:59.961136 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: request: GET /compute/v2.1/os-volumes/3987cb7a-fb9c-41d0-ac2c-410058d3e565 HTTP/1.1 Jul 20 19:23:59.961136 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: Accept: application/json Jul 20 19:23:59.961136 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: Accept-Encoding: identity Jul 20 19:23:59.961136 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: Connection: close Jul 20 19:23:59.961136 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: Content-Length: 0 Jul 20 19:23:59.961136 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: Content-Type: application/json Jul 20 19:23:59.961136 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: Host: 10.222.0.69 Jul 20 19:23:59.961136 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: Openstack-System-Scope: None Jul 20 19:23:59.961136 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: User-Agent: python-urllib3/1.26.9 Jul 20 19:23:59.961136 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Auth-Token: gAAAAABi2FY05zsMPgdFgWFIc_w2cVSruqCJf_zvRwekqMtH88Jf2adPnHBYnlahwEOlB_cp1iZg3TMbUK6fqSGArHMCehNPogpzNuWv67jzjMggRJu6M2Vt1EEQHdZs-ZdEtenD1I_5Rx11orU-wvDBYiVgm18bXbEzh9yxHLY47N7BchEvlNU Jul 20 19:23:59.961136 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Domain-Id: None Jul 20 19:23:59.961136 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Domain-Name: None Jul 20 19:23:59.961136 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Identity-Status: Confirmed Jul 20 19:23:59.961136 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Is-Admin-Project: True Jul 20 19:23:59.961136 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Project-Domain-Id: default Jul 20 19:23:59.961136 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Project-Domain-Name: Default Jul 20 19:23:59.961136 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Project-Id: f97d002af3ee402090e62737cf1e14b9 Jul 20 19:23:59.961136 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-179055845 Jul 20 19:23:59.961136 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Role: reader,member Jul 20 19:23:59.961136 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Roles: reader,member Jul 20 19:23:59.963085 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f97d002af3ee402090e62737cf1e14b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f97d002af3ee402090e62737cf1e14b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f97d002af3ee402090e62737cf1e14b9", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f97d002af3ee402090e62737cf1e14b9"}]}] Jul 20 19:23:59.963085 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Tenant: tempest-VolumesSnapshotsTestJSON-179055845 Jul 20 19:23:59.963085 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Tenant-Id: f97d002af3ee402090e62737cf1e14b9 Jul 20 19:23:59.963085 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-179055845 Jul 20 19:23:59.963085 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-User: tempest-VolumesSnapshotsTestJSON-179055845-project Jul 20 19:23:59.963085 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-User-Domain-Id: default Jul 20 19:23:59.963085 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-User-Domain-Name: Default Jul 20 19:23:59.963085 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-User-Id: 47478871f08e4c58be083739eb1ee56b Jul 20 19:23:59.963085 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-User-Name: tempest-VolumesSnapshotsTestJSON-179055845-project Jul 20 19:23:59.963085 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: method: Jul 20 19:23:59.963085 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: exception: Volume 3987cb7a-fb9c-41d0-ac2c-410058d3e565 could not be found. Jul 20 19:23:59.963085 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: action_args: {'id': '3987cb7a-fb9c-41d0-ac2c-410058d3e565'} Jul 20 19:23:59.963085 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:23:59.963906 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:23:59.963906 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 19:23:59.963906 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 19:23:59.963906 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 19:23:59.963906 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 19:23:59.963906 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 19:23:59.963906 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 19:23:59.963906 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 19:23:59.963906 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 19:23:59.963906 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 19:23:59.963906 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 19:23:59.963906 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 19:23:59.963906 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 19:23:59.963906 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 19:23:59.963906 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 19:23:59.963906 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3987cb7a-fb9c-41d0-ac2c-410058d3e565 could not be found. (HTTP 404) (Request-ID: req-4815d4ee-e6a2-4784-8826-b5ec3c351458) Jul 20 19:23:59.963906 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Jul 20 19:23:59.963906 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:23:59.963906 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Jul 20 19:23:59.965091 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:23:59.965091 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 20 19:23:59.965091 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 20 19:23:59.965091 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 19:23:59.965091 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 19:23:59.965091 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 19:23:59.965091 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 19:23:59.965091 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 19:23:59.965091 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 19:23:59.965091 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 19:23:59.965091 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 19:23:59.965091 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 19:23:59.965091 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 19:23:59.965091 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 19:23:59.965091 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 19:23:59.965091 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 19:23:59.965091 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 19:23:59.965091 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 19:23:59.965091 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 19:23:59.966023 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 19:23:59.966023 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 19:23:59.966023 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 19:23:59.966023 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 19:23:59.966023 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3987cb7a-fb9c-41d0-ac2c-410058d3e565 could not be found. Jul 20 19:23:59.966023 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Jul 20 19:23:59.966023 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:23:59.966023 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Jul 20 19:23:59.966023 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:23:59.966023 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:23:59.966023 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:23:59.966023 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:23:59.966023 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:23:59.966023 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 19:23:59.966023 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 19:23:59.966023 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:23:59.966023 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:23:59.966023 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 20 19:23:59.966023 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:23:59.966908 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3987cb7a-fb9c-41d0-ac2c-410058d3e565 could not be found. Jul 20 19:23:59.966908 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Jul 20 19:23:59.966908 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:23:59.966908 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Jul 20 19:23:59.966908 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:23:59.966908 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:23:59.966908 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:23:59.966908 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:23:59.966908 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:23:59.966908 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3987cb7a-fb9c-41d0-ac2c-410058d3e565 could not be found. Jul 20 19:23:59.966908 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Jul 20 19:23:59.969869 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-d73e1625-7d50-4ee5-abc5-55aa36503f34 tempest-VolumesSnapshotsTestJSON-179055845 tempest-VolumesSnapshotsTestJSON-179055845-project] Returning 404 to user: Volume 3987cb7a-fb9c-41d0-ac2c-410058d3e565 could not be found. {{(pid=117762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:23:59.970843 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-d73e1625-7d50-4ee5-abc5-55aa36503f34 tempest-VolumesSnapshotsTestJSON-179055845 tempest-VolumesSnapshotsTestJSON-179055845-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/3987cb7a-fb9c-41d0-ac2c-410058d3e565" status: 404 len: 109 microversion: 2.1 time: 0.132246 Jul 20 19:23:59.974328 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 23/46] 10.222.0.69 () {58 vars in 1244 bytes} [Wed Jul 20 19:23:59 2022] GET /compute/v2.1/os-volumes/3987cb7a-fb9c-41d0-ac2c-410058d3e565 => generated 109 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:24:00.169888 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-af562956-e1e3-451c-a4f0-eeb2f3401c7e tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:00.170591 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-af562956-e1e3-451c-a4f0-eeb2f3401c7e tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] [instance: 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:00.187119 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-af562956-e1e3-451c-a4f0-eeb2f3401c7e tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:00.189778 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-af562956-e1e3-451c-a4f0-eeb2f3401c7e tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:00.195125 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-af562956-e1e3-451c-a4f0-eeb2f3401c7e tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:00.195601 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-af562956-e1e3-451c-a4f0-eeb2f3401c7e tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:00.840034 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-af562956-e1e3-451c-a4f0-eeb2f3401c7e tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb901faa8e9410484f83e47e5bcfa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e0691b14804cc5b4fe120fc5dea871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:00.863489 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-af562956-e1e3-451c-a4f0-eeb2f3401c7e tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] 10.222.0.69 "GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c" status: 200 len: 1315 microversion: 2.1 time: 0.696957 Jul 20 19:24:00.865707 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 24/47] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:00 2022] GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c => generated 1315 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:24:00.874986 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-e06a10e5-ab57-4622-80a1-5caf54c751b0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:00.876768 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-e06a10e5-ab57-4622-80a1-5caf54c751b0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:00.889953 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e06a10e5-ab57-4622-80a1-5caf54c751b0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:00.892016 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e06a10e5-ab57-4622-80a1-5caf54c751b0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:00.895894 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e06a10e5-ab57-4622-80a1-5caf54c751b0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:00.898643 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e06a10e5-ab57-4622-80a1-5caf54c751b0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:01.487893 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-e06a10e5-ab57-4622-80a1-5caf54c751b0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:01.504187 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-e06a10e5-ab57-4622-80a1-5caf54c751b0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:01.510369 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-e06a10e5-ab57-4622-80a1-5caf54c751b0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:01.518471 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-e06a10e5-ab57-4622-80a1-5caf54c751b0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1332 microversion: 2.20 time: 0.646335 Jul 20 19:24:01.519649 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 25/48] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:24:00 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1332 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:24:01.541820 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-5a85328b-a936-42a8-a2a5-99c2459e3ee3 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1204065622", "imageRef": "59575804-e013-4dec-af24-b6c2dbbce73a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1f29a5cb-67ca-4a0b-8479-a5dbe6d43f3d"}], "security_groups": [{"name": "tempest-securitygroup--1666584165"}], "key_name": "tempest-keypair-1960440461", "user_data": "}} {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:24:01.808150 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.virt.hardware [None req-249d36eb-1ca6-42ab-9630-db8899b613a5 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Flavor limits 0:0:0 {{(pid=117761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 19:24:01.809482 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.virt.hardware [None req-249d36eb-1ca6-42ab-9630-db8899b613a5 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Image limits 0:0:0 {{(pid=117761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 19:24:01.810000 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.virt.hardware [None req-249d36eb-1ca6-42ab-9630-db8899b613a5 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Flavor pref 0:0:0 {{(pid=117761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 19:24:01.810414 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.virt.hardware [None req-249d36eb-1ca6-42ab-9630-db8899b613a5 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Image pref 0:0:0 {{(pid=117761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 19:24:01.810834 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.virt.hardware [None req-249d36eb-1ca6-42ab-9630-db8899b613a5 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 19:24:01.846401 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-249d36eb-1ca6-42ab-9630-db8899b613a5 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:01.846796 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-249d36eb-1ca6-42ab-9630-db8899b613a5 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:01.849489 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-249d36eb-1ca6-42ab-9630-db8899b613a5 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:01.849984 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-249d36eb-1ca6-42ab-9630-db8899b613a5 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:01.919852 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.quota [None req-249d36eb-1ca6-42ab-9630-db8899b613a5 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Getting quotas for project 8821facab6ed48588d9d484b5e3d98ba. Resources: {'cores', 'ram', 'instances'} {{(pid=117761) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:24:01.947569 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.quota [None req-249d36eb-1ca6-42ab-9630-db8899b613a5 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Getting quotas for user 9192f2842ca044f08e5f95f98f2e1b88 and project 8821facab6ed48588d9d484b5e3d98ba. Resources: {'cores', 'ram', 'instances'} {{(pid=117761) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:24:01.999656 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-249d36eb-1ca6-42ab-9630-db8899b613a5 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Going to run 1 instances... {{(pid=117761) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 19:24:02.003650 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-249d36eb-1ca6-42ab-9630-db8899b613a5 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='59575804-e013-4dec-af24-b6c2dbbce73a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117761) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 19:24:02.180589 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-249d36eb-1ca6-42ab-9630-db8899b613a5 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.163835 Jul 20 19:24:02.181247 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 24/49] 10.222.0.69 () {60 vars in 1146 bytes} [Wed Jul 20 19:23:57 2022] POST /compute/v2.1/servers => generated 383 bytes in 5165 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 19:24:02.541769 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.network.neutron [None req-5a85328b-a936-42a8-a2a5-99c2459e3ee3 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] validate_networks() for [('1f29a5cb-67ca-4a0b-8479-a5dbe6d43f3d', None, None, None, None, None)] {{(pid=117762) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 19:24:02.796781 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [req-8178da8a-b3d7-4b6d-9d8e-c4f969f49ed5 req-da5160ca-d808-428b-b61d-1de0414eb304 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3579edbc-f4b6-4ba1-beb5-a095d7d9c21c", "tag": "ae517b12-2e27-423c-bb01-b994d91ccefb"}]} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:24:02.833308 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-8178da8a-b3d7-4b6d-9d8e-c4f969f49ed5 req-da5160ca-d808-428b-b61d-1de0414eb304 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:02.850189 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-8178da8a-b3d7-4b6d-9d8e-c4f969f49ed5 req-da5160ca-d808-428b-b61d-1de0414eb304 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:02.949668 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.compute.server_external_events [req-8178da8a-b3d7-4b6d-9d8e-c4f969f49ed5 req-da5160ca-d808-428b-b61d-1de0414eb304 service nova] Creating event network-changed:ae517b12-2e27-423c-bb01-b994d91ccefb for instance 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c on hv-cinder-83538 Jul 20 19:24:02.950274 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-8178da8a-b3d7-4b6d-9d8e-c4f969f49ed5 req-da5160ca-d808-428b-b61d-1de0414eb304 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117761) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 19:24:02.951455 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-886eb93c-f7fc-435c-8ab1-4fad5a3fd464 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:02.970463 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-886eb93c-f7fc-435c-8ab1-4fad5a3fd464 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:02.977232 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-886eb93c-f7fc-435c-8ab1-4fad5a3fd464 None None] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:02.979568 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-886eb93c-f7fc-435c-8ab1-4fad5a3fd464 None None] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:03.040901 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.compute.rpcapi [None req-886eb93c-f7fc-435c-8ab1-4fad5a3fd464 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 20 19:24:03.046382 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-886eb93c-f7fc-435c-8ab1-4fad5a3fd464 None None] Releasing lock "compute-rpcapi-router" {{(pid=117761) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 19:24:03.125424 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-886eb93c-f7fc-435c-8ab1-4fad5a3fd464 None None] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.933991 Jul 20 19:24:03.127506 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 25/50] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 19:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:24:03.140466 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-eaf077b3-6211-42bc-85c7-395089391858 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:03.141449 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-eaf077b3-6211-42bc-85c7-395089391858 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] [instance: 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:03.173556 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-eaf077b3-6211-42bc-85c7-395089391858 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:03.173933 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-eaf077b3-6211-42bc-85c7-395089391858 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:03.174725 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-eaf077b3-6211-42bc-85c7-395089391858 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:03.179542 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-eaf077b3-6211-42bc-85c7-395089391858 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:04.986515 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.virt.hardware [None req-5a85328b-a936-42a8-a2a5-99c2459e3ee3 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Flavor limits 0:0:0 {{(pid=117762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 19:24:04.987051 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.virt.hardware [None req-5a85328b-a936-42a8-a2a5-99c2459e3ee3 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Image limits 0:0:0 {{(pid=117762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 19:24:04.988056 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.virt.hardware [None req-5a85328b-a936-42a8-a2a5-99c2459e3ee3 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Flavor pref 0:0:0 {{(pid=117762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 19:24:04.988637 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.virt.hardware [None req-5a85328b-a936-42a8-a2a5-99c2459e3ee3 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Image pref 0:0:0 {{(pid=117762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 19:24:04.989210 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.virt.hardware [None req-5a85328b-a936-42a8-a2a5-99c2459e3ee3 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 19:24:05.005143 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-5a85328b-a936-42a8-a2a5-99c2459e3ee3 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:05.008290 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-5a85328b-a936-42a8-a2a5-99c2459e3ee3 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:05.009778 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-5a85328b-a936-42a8-a2a5-99c2459e3ee3 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:05.011019 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-5a85328b-a936-42a8-a2a5-99c2459e3ee3 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:05.058742 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.quota [None req-5a85328b-a936-42a8-a2a5-99c2459e3ee3 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Getting quotas for project d0ab510f529d4442bd0e379056c4c3e5. Resources: {'cores', 'ram', 'instances'} {{(pid=117762) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:24:05.069818 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.quota [None req-5a85328b-a936-42a8-a2a5-99c2459e3ee3 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Getting quotas for user 4d08da0ef69e4cf2abc6c18bbbc51a2f and project d0ab510f529d4442bd0e379056c4c3e5. Resources: {'cores', 'ram', 'instances'} {{(pid=117762) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:24:05.102542 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-5a85328b-a936-42a8-a2a5-99c2459e3ee3 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Going to run 1 instances... {{(pid=117762) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 19:24:05.108436 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-5a85328b-a936-42a8-a2a5-99c2459e3ee3 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='59575804-e013-4dec-af24-b6c2dbbce73a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117762) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 19:24:05.273181 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-5a85328b-a936-42a8-a2a5-99c2459e3ee3 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.749343 Jul 20 19:24:05.275116 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 26/51] 10.222.0.69 () {60 vars in 1146 bytes} [Wed Jul 20 19:24:01 2022] POST /compute/v2.1/servers => generated 402 bytes in 3754 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 19:24:05.291186 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-ab564cba-b2cf-436e-9df4-5f192416c400 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:05.295236 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-ab564cba-b2cf-436e-9df4-5f192416c400 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:05.349186 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-ab564cba-b2cf-436e-9df4-5f192416c400 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:05.350548 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-ab564cba-b2cf-436e-9df4-5f192416c400 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:05.352182 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-ab564cba-b2cf-436e-9df4-5f192416c400 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:05.352879 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-ab564cba-b2cf-436e-9df4-5f192416c400 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:05.451117 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-eaf077b3-6211-42bc-85c7-395089391858 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb901faa8e9410484f83e47e5bcfa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e0691b14804cc5b4fe120fc5dea871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:05.465768 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-eaf077b3-6211-42bc-85c7-395089391858 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] 10.222.0.69 "GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c" status: 200 len: 1315 microversion: 2.1 time: 2.336934 Jul 20 19:24:05.473247 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 26/52] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:03 2022] GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c => generated 1315 bytes in 2345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:05.479766 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-bbcaa95b-1e05-49ef-a2e2-1a5244663179 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:05.480574 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-bbcaa95b-1e05-49ef-a2e2-1a5244663179 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:05.528677 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bbcaa95b-1e05-49ef-a2e2-1a5244663179 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:05.529144 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bbcaa95b-1e05-49ef-a2e2-1a5244663179 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:05.538554 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bbcaa95b-1e05-49ef-a2e2-1a5244663179 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:05.542766 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bbcaa95b-1e05-49ef-a2e2-1a5244663179 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:06.307072 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-bbcaa95b-1e05-49ef-a2e2-1a5244663179 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:06.347006 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-bbcaa95b-1e05-49ef-a2e2-1a5244663179 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:06.352502 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-bbcaa95b-1e05-49ef-a2e2-1a5244663179 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:06.358192 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-bbcaa95b-1e05-49ef-a2e2-1a5244663179 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1338 microversion: 2.20 time: 0.881844 Jul 20 19:24:06.361120 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 27/53] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:24:05 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1338 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:24:06.379907 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e6d78b6f-deb5-4802-b248-ce4dd2c890b3 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:06.382173 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e6d78b6f-deb5-4802-b248-ce4dd2c890b3 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:06.718257 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e6d78b6f-deb5-4802-b248-ce4dd2c890b3 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:06.736450 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e6d78b6f-deb5-4802-b248-ce4dd2c890b3 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a" status: 200 len: 1238 microversion: 2.1 time: 0.371539 Jul 20 19:24:06.737049 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 28/54] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:06 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a => generated 1238 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:06.780034 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e9c45de9-0162-468f-8844-d293b98fdd65 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:06.781201 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e9c45de9-0162-468f-8844-d293b98fdd65 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] [instance: 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:06.823048 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e9c45de9-0162-468f-8844-d293b98fdd65 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:06.823618 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e9c45de9-0162-468f-8844-d293b98fdd65 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:06.826467 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e9c45de9-0162-468f-8844-d293b98fdd65 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:06.828105 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e9c45de9-0162-468f-8844-d293b98fdd65 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:07.291474 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-ab564cba-b2cf-436e-9df4-5f192416c400 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:07.305668 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-ab564cba-b2cf-436e-9df4-5f192416c400 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1281 microversion: 2.1 time: 2.020682 Jul 20 19:24:07.328401 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 27/55] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:05 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1281 bytes in 2045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:07.399095 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-733be539-b0e3-4d0e-a8ab-6fb7c989674e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:07.399095 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-733be539-b0e3-4d0e-a8ab-6fb7c989674e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:07.452228 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-733be539-b0e3-4d0e-a8ab-6fb7c989674e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:07.454564 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-733be539-b0e3-4d0e-a8ab-6fb7c989674e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:07.465055 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-733be539-b0e3-4d0e-a8ab-6fb7c989674e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:07.469755 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-733be539-b0e3-4d0e-a8ab-6fb7c989674e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:08.113880 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e9c45de9-0162-468f-8844-d293b98fdd65 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb901faa8e9410484f83e47e5bcfa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e0691b14804cc5b4fe120fc5dea871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:08.130783 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e9c45de9-0162-468f-8844-d293b98fdd65 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] 10.222.0.69 "GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c" status: 200 len: 1315 microversion: 2.1 time: 1.372333 Jul 20 19:24:08.136534 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 29/56] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:06 2022] GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c => generated 1315 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:08.172339 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-7acc90e0-43a8-4515-83f9-5e0253bb379f tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:08.176778 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-7acc90e0-43a8-4515-83f9-5e0253bb379f tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:08.206181 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7acc90e0-43a8-4515-83f9-5e0253bb379f tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:08.209671 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7acc90e0-43a8-4515-83f9-5e0253bb379f tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:08.220639 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7acc90e0-43a8-4515-83f9-5e0253bb379f tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:08.223699 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7acc90e0-43a8-4515-83f9-5e0253bb379f tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:08.419370 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-7acc90e0-43a8-4515-83f9-5e0253bb379f tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:08.432279 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-7acc90e0-43a8-4515-83f9-5e0253bb379f tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a" status: 200 len: 1296 microversion: 2.1 time: 0.293490 Jul 20 19:24:08.434753 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 30/57] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:08 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a => generated 1296 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:08.446750 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4c5165fc-2438-4d62-ae5a-09a3446ba300 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:08.449758 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-4c5165fc-2438-4d62-ae5a-09a3446ba300 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:08.463974 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4c5165fc-2438-4d62-ae5a-09a3446ba300 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:08.466022 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4c5165fc-2438-4d62-ae5a-09a3446ba300 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:08.468869 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4c5165fc-2438-4d62-ae5a-09a3446ba300 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:08.470545 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4c5165fc-2438-4d62-ae5a-09a3446ba300 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:08.486436 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-733be539-b0e3-4d0e-a8ab-6fb7c989674e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:08.501168 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-733be539-b0e3-4d0e-a8ab-6fb7c989674e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:08.502754 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-733be539-b0e3-4d0e-a8ab-6fb7c989674e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:08.503879 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-733be539-b0e3-4d0e-a8ab-6fb7c989674e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1338 microversion: 2.20 time: 1.127919 Jul 20 19:24:08.524335 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 28/58] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:24:07 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1338 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:24:08.620249 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-4c5165fc-2438-4d62-ae5a-09a3446ba300 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:08.630714 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-4c5165fc-2438-4d62-ae5a-09a3446ba300 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1279 microversion: 2.1 time: 0.194087 Jul 20 19:24:08.634289 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 31/59] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:08 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1279 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:09.022710 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [req-fae4e7c3-d9f6-43a9-98eb-54a2c4f4a4b1 req-2d3727e5-7f9d-4b2d-9929-91d33508a3c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "053acc99-052e-4247-a54a-2799958f10e6", "tag": "4d19ea60-bcb5-4893-ad87-553405e3a20a"}]} {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:24:09.068025 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [req-fae4e7c3-d9f6-43a9-98eb-54a2c4f4a4b1 req-2d3727e5-7f9d-4b2d-9929-91d33508a3c7 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:09.071020 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [req-fae4e7c3-d9f6-43a9-98eb-54a2c4f4a4b1 req-2d3727e5-7f9d-4b2d-9929-91d33508a3c7 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:09.153637 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-fdd5ca13-3782-448f-a73f-57e205daac19 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:09.154284 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-fdd5ca13-3782-448f-a73f-57e205daac19 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] [instance: 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:09.167740 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fdd5ca13-3782-448f-a73f-57e205daac19 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:09.169938 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fdd5ca13-3782-448f-a73f-57e205daac19 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:09.172510 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fdd5ca13-3782-448f-a73f-57e205daac19 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:09.173189 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fdd5ca13-3782-448f-a73f-57e205daac19 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:09.176051 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.compute.server_external_events [req-fae4e7c3-d9f6-43a9-98eb-54a2c4f4a4b1 req-2d3727e5-7f9d-4b2d-9929-91d33508a3c7 service nova] Creating event network-changed:4d19ea60-bcb5-4893-ad87-553405e3a20a for instance 053acc99-052e-4247-a54a-2799958f10e6 on hv-cinder-83538 Jul 20 19:24:09.180217 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [req-fae4e7c3-d9f6-43a9-98eb-54a2c4f4a4b1 req-2d3727e5-7f9d-4b2d-9929-91d33508a3c7 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117762) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 19:24:09.184817 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f4b3e685-9714-4b69-b386-e39cdad44340 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:09.185453 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f4b3e685-9714-4b69-b386-e39cdad44340 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:09.192339 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f4b3e685-9714-4b69-b386-e39cdad44340 None None] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:09.194210 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f4b3e685-9714-4b69-b386-e39cdad44340 None None] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:09.223298 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.compute.rpcapi [None req-f4b3e685-9714-4b69-b386-e39cdad44340 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 20 19:24:09.232923 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f4b3e685-9714-4b69-b386-e39cdad44340 None None] Releasing lock "compute-rpcapi-router" {{(pid=117762) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 19:24:09.269445 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-f4b3e685-9714-4b69-b386-e39cdad44340 None None] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.733938 Jul 20 19:24:09.270687 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 29/60] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 19:24:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:24:09.453127 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-af21a2ba-eb16-4e0a-a552-09319d3f7870 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:09.455046 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-af21a2ba-eb16-4e0a-a552-09319d3f7870 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:09.479477 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-af21a2ba-eb16-4e0a-a552-09319d3f7870 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:09.481497 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-af21a2ba-eb16-4e0a-a552-09319d3f7870 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:09.483908 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-af21a2ba-eb16-4e0a-a552-09319d3f7870 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:09.486627 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-af21a2ba-eb16-4e0a-a552-09319d3f7870 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:09.691261 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-fdd5ca13-3782-448f-a73f-57e205daac19 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb901faa8e9410484f83e47e5bcfa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e0691b14804cc5b4fe120fc5dea871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:09.703148 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-fdd5ca13-3782-448f-a73f-57e205daac19 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] 10.222.0.69 "GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c" status: 200 len: 1315 microversion: 2.1 time: 0.555372 Jul 20 19:24:09.717590 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 32/61] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:09 2022] GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c => generated 1315 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:24:09.719409 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-af21a2ba-eb16-4e0a-a552-09319d3f7870 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:09.729550 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-af21a2ba-eb16-4e0a-a552-09319d3f7870 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a" status: 200 len: 1296 microversion: 2.1 time: 0.282335 Jul 20 19:24:09.730244 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 30/62] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:09 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a => generated 1296 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:09.731229 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-5b7efd42-f550-490a-802f-90e64018c789 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:09.732739 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-5b7efd42-f550-490a-802f-90e64018c789 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:09.755030 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5b7efd42-f550-490a-802f-90e64018c789 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:09.755801 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5b7efd42-f550-490a-802f-90e64018c789 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:09.756188 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-f1fc13ca-f93e-4529-b470-76a4b5b80450 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:09.759683 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5b7efd42-f550-490a-802f-90e64018c789 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:09.760245 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5b7efd42-f550-490a-802f-90e64018c789 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:09.760361 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-f1fc13ca-f93e-4529-b470-76a4b5b80450 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:09.775049 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f1fc13ca-f93e-4529-b470-76a4b5b80450 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:09.775522 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f1fc13ca-f93e-4529-b470-76a4b5b80450 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:09.778248 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f1fc13ca-f93e-4529-b470-76a4b5b80450 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:09.780025 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f1fc13ca-f93e-4529-b470-76a4b5b80450 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:10.177771 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-5b7efd42-f550-490a-802f-90e64018c789 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:10.194325 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-5b7efd42-f550-490a-802f-90e64018c789 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:10.201185 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-5b7efd42-f550-490a-802f-90e64018c789 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:10.203594 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-5b7efd42-f550-490a-802f-90e64018c789 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1405 microversion: 2.20 time: 0.483050 Jul 20 19:24:10.204183 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 33/63] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:24:09 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1405 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:24:10.239818 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-f1fc13ca-f93e-4529-b470-76a4b5b80450 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:10.252476 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-f1fc13ca-f93e-4529-b470-76a4b5b80450 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1321 microversion: 2.1 time: 0.505430 Jul 20 19:24:10.255151 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 31/64] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:09 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1321 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:10.727003 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-f4796908-52f6-4917-91d6-fc108f757d31 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:10.728707 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-f4796908-52f6-4917-91d6-fc108f757d31 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] [instance: 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:10.737251 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f4796908-52f6-4917-91d6-fc108f757d31 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:10.738086 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f4796908-52f6-4917-91d6-fc108f757d31 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:10.738863 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f4796908-52f6-4917-91d6-fc108f757d31 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:10.739472 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f4796908-52f6-4917-91d6-fc108f757d31 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:10.750391 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-48e91904-5a71-439f-b87b-02b8333005c0 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:10.750989 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-48e91904-5a71-439f-b87b-02b8333005c0 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:10.770566 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-48e91904-5a71-439f-b87b-02b8333005c0 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:10.771458 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-48e91904-5a71-439f-b87b-02b8333005c0 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:10.772641 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-48e91904-5a71-439f-b87b-02b8333005c0 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:10.773392 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-48e91904-5a71-439f-b87b-02b8333005c0 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:10.956198 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-48e91904-5a71-439f-b87b-02b8333005c0 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:10.966979 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-48e91904-5a71-439f-b87b-02b8333005c0 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a" status: 200 len: 1364 microversion: 2.1 time: 0.221949 Jul 20 19:24:10.968883 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 32/65] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:10 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a => generated 1364 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:24:10.994630 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-f4796908-52f6-4917-91d6-fc108f757d31 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb901faa8e9410484f83e47e5bcfa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e0691b14804cc5b4fe120fc5dea871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:11.005106 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-f4796908-52f6-4917-91d6-fc108f757d31 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] 10.222.0.69 "GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c" status: 200 len: 1315 microversion: 2.1 time: 0.284527 Jul 20 19:24:11.006505 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 34/66] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:10 2022] GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c => generated 1315 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:11.230181 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-b16486d7-31bd-4593-a604-2c809e082a02 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:11.230181 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-b16486d7-31bd-4593-a604-2c809e082a02 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:11.235621 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b16486d7-31bd-4593-a604-2c809e082a02 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:11.238673 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b16486d7-31bd-4593-a604-2c809e082a02 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:11.239592 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b16486d7-31bd-4593-a604-2c809e082a02 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:11.242076 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b16486d7-31bd-4593-a604-2c809e082a02 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:11.273234 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-171fac64-224e-4ad4-a2ba-d22b77e9a28a tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:11.275046 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-171fac64-224e-4ad4-a2ba-d22b77e9a28a tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:11.287622 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-171fac64-224e-4ad4-a2ba-d22b77e9a28a tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:11.289492 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-171fac64-224e-4ad4-a2ba-d22b77e9a28a tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:11.291705 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-171fac64-224e-4ad4-a2ba-d22b77e9a28a tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:11.292921 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-171fac64-224e-4ad4-a2ba-d22b77e9a28a tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:11.774260 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-b16486d7-31bd-4593-a604-2c809e082a02 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:11.793253 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-b16486d7-31bd-4593-a604-2c809e082a02 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:11.795223 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-b16486d7-31bd-4593-a604-2c809e082a02 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:11.797135 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-b16486d7-31bd-4593-a604-2c809e082a02 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1405 microversion: 2.20 time: 0.578776 Jul 20 19:24:11.805290 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-171fac64-224e-4ad4-a2ba-d22b77e9a28a tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:11.809814 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 33/67] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:24:11 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1405 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:24:11.817108 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-171fac64-224e-4ad4-a2ba-d22b77e9a28a tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1321 microversion: 2.1 time: 0.549429 Jul 20 19:24:11.830093 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 35/68] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:11 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1321 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:24:11.984310 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-2462d69a-0e9c-42bd-bfe1-82ff735ec0a2 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:11.984819 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-2462d69a-0e9c-42bd-bfe1-82ff735ec0a2 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:11.998867 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2462d69a-0e9c-42bd-bfe1-82ff735ec0a2 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:11.999315 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2462d69a-0e9c-42bd-bfe1-82ff735ec0a2 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:12.000094 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2462d69a-0e9c-42bd-bfe1-82ff735ec0a2 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:12.000529 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2462d69a-0e9c-42bd-bfe1-82ff735ec0a2 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:12.025209 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-dc73f873-fe52-486e-8a74-16ea1a9ed734 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:12.026686 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-dc73f873-fe52-486e-8a74-16ea1a9ed734 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] [instance: 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:12.038558 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-dc73f873-fe52-486e-8a74-16ea1a9ed734 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:12.039550 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-dc73f873-fe52-486e-8a74-16ea1a9ed734 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:12.040952 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-dc73f873-fe52-486e-8a74-16ea1a9ed734 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:12.042527 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-dc73f873-fe52-486e-8a74-16ea1a9ed734 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:12.376698 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-dc73f873-fe52-486e-8a74-16ea1a9ed734 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb901faa8e9410484f83e47e5bcfa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e0691b14804cc5b4fe120fc5dea871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:12.379825 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=81 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:12.393002 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-dc73f873-fe52-486e-8a74-16ea1a9ed734 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] 10.222.0.69 "GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c" status: 200 len: 1315 microversion: 2.1 time: 0.373657 Jul 20 19:24:12.396752 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 36/69] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:12 2022] GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c => generated 1315 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:12.408772 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [req-ffa594f3-763a-4e67-9f80-a79ea673d41e req-256c1114-e9e1-4f41-bc64-544716207850 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c33037ed-7b36-43aa-85ad-e48920801b0a", "tag": "d530fbe6-76ab-41fc-9fa3-b088835bc0da"}]} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:24:12.429833 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=10 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:12.436129 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-ffa594f3-763a-4e67-9f80-a79ea673d41e req-256c1114-e9e1-4f41-bc64-544716207850 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:12.437814 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-ffa594f3-763a-4e67-9f80-a79ea673d41e req-256c1114-e9e1-4f41-bc64-544716207850 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:12.477215 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.compute.server_external_events [req-ffa594f3-763a-4e67-9f80-a79ea673d41e req-256c1114-e9e1-4f41-bc64-544716207850 service nova] Creating event network-changed:d530fbe6-76ab-41fc-9fa3-b088835bc0da for instance c33037ed-7b36-43aa-85ad-e48920801b0a on hv-cinder-83538 Jul 20 19:24:12.489050 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [req-ffa594f3-763a-4e67-9f80-a79ea673d41e req-256c1114-e9e1-4f41-bc64-544716207850 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082794 Jul 20 19:24:12.489890 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 37/70] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 19:24:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:24:12.827353 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-49d6efe9-ed6d-4734-b39a-ab9c9dd6723b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:12.827891 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-49d6efe9-ed6d-4734-b39a-ab9c9dd6723b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:12.835155 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-49d6efe9-ed6d-4734-b39a-ab9c9dd6723b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:12.835435 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-49d6efe9-ed6d-4734-b39a-ab9c9dd6723b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:12.836470 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-49d6efe9-ed6d-4734-b39a-ab9c9dd6723b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:12.837066 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-49d6efe9-ed6d-4734-b39a-ab9c9dd6723b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:12.838277 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-2462d69a-0e9c-42bd-bfe1-82ff735ec0a2 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:12.846382 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_cell1:SELECT=79 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:12.852873 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-2462d69a-0e9c-42bd-bfe1-82ff735ec0a2 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a" status: 200 len: 1364 microversion: 2.1 time: 0.872322 Jul 20 19:24:12.862351 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 34/71] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:11 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a => generated 1364 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:12.883874 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-968880f1-806b-4b7c-85f7-43c7115536af tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:12.885434 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-968880f1-806b-4b7c-85f7-43c7115536af tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:12.889250 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=7 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:12.904218 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-968880f1-806b-4b7c-85f7-43c7115536af tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:12.907089 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-968880f1-806b-4b7c-85f7-43c7115536af tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:12.908063 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-968880f1-806b-4b7c-85f7-43c7115536af tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:12.909531 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-968880f1-806b-4b7c-85f7-43c7115536af tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:13.036506 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell0:SELECT=8 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:13.134411 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-49d6efe9-ed6d-4734-b39a-ab9c9dd6723b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:13.149337 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-49d6efe9-ed6d-4734-b39a-ab9c9dd6723b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:13.150912 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-49d6efe9-ed6d-4734-b39a-ab9c9dd6723b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:13.162433 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-49d6efe9-ed6d-4734-b39a-ab9c9dd6723b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1405 microversion: 2.20 time: 0.339410 Jul 20 19:24:13.163579 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 38/72] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:24:12 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1405 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:24:13.413281 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-8a100c94-e759-4dae-bb2e-2a6e09e62ed7 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:13.414071 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-8a100c94-e759-4dae-bb2e-2a6e09e62ed7 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] [instance: 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:13.428806 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8a100c94-e759-4dae-bb2e-2a6e09e62ed7 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:13.430931 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8a100c94-e759-4dae-bb2e-2a6e09e62ed7 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:13.434132 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8a100c94-e759-4dae-bb2e-2a6e09e62ed7 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:13.435006 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8a100c94-e759-4dae-bb2e-2a6e09e62ed7 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:13.529065 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-968880f1-806b-4b7c-85f7-43c7115536af tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:13.535788 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-968880f1-806b-4b7c-85f7-43c7115536af tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1321 microversion: 2.1 time: 0.671258 Jul 20 19:24:13.536286 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 35/73] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:12 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1321 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:13.552718 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [req-d36a883c-43a9-46f1-871e-91aba6484a79 req-e9823342-eb61-43a2-8fa9-b91d5789505a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b2abd53-4758-462c-b36a-0d1bf0b66a55", "tag": "3232872d-df06-40e7-a7c3-7cc3babe684d"}]} {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:24:13.580941 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [req-d36a883c-43a9-46f1-871e-91aba6484a79 req-e9823342-eb61-43a2-8fa9-b91d5789505a service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:13.581387 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [req-d36a883c-43a9-46f1-871e-91aba6484a79 req-e9823342-eb61-43a2-8fa9-b91d5789505a service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:13.608501 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.compute.server_external_events [req-d36a883c-43a9-46f1-871e-91aba6484a79 req-e9823342-eb61-43a2-8fa9-b91d5789505a service nova] Creating event network-changed:3232872d-df06-40e7-a7c3-7cc3babe684d for instance 3b2abd53-4758-462c-b36a-0d1bf0b66a55 on hv-cinder-83538 Jul 20 19:24:13.616797 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [req-d36a883c-43a9-46f1-871e-91aba6484a79 req-e9823342-eb61-43a2-8fa9-b91d5789505a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067791 Jul 20 19:24:13.617792 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 36/74] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 19:24:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:24:13.873687 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-7a0bb9b6-252d-42b1-a02f-6966f7a2bea5 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:13.874380 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-7a0bb9b6-252d-42b1-a02f-6966f7a2bea5 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:13.891819 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-7a0bb9b6-252d-42b1-a02f-6966f7a2bea5 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:13.892369 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-7a0bb9b6-252d-42b1-a02f-6966f7a2bea5 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:13.894852 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-7a0bb9b6-252d-42b1-a02f-6966f7a2bea5 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:13.896182 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-7a0bb9b6-252d-42b1-a02f-6966f7a2bea5 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:13.910564 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8a100c94-e759-4dae-bb2e-2a6e09e62ed7 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb901faa8e9410484f83e47e5bcfa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e0691b14804cc5b4fe120fc5dea871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:13.926426 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-8a100c94-e759-4dae-bb2e-2a6e09e62ed7 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] 10.222.0.69 "GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c" status: 200 len: 1315 microversion: 2.1 time: 0.517833 Jul 20 19:24:13.930879 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 39/75] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:13 2022] GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c => generated 1315 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:14.107916 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-7a0bb9b6-252d-42b1-a02f-6966f7a2bea5 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:14.117300 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-7a0bb9b6-252d-42b1-a02f-6966f7a2bea5 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a" status: 200 len: 1364 microversion: 2.1 time: 0.248033 Jul 20 19:24:14.118352 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 37/76] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:13 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a => generated 1364 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:24:14.182188 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-5d06dce8-d47c-4ade-ba3d-094cc51dcbf1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:14.182796 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-5d06dce8-d47c-4ade-ba3d-094cc51dcbf1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:14.189388 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5d06dce8-d47c-4ade-ba3d-094cc51dcbf1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:14.189874 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5d06dce8-d47c-4ade-ba3d-094cc51dcbf1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:14.190642 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5d06dce8-d47c-4ade-ba3d-094cc51dcbf1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:14.191204 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5d06dce8-d47c-4ade-ba3d-094cc51dcbf1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:14.339061 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-5d06dce8-d47c-4ade-ba3d-094cc51dcbf1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:14.347486 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-5d06dce8-d47c-4ade-ba3d-094cc51dcbf1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:14.349251 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-5d06dce8-d47c-4ade-ba3d-094cc51dcbf1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:14.350619 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-5d06dce8-d47c-4ade-ba3d-094cc51dcbf1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1405 microversion: 2.20 time: 0.172438 Jul 20 19:24:14.351443 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 40/77] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:24:14 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1405 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:24:14.561574 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-b7ea3f9b-ab84-4b0d-9221-5d6fc51edafd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:14.563359 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-b7ea3f9b-ab84-4b0d-9221-5d6fc51edafd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:14.575192 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b7ea3f9b-ab84-4b0d-9221-5d6fc51edafd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:14.576012 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b7ea3f9b-ab84-4b0d-9221-5d6fc51edafd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:14.577336 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b7ea3f9b-ab84-4b0d-9221-5d6fc51edafd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:14.578140 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b7ea3f9b-ab84-4b0d-9221-5d6fc51edafd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:14.828393 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-b7ea3f9b-ab84-4b0d-9221-5d6fc51edafd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:14.842057 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-b7ea3f9b-ab84-4b0d-9221-5d6fc51edafd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1321 microversion: 2.1 time: 0.289314 Jul 20 19:24:14.842937 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 38/78] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:14 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1321 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:14.946924 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-1d547541-37e5-4f05-b253-6c4e0ccafe32 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:14.947531 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-1d547541-37e5-4f05-b253-6c4e0ccafe32 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] [instance: 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:14.958928 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1d547541-37e5-4f05-b253-6c4e0ccafe32 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:14.960158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1d547541-37e5-4f05-b253-6c4e0ccafe32 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:14.962788 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1d547541-37e5-4f05-b253-6c4e0ccafe32 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:14.965309 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1d547541-37e5-4f05-b253-6c4e0ccafe32 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:15.137474 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-2b88cc3c-237f-43db-a5fe-7fa74be66837 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:15.139735 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-2b88cc3c-237f-43db-a5fe-7fa74be66837 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:15.141934 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_cell0:SELECT=22 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:15.149002 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2b88cc3c-237f-43db-a5fe-7fa74be66837 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:15.149856 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2b88cc3c-237f-43db-a5fe-7fa74be66837 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:15.151166 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2b88cc3c-237f-43db-a5fe-7fa74be66837 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:15.151823 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2b88cc3c-237f-43db-a5fe-7fa74be66837 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:15.318224 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1d547541-37e5-4f05-b253-6c4e0ccafe32 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb901faa8e9410484f83e47e5bcfa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e0691b14804cc5b4fe120fc5dea871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:15.331915 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-1d547541-37e5-4f05-b253-6c4e0ccafe32 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] 10.222.0.69 "GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c" status: 200 len: 1315 microversion: 2.1 time: 0.389265 Jul 20 19:24:15.348023 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 41/79] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:14 2022] GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c => generated 1315 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:15.370713 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d8c3f652-9651-4b1a-b441-9a87e793c9ee tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:15.372255 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d8c3f652-9651-4b1a-b441-9a87e793c9ee tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:15.387467 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d8c3f652-9651-4b1a-b441-9a87e793c9ee tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:15.389600 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d8c3f652-9651-4b1a-b441-9a87e793c9ee tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:15.391033 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d8c3f652-9651-4b1a-b441-9a87e793c9ee tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:15.394735 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d8c3f652-9651-4b1a-b441-9a87e793c9ee tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:15.511470 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-2b88cc3c-237f-43db-a5fe-7fa74be66837 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:15.526353 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-2b88cc3c-237f-43db-a5fe-7fa74be66837 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a" status: 200 len: 1364 microversion: 2.1 time: 0.394940 Jul 20 19:24:15.532598 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 39/80] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:15 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a => generated 1364 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:15.634705 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d8c3f652-9651-4b1a-b441-9a87e793c9ee tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:15.644432 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d8c3f652-9651-4b1a-b441-9a87e793c9ee tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:15.646534 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d8c3f652-9651-4b1a-b441-9a87e793c9ee tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:15.648902 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d8c3f652-9651-4b1a-b441-9a87e793c9ee tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1405 microversion: 2.20 time: 0.283810 Jul 20 19:24:15.660146 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 42/81] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:24:15 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1405 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:24:15.665486 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [req-61bcc7b5-d43f-4cf9-9bf2-11d29f762aa1 req-fe24f0f4-e23e-4a46-b96a-ec33f5d392ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "689a26d3-0640-4e71-acf6-10bda1f0f4fc", "tag": "64f9d89f-7304-4e79-86e7-8900cf5f72fc"}]} {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:24:15.679319 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [req-61bcc7b5-d43f-4cf9-9bf2-11d29f762aa1 req-fe24f0f4-e23e-4a46-b96a-ec33f5d392ea service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:15.679773 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [req-61bcc7b5-d43f-4cf9-9bf2-11d29f762aa1 req-fe24f0f4-e23e-4a46-b96a-ec33f5d392ea service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:15.691787 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.compute.server_external_events [req-61bcc7b5-d43f-4cf9-9bf2-11d29f762aa1 req-fe24f0f4-e23e-4a46-b96a-ec33f5d392ea service nova] Creating event network-changed:64f9d89f-7304-4e79-86e7-8900cf5f72fc for instance 689a26d3-0640-4e71-acf6-10bda1f0f4fc on hv-cinder-83538 Jul 20 19:24:15.697012 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [req-61bcc7b5-d43f-4cf9-9bf2-11d29f762aa1 req-fe24f0f4-e23e-4a46-b96a-ec33f5d392ea service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044039 Jul 20 19:24:15.697864 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 40/82] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 19:24:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:24:15.860797 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-7c35c0ce-d78e-4cf2-82d1-20fd085394fc tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:15.861953 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-7c35c0ce-d78e-4cf2-82d1-20fd085394fc tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:15.870220 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7c35c0ce-d78e-4cf2-82d1-20fd085394fc tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:15.871172 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7c35c0ce-d78e-4cf2-82d1-20fd085394fc tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:15.872733 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7c35c0ce-d78e-4cf2-82d1-20fd085394fc tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:15.873397 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7c35c0ce-d78e-4cf2-82d1-20fd085394fc tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:16.114819 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-7c35c0ce-d78e-4cf2-82d1-20fd085394fc tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:16.131942 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-7c35c0ce-d78e-4cf2-82d1-20fd085394fc tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1321 microversion: 2.1 time: 0.275339 Jul 20 19:24:16.137486 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 43/83] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:15 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1321 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:24:16.370152 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-1505ffb9-f7ba-4fd4-818c-fc070d43fd05 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:16.371728 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-1505ffb9-f7ba-4fd4-818c-fc070d43fd05 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] [instance: 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:16.397538 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1505ffb9-f7ba-4fd4-818c-fc070d43fd05 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:16.398309 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1505ffb9-f7ba-4fd4-818c-fc070d43fd05 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:16.401166 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1505ffb9-f7ba-4fd4-818c-fc070d43fd05 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:16.403357 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1505ffb9-f7ba-4fd4-818c-fc070d43fd05 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:16.553555 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-899c0080-74d0-4e9e-a567-20779f9ae9e7 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:16.557024 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-899c0080-74d0-4e9e-a567-20779f9ae9e7 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:16.584216 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-899c0080-74d0-4e9e-a567-20779f9ae9e7 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:16.585469 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-899c0080-74d0-4e9e-a567-20779f9ae9e7 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:16.586721 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-899c0080-74d0-4e9e-a567-20779f9ae9e7 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:16.589909 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-899c0080-74d0-4e9e-a567-20779f9ae9e7 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:16.735296 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell0:SELECT=26 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:16.750876 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-1505ffb9-f7ba-4fd4-818c-fc070d43fd05 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb901faa8e9410484f83e47e5bcfa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e0691b14804cc5b4fe120fc5dea871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:16.762742 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-1505ffb9-f7ba-4fd4-818c-fc070d43fd05 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] 10.222.0.69 "GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c" status: 200 len: 1315 microversion: 2.1 time: 0.409129 Jul 20 19:24:16.763512 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 41/84] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:16 2022] GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c => generated 1315 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:16.773190 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-053ee88a-9ec5-4413-936f-73a0fe0c6433 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:16.777862 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-053ee88a-9ec5-4413-936f-73a0fe0c6433 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:16.796235 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-053ee88a-9ec5-4413-936f-73a0fe0c6433 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:16.796235 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-053ee88a-9ec5-4413-936f-73a0fe0c6433 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:16.796235 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-053ee88a-9ec5-4413-936f-73a0fe0c6433 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:16.796999 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-053ee88a-9ec5-4413-936f-73a0fe0c6433 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:16.899233 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-899c0080-74d0-4e9e-a567-20779f9ae9e7 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:16.915288 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-899c0080-74d0-4e9e-a567-20779f9ae9e7 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a" status: 200 len: 1364 microversion: 2.1 time: 0.366690 Jul 20 19:24:16.935309 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 44/85] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:16 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a => generated 1364 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:17.082486 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-053ee88a-9ec5-4413-936f-73a0fe0c6433 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:17.098506 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-053ee88a-9ec5-4413-936f-73a0fe0c6433 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:17.101073 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-053ee88a-9ec5-4413-936f-73a0fe0c6433 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:17.104412 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-053ee88a-9ec5-4413-936f-73a0fe0c6433 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1405 microversion: 2.20 time: 0.336118 Jul 20 19:24:17.105559 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 42/86] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:24:16 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1405 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:24:17.156581 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-7619182f-4861-4be2-9294-a38f4c09fde8 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:17.160827 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-7619182f-4861-4be2-9294-a38f4c09fde8 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:17.183113 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7619182f-4861-4be2-9294-a38f4c09fde8 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:17.184544 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7619182f-4861-4be2-9294-a38f4c09fde8 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:17.185457 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7619182f-4861-4be2-9294-a38f4c09fde8 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:17.188185 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7619182f-4861-4be2-9294-a38f4c09fde8 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:17.347364 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-7619182f-4861-4be2-9294-a38f4c09fde8 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:17.356129 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-7619182f-4861-4be2-9294-a38f4c09fde8 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1321 microversion: 2.1 time: 0.206985 Jul 20 19:24:17.365804 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 45/87] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:17 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1321 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:17.789274 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-b4a63853-ca05-4ad8-9821-7ad871f8382d tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:17.790537 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-b4a63853-ca05-4ad8-9821-7ad871f8382d tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] [instance: 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:17.803599 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b4a63853-ca05-4ad8-9821-7ad871f8382d tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:17.804349 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b4a63853-ca05-4ad8-9821-7ad871f8382d tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:17.805143 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b4a63853-ca05-4ad8-9821-7ad871f8382d tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:17.805610 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b4a63853-ca05-4ad8-9821-7ad871f8382d tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:17.951581 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-3b3855f7-0455-4704-b1be-4c71d4c50e03 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:17.953577 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-3b3855f7-0455-4704-b1be-4c71d4c50e03 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:17.968052 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3b3855f7-0455-4704-b1be-4c71d4c50e03 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:17.968624 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3b3855f7-0455-4704-b1be-4c71d4c50e03 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:17.970210 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3b3855f7-0455-4704-b1be-4c71d4c50e03 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:17.970755 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3b3855f7-0455-4704-b1be-4c71d4c50e03 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:18.123830 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-b4a63853-ca05-4ad8-9821-7ad871f8382d tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb901faa8e9410484f83e47e5bcfa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e0691b14804cc5b4fe120fc5dea871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:18.138496 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-b4a63853-ca05-4ad8-9821-7ad871f8382d tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] 10.222.0.69 "GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c" status: 200 len: 1315 microversion: 2.1 time: 0.355437 Jul 20 19:24:18.144137 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 43/88] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:17 2022] GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c => generated 1315 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:18.169303 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-0a482b7d-b6dd-4a56-acac-84092ef26612 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:18.170497 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-0a482b7d-b6dd-4a56-acac-84092ef26612 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:18.196082 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-0a482b7d-b6dd-4a56-acac-84092ef26612 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:18.196848 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-0a482b7d-b6dd-4a56-acac-84092ef26612 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:18.197852 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-0a482b7d-b6dd-4a56-acac-84092ef26612 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:18.198436 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-0a482b7d-b6dd-4a56-acac-84092ef26612 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:18.264499 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3b3855f7-0455-4704-b1be-4c71d4c50e03 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:18.282930 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-3b3855f7-0455-4704-b1be-4c71d4c50e03 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a" status: 200 len: 1364 microversion: 2.1 time: 0.333620 Jul 20 19:24:18.287281 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 46/89] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:17 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a => generated 1364 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:18.374608 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-29d7f320-dcdb-432e-87bb-61d081111d11 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:18.375726 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-29d7f320-dcdb-432e-87bb-61d081111d11 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:18.387510 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-29d7f320-dcdb-432e-87bb-61d081111d11 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:18.390085 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-29d7f320-dcdb-432e-87bb-61d081111d11 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:18.391115 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-29d7f320-dcdb-432e-87bb-61d081111d11 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:18.393087 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-29d7f320-dcdb-432e-87bb-61d081111d11 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:19.020648 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-0a482b7d-b6dd-4a56-acac-84092ef26612 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:19.026953 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-29d7f320-dcdb-432e-87bb-61d081111d11 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:19.032639 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-0a482b7d-b6dd-4a56-acac-84092ef26612 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:19.034432 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-29d7f320-dcdb-432e-87bb-61d081111d11 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1321 microversion: 2.1 time: 0.665593 Jul 20 19:24:19.039598 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 47/90] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:18 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1321 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:19.040461 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-0a482b7d-b6dd-4a56-acac-84092ef26612 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:19.044403 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-0a482b7d-b6dd-4a56-acac-84092ef26612 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1405 microversion: 2.20 time: 0.899111 Jul 20 19:24:19.044975 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 44/91] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:24:18 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1405 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:24:19.156378 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-2385f93e-6579-4c52-82bb-e01ffda0d454 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:19.157680 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-2385f93e-6579-4c52-82bb-e01ffda0d454 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] [instance: 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:19.165582 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2385f93e-6579-4c52-82bb-e01ffda0d454 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:19.166389 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2385f93e-6579-4c52-82bb-e01ffda0d454 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:19.167407 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2385f93e-6579-4c52-82bb-e01ffda0d454 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:19.168054 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2385f93e-6579-4c52-82bb-e01ffda0d454 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:19.217651 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_cell0:SELECT=6 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:19.300509 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [req-9ea1e515-a7fc-4a9d-ad27-5a3691436aa3 req-40a46523-3ca3-4ee1-aa15-66be6a015599 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3579edbc-f4b6-4ba1-beb5-a095d7d9c21c", "name": "network-vif-plugged", "status": "completed", "tag": "ae517b12-2e27-423c-bb01-b994d91ccefb"}]} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:24:19.320443 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-9ea1e515-a7fc-4a9d-ad27-5a3691436aa3 req-40a46523-3ca3-4ee1-aa15-66be6a015599 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:19.320903 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-9ea1e515-a7fc-4a9d-ad27-5a3691436aa3 req-40a46523-3ca3-4ee1-aa15-66be6a015599 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:19.368122 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.compute.server_external_events [req-9ea1e515-a7fc-4a9d-ad27-5a3691436aa3 req-40a46523-3ca3-4ee1-aa15-66be6a015599 service nova] Creating event network-vif-plugged:ae517b12-2e27-423c-bb01-b994d91ccefb for instance 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c on hv-cinder-83538 Jul 20 19:24:19.378585 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [req-9ea1e515-a7fc-4a9d-ad27-5a3691436aa3 req-40a46523-3ca3-4ee1-aa15-66be6a015599 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.331980 Jul 20 19:24:19.380839 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 48/92] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 19:24:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:24:19.406291 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-bc39fa96-6603-46e0-9085-94ccf37b8740 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:19.406291 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-bc39fa96-6603-46e0-9085-94ccf37b8740 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:19.431068 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bc39fa96-6603-46e0-9085-94ccf37b8740 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:19.431696 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bc39fa96-6603-46e0-9085-94ccf37b8740 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:19.437465 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bc39fa96-6603-46e0-9085-94ccf37b8740 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:19.438952 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bc39fa96-6603-46e0-9085-94ccf37b8740 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:20.155666 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-2385f93e-6579-4c52-82bb-e01ffda0d454 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb901faa8e9410484f83e47e5bcfa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e0691b14804cc5b4fe120fc5dea871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:20.164592 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-2385f93e-6579-4c52-82bb-e01ffda0d454 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] 10.222.0.69 "GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c" status: 200 len: 1315 microversion: 2.1 time: 1.011898 Jul 20 19:24:20.165181 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 45/93] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:19 2022] GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c => generated 1315 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:24:20.185870 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-f638c03e-5380-4eaa-a292-7193263f59d9 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:20.186481 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-f638c03e-5380-4eaa-a292-7193263f59d9 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:20.210240 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f638c03e-5380-4eaa-a292-7193263f59d9 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:20.210693 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f638c03e-5380-4eaa-a292-7193263f59d9 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:20.211654 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f638c03e-5380-4eaa-a292-7193263f59d9 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:20.212093 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f638c03e-5380-4eaa-a292-7193263f59d9 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:20.395354 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-bc39fa96-6603-46e0-9085-94ccf37b8740 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:20.411327 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-bc39fa96-6603-46e0-9085-94ccf37b8740 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a" status: 200 len: 1364 microversion: 2.1 time: 1.028260 Jul 20 19:24:20.416235 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 49/94] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:19 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a => generated 1364 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:20.431745 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-35a847ff-0428-4aec-bb4e-90c457021cd7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:20.434767 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-35a847ff-0428-4aec-bb4e-90c457021cd7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:20.463796 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-35a847ff-0428-4aec-bb4e-90c457021cd7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:20.463796 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-35a847ff-0428-4aec-bb4e-90c457021cd7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:20.464823 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-35a847ff-0428-4aec-bb4e-90c457021cd7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:20.465302 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-35a847ff-0428-4aec-bb4e-90c457021cd7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:20.761825 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-f638c03e-5380-4eaa-a292-7193263f59d9 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:20.773450 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-f638c03e-5380-4eaa-a292-7193263f59d9 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1321 microversion: 2.1 time: 0.594648 Jul 20 19:24:20.777324 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 46/95] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:20 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1321 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:21.032914 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-35a847ff-0428-4aec-bb4e-90c457021cd7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:21.045064 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-35a847ff-0428-4aec-bb4e-90c457021cd7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:21.047508 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-35a847ff-0428-4aec-bb4e-90c457021cd7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:21.049002 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-35a847ff-0428-4aec-bb4e-90c457021cd7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1405 microversion: 2.20 time: 0.631710 Jul 20 19:24:21.058786 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 50/96] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:24:20 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1405 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:24:21.181235 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-790739bc-b52e-4dce-8472-46f6a7bf44e2 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:21.181880 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-790739bc-b52e-4dce-8472-46f6a7bf44e2 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] [instance: 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:21.190855 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-790739bc-b52e-4dce-8472-46f6a7bf44e2 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:21.191522 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-790739bc-b52e-4dce-8472-46f6a7bf44e2 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:21.201136 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-790739bc-b52e-4dce-8472-46f6a7bf44e2 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:21.201613 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-790739bc-b52e-4dce-8472-46f6a7bf44e2 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:21.434643 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-2fee2885-060d-4077-b02c-919b96aa3d83 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:21.435345 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-2fee2885-060d-4077-b02c-919b96aa3d83 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:21.447305 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-790739bc-b52e-4dce-8472-46f6a7bf44e2 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb901faa8e9410484f83e47e5bcfa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e0691b14804cc5b4fe120fc5dea871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:21.466698 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-790739bc-b52e-4dce-8472-46f6a7bf44e2 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] 10.222.0.69 "GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c" status: 200 len: 1315 microversion: 2.1 time: 0.289766 Jul 20 19:24:21.467562 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 47/97] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:21 2022] GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c => generated 1315 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:21.470335 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2fee2885-060d-4077-b02c-919b96aa3d83 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:21.474126 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2fee2885-060d-4077-b02c-919b96aa3d83 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:21.475942 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2fee2885-060d-4077-b02c-919b96aa3d83 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:21.477678 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2fee2885-060d-4077-b02c-919b96aa3d83 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:21.703070 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-2fee2885-060d-4077-b02c-919b96aa3d83 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:21.711672 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-2fee2885-060d-4077-b02c-919b96aa3d83 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a" status: 200 len: 1364 microversion: 2.1 time: 0.284163 Jul 20 19:24:21.712251 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 51/98] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:21 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a => generated 1364 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:24:21.794538 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-265e608c-51ca-445e-9d95-1fe8ae45eab8 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:21.795474 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-265e608c-51ca-445e-9d95-1fe8ae45eab8 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:21.801874 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-265e608c-51ca-445e-9d95-1fe8ae45eab8 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:21.802596 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-265e608c-51ca-445e-9d95-1fe8ae45eab8 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:21.804108 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-265e608c-51ca-445e-9d95-1fe8ae45eab8 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:21.804731 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-265e608c-51ca-445e-9d95-1fe8ae45eab8 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:21.975317 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-265e608c-51ca-445e-9d95-1fe8ae45eab8 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:21.984451 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-265e608c-51ca-445e-9d95-1fe8ae45eab8 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1321 microversion: 2.1 time: 0.194178 Jul 20 19:24:21.985402 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 48/99] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:21 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1321 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:22.068871 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-3867423d-a1dd-437c-b62d-f98debd57748 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:22.069702 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-3867423d-a1dd-437c-b62d-f98debd57748 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:22.076761 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3867423d-a1dd-437c-b62d-f98debd57748 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:22.077393 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3867423d-a1dd-437c-b62d-f98debd57748 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:22.078204 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3867423d-a1dd-437c-b62d-f98debd57748 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:22.078869 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3867423d-a1dd-437c-b62d-f98debd57748 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:22.295757 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3867423d-a1dd-437c-b62d-f98debd57748 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:22.309822 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3867423d-a1dd-437c-b62d-f98debd57748 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:22.313190 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3867423d-a1dd-437c-b62d-f98debd57748 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:22.327403 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-3867423d-a1dd-437c-b62d-f98debd57748 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1405 microversion: 2.20 time: 0.261695 Jul 20 19:24:22.340627 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 52/100] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:24:22 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1405 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:24:22.485594 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-a3701ff0-5ee7-4dd0-b119-0368631452da tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:22.488178 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-a3701ff0-5ee7-4dd0-b119-0368631452da tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] [instance: 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:22.498507 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a3701ff0-5ee7-4dd0-b119-0368631452da tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:22.504608 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a3701ff0-5ee7-4dd0-b119-0368631452da tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:22.505666 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a3701ff0-5ee7-4dd0-b119-0368631452da tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:22.506177 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a3701ff0-5ee7-4dd0-b119-0368631452da tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:22.544333 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [req-65c8b24f-8619-44ad-8e8f-bb0339a13695 req-58fbc13b-4e81-4553-a64e-c849ef807298 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "053acc99-052e-4247-a54a-2799958f10e6", "name": "network-vif-plugged", "status": "completed", "tag": "4d19ea60-bcb5-4893-ad87-553405e3a20a"}]} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:24:22.558749 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-65c8b24f-8619-44ad-8e8f-bb0339a13695 req-58fbc13b-4e81-4553-a64e-c849ef807298 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:22.559210 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-65c8b24f-8619-44ad-8e8f-bb0339a13695 req-58fbc13b-4e81-4553-a64e-c849ef807298 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:22.580362 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.compute.server_external_events [req-65c8b24f-8619-44ad-8e8f-bb0339a13695 req-58fbc13b-4e81-4553-a64e-c849ef807298 service nova] Creating event network-vif-plugged:4d19ea60-bcb5-4893-ad87-553405e3a20a for instance 053acc99-052e-4247-a54a-2799958f10e6 on hv-cinder-83538 Jul 20 19:24:22.587320 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [req-65c8b24f-8619-44ad-8e8f-bb0339a13695 req-58fbc13b-4e81-4553-a64e-c849ef807298 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046785 Jul 20 19:24:22.588601 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 53/101] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 19:24:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:24:22.731233 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d7b24bf0-b44f-4142-ba78-200263cc38d4 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:22.731953 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d7b24bf0-b44f-4142-ba78-200263cc38d4 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:22.739043 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d7b24bf0-b44f-4142-ba78-200263cc38d4 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:22.739498 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d7b24bf0-b44f-4142-ba78-200263cc38d4 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:22.740365 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d7b24bf0-b44f-4142-ba78-200263cc38d4 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:22.743743 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d7b24bf0-b44f-4142-ba78-200263cc38d4 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:22.749981 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-a3701ff0-5ee7-4dd0-b119-0368631452da tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb901faa8e9410484f83e47e5bcfa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e0691b14804cc5b4fe120fc5dea871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:22.760302 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-a3701ff0-5ee7-4dd0-b119-0368631452da tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] 10.222.0.69 "GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c" status: 200 len: 1315 microversion: 2.1 time: 0.279259 Jul 20 19:24:22.761735 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 49/102] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:22 2022] GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c => generated 1315 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:22.958586 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d7b24bf0-b44f-4142-ba78-200263cc38d4 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:22.971265 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d7b24bf0-b44f-4142-ba78-200263cc38d4 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a" status: 200 len: 1364 microversion: 2.1 time: 0.244189 Jul 20 19:24:22.972287 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 54/103] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:22 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a => generated 1364 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:24:23.010515 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-ac61df94-9dde-482e-99c8-b85ec76f96ce tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:23.011283 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-ac61df94-9dde-482e-99c8-b85ec76f96ce tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:23.017792 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-ac61df94-9dde-482e-99c8-b85ec76f96ce tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:23.018241 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-ac61df94-9dde-482e-99c8-b85ec76f96ce tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:23.018999 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-ac61df94-9dde-482e-99c8-b85ec76f96ce tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:23.019427 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-ac61df94-9dde-482e-99c8-b85ec76f96ce tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:23.167276 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-ac61df94-9dde-482e-99c8-b85ec76f96ce tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:23.175497 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-ac61df94-9dde-482e-99c8-b85ec76f96ce tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1321 microversion: 2.1 time: 0.175387 Jul 20 19:24:23.176234 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 50/104] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:22 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1321 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:23.353200 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-2587ce26-b6f9-4a9d-b7c8-82f64e9a919f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:23.355552 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-2587ce26-b6f9-4a9d-b7c8-82f64e9a919f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:23.368027 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2587ce26-b6f9-4a9d-b7c8-82f64e9a919f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:23.369569 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2587ce26-b6f9-4a9d-b7c8-82f64e9a919f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:23.370966 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2587ce26-b6f9-4a9d-b7c8-82f64e9a919f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:23.371609 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2587ce26-b6f9-4a9d-b7c8-82f64e9a919f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:23.394957 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:23.620863 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-2587ce26-b6f9-4a9d-b7c8-82f64e9a919f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:23.629987 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-2587ce26-b6f9-4a9d-b7c8-82f64e9a919f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:23.634032 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-2587ce26-b6f9-4a9d-b7c8-82f64e9a919f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:23.634032 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-2587ce26-b6f9-4a9d-b7c8-82f64e9a919f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1405 microversion: 2.20 time: 0.290368 Jul 20 19:24:23.635100 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 55/105] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:24:23 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1405 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:24:23.779071 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-52638140-f49c-4c75-80f4-2b3a5a207ce8 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:23.779687 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-52638140-f49c-4c75-80f4-2b3a5a207ce8 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] [instance: 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:23.791399 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-52638140-f49c-4c75-80f4-2b3a5a207ce8 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:23.791918 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-52638140-f49c-4c75-80f4-2b3a5a207ce8 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:23.792744 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-52638140-f49c-4c75-80f4-2b3a5a207ce8 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:23.793182 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-52638140-f49c-4c75-80f4-2b3a5a207ce8 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:23.989974 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-30d50cd1-4451-4ade-bbfc-4dc0269d12fc tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:23.991503 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-30d50cd1-4451-4ade-bbfc-4dc0269d12fc tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:23.997887 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-30d50cd1-4451-4ade-bbfc-4dc0269d12fc tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:24.004397 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-30d50cd1-4451-4ade-bbfc-4dc0269d12fc tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:24.005384 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-30d50cd1-4451-4ade-bbfc-4dc0269d12fc tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:24.006695 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-30d50cd1-4451-4ade-bbfc-4dc0269d12fc tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:24.206471 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-52638140-f49c-4c75-80f4-2b3a5a207ce8 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb901faa8e9410484f83e47e5bcfa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e0691b14804cc5b4fe120fc5dea871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:24.215464 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-52638140-f49c-4c75-80f4-2b3a5a207ce8 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] 10.222.0.69 "GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c" status: 200 len: 1315 microversion: 2.1 time: 0.440938 Jul 20 19:24:24.219063 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 51/106] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:23 2022] GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c => generated 1315 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:24.250381 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-a4c75427-4fda-43a8-a2c3-93188d97b0ae tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:24.251283 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-a4c75427-4fda-43a8-a2c3-93188d97b0ae tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:24.273740 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a4c75427-4fda-43a8-a2c3-93188d97b0ae tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:24.276611 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a4c75427-4fda-43a8-a2c3-93188d97b0ae tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:24.279394 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a4c75427-4fda-43a8-a2c3-93188d97b0ae tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:24.284085 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a4c75427-4fda-43a8-a2c3-93188d97b0ae tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:24.309948 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-30d50cd1-4451-4ade-bbfc-4dc0269d12fc tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:24.325806 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-30d50cd1-4451-4ade-bbfc-4dc0269d12fc tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a" status: 200 len: 1364 microversion: 2.1 time: 0.332734 Jul 20 19:24:24.326519 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 56/107] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:23 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a => generated 1364 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:24.600712 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-a4c75427-4fda-43a8-a2c3-93188d97b0ae tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:24.605638 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_cell1:SELECT=100 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:24.617036 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-a4c75427-4fda-43a8-a2c3-93188d97b0ae tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1321 microversion: 2.1 time: 0.394909 Jul 20 19:24:24.626526 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 52/108] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:24 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1321 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:24.651650 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-20c6d520-6162-48a2-bb80-932ecca0f534 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:24.652257 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-20c6d520-6162-48a2-bb80-932ecca0f534 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:24.659175 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-20c6d520-6162-48a2-bb80-932ecca0f534 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:24.659623 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-20c6d520-6162-48a2-bb80-932ecca0f534 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:24.660679 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-20c6d520-6162-48a2-bb80-932ecca0f534 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:24.661111 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-20c6d520-6162-48a2-bb80-932ecca0f534 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:24.871789 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-20c6d520-6162-48a2-bb80-932ecca0f534 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:24.880603 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-20c6d520-6162-48a2-bb80-932ecca0f534 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:24.883674 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-20c6d520-6162-48a2-bb80-932ecca0f534 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:24.885072 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-20c6d520-6162-48a2-bb80-932ecca0f534 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1405 microversion: 2.20 time: 0.237386 Jul 20 19:24:24.885806 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 57/109] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:24:24 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1405 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:24:25.241935 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-4b82137a-6ff1-4c7e-9d9a-9150392bcf89 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:25.244606 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-4b82137a-6ff1-4c7e-9d9a-9150392bcf89 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] [instance: 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:25.256642 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4b82137a-6ff1-4c7e-9d9a-9150392bcf89 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:25.257456 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4b82137a-6ff1-4c7e-9d9a-9150392bcf89 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:25.258912 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4b82137a-6ff1-4c7e-9d9a-9150392bcf89 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:25.260467 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4b82137a-6ff1-4c7e-9d9a-9150392bcf89 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:25.364369 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-39d7e7ae-6f9e-4887-a658-78f5cbae3c0c tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:25.366065 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-39d7e7ae-6f9e-4887-a658-78f5cbae3c0c tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:25.374197 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-39d7e7ae-6f9e-4887-a658-78f5cbae3c0c tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:25.375024 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-39d7e7ae-6f9e-4887-a658-78f5cbae3c0c tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:25.376477 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-39d7e7ae-6f9e-4887-a658-78f5cbae3c0c tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:25.377296 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-39d7e7ae-6f9e-4887-a658-78f5cbae3c0c tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:25.460507 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-4b82137a-6ff1-4c7e-9d9a-9150392bcf89 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb901faa8e9410484f83e47e5bcfa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e0691b14804cc5b4fe120fc5dea871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:25.469023 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-4b82137a-6ff1-4c7e-9d9a-9150392bcf89 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] 10.222.0.69 "GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c" status: 200 len: 1315 microversion: 2.1 time: 0.236717 Jul 20 19:24:25.470312 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 53/110] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:25 2022] GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:25.577485 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-39d7e7ae-6f9e-4887-a658-78f5cbae3c0c tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:25.586514 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-39d7e7ae-6f9e-4887-a658-78f5cbae3c0c tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a" status: 200 len: 1364 microversion: 2.1 time: 0.247074 Jul 20 19:24:25.587102 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 58/111] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:25 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a => generated 1364 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:25.635217 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-9fdaa1fe-64db-4474-91e4-7bc7a779c904 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:25.636114 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-9fdaa1fe-64db-4474-91e4-7bc7a779c904 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:25.644228 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9fdaa1fe-64db-4474-91e4-7bc7a779c904 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:25.644951 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9fdaa1fe-64db-4474-91e4-7bc7a779c904 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:25.645971 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9fdaa1fe-64db-4474-91e4-7bc7a779c904 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:25.646780 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9fdaa1fe-64db-4474-91e4-7bc7a779c904 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:25.904531 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-729373fb-78f9-47c2-b294-9784953fcd84 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:25.905384 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-729373fb-78f9-47c2-b294-9784953fcd84 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:25.915065 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-9fdaa1fe-64db-4474-91e4-7bc7a779c904 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:25.916233 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-729373fb-78f9-47c2-b294-9784953fcd84 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:25.916800 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-729373fb-78f9-47c2-b294-9784953fcd84 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:25.917747 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-729373fb-78f9-47c2-b294-9784953fcd84 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:25.918386 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-729373fb-78f9-47c2-b294-9784953fcd84 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:25.924945 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-9fdaa1fe-64db-4474-91e4-7bc7a779c904 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1321 microversion: 2.1 time: 0.295210 Jul 20 19:24:25.929982 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 54/112] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:25 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1321 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:26.123842 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-729373fb-78f9-47c2-b294-9784953fcd84 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:26.134565 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-729373fb-78f9-47c2-b294-9784953fcd84 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:26.139452 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-729373fb-78f9-47c2-b294-9784953fcd84 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:26.140645 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-729373fb-78f9-47c2-b294-9784953fcd84 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1405 microversion: 2.20 time: 0.241143 Jul 20 19:24:26.143516 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 59/113] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:24:25 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1405 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:24:26.487009 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-49350456-02e3-44dc-8dec-825a98c4fb3f tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:26.488235 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-49350456-02e3-44dc-8dec-825a98c4fb3f tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] [instance: 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:26.497490 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-49350456-02e3-44dc-8dec-825a98c4fb3f tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:26.503035 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-49350456-02e3-44dc-8dec-825a98c4fb3f tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:26.504090 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-49350456-02e3-44dc-8dec-825a98c4fb3f tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:26.504863 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-49350456-02e3-44dc-8dec-825a98c4fb3f tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:26.572900 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [req-0a2a335e-20d4-4da9-90e2-4394824d5736 req-86439467-8c96-464d-b03f-eb8cbf1a0fc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "689a26d3-0640-4e71-acf6-10bda1f0f4fc", "name": "network-vif-plugged", "status": "completed", "tag": "64f9d89f-7304-4e79-86e7-8900cf5f72fc"}]} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:24:26.603241 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-0a2a335e-20d4-4da9-90e2-4394824d5736 req-86439467-8c96-464d-b03f-eb8cbf1a0fc4 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:26.604719 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-0a2a335e-20d4-4da9-90e2-4394824d5736 req-86439467-8c96-464d-b03f-eb8cbf1a0fc4 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:26.628454 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.compute.server_external_events [req-0a2a335e-20d4-4da9-90e2-4394824d5736 req-86439467-8c96-464d-b03f-eb8cbf1a0fc4 service nova] Creating event network-vif-plugged:64f9d89f-7304-4e79-86e7-8900cf5f72fc for instance 689a26d3-0640-4e71-acf6-10bda1f0f4fc on hv-cinder-83538 Jul 20 19:24:26.638101 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [req-0a2a335e-20d4-4da9-90e2-4394824d5736 req-86439467-8c96-464d-b03f-eb8cbf1a0fc4 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073375 Jul 20 19:24:26.639785 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 60/114] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 19:24:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:24:26.655561 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-dc452dca-9524-41fa-ad4d-0374bfb0526a tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:26.656551 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-dc452dca-9524-41fa-ad4d-0374bfb0526a tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:26.666714 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-dc452dca-9524-41fa-ad4d-0374bfb0526a tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:26.667527 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-dc452dca-9524-41fa-ad4d-0374bfb0526a tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:26.668690 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-dc452dca-9524-41fa-ad4d-0374bfb0526a tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:26.669345 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-dc452dca-9524-41fa-ad4d-0374bfb0526a tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:26.757188 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-49350456-02e3-44dc-8dec-825a98c4fb3f tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb901faa8e9410484f83e47e5bcfa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e0691b14804cc5b4fe120fc5dea871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:26.766113 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-49350456-02e3-44dc-8dec-825a98c4fb3f tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] 10.222.0.69 "GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c" status: 200 len: 1315 microversion: 2.1 time: 0.282949 Jul 20 19:24:26.777137 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 55/115] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:26 2022] GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c => generated 1315 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:26.851671 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-dc452dca-9524-41fa-ad4d-0374bfb0526a tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:26.862940 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-dc452dca-9524-41fa-ad4d-0374bfb0526a tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a" status: 200 len: 1364 microversion: 2.1 time: 0.219874 Jul 20 19:24:26.863719 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 61/116] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:26 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a => generated 1364 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:26.955939 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-755f20d9-8cdc-486b-a0b5-0d75797ad05e tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:26.956557 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-755f20d9-8cdc-486b-a0b5-0d75797ad05e tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:26.965049 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-755f20d9-8cdc-486b-a0b5-0d75797ad05e tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:26.965615 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-755f20d9-8cdc-486b-a0b5-0d75797ad05e tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:26.966458 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-755f20d9-8cdc-486b-a0b5-0d75797ad05e tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:26.967739 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-755f20d9-8cdc-486b-a0b5-0d75797ad05e tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:27.131949 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-755f20d9-8cdc-486b-a0b5-0d75797ad05e tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:27.147669 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-755f20d9-8cdc-486b-a0b5-0d75797ad05e tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1321 microversion: 2.1 time: 0.200315 Jul 20 19:24:27.148721 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 56/117] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:26 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1321 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:27.160385 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e5378f39-e4d5-457f-bee7-e084dfa43b01 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:27.161641 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e5378f39-e4d5-457f-bee7-e084dfa43b01 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:27.173347 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e5378f39-e4d5-457f-bee7-e084dfa43b01 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:27.173849 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e5378f39-e4d5-457f-bee7-e084dfa43b01 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:27.183195 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e5378f39-e4d5-457f-bee7-e084dfa43b01 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:27.183902 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e5378f39-e4d5-457f-bee7-e084dfa43b01 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:27.394567 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e5378f39-e4d5-457f-bee7-e084dfa43b01 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:27.405223 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e5378f39-e4d5-457f-bee7-e084dfa43b01 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:27.407851 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e5378f39-e4d5-457f-bee7-e084dfa43b01 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:27.411484 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e5378f39-e4d5-457f-bee7-e084dfa43b01 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1405 microversion: 2.20 time: 0.253501 Jul 20 19:24:27.413492 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 62/118] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:24:27 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1405 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:24:27.786163 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-a0755671-1c34-4a5d-90ae-74f6f5abe2f8 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:27.786851 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-a0755671-1c34-4a5d-90ae-74f6f5abe2f8 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] [instance: 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:27.806315 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a0755671-1c34-4a5d-90ae-74f6f5abe2f8 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:27.806835 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a0755671-1c34-4a5d-90ae-74f6f5abe2f8 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:27.807675 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a0755671-1c34-4a5d-90ae-74f6f5abe2f8 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:27.808168 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a0755671-1c34-4a5d-90ae-74f6f5abe2f8 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:27.881553 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-70c0fc40-4af9-4653-804a-a2c190b2b44f tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:27.882302 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-70c0fc40-4af9-4653-804a-a2c190b2b44f tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:27.899914 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-70c0fc40-4af9-4653-804a-a2c190b2b44f tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:27.900539 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-70c0fc40-4af9-4653-804a-a2c190b2b44f tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:27.901451 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-70c0fc40-4af9-4653-804a-a2c190b2b44f tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:27.902016 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-70c0fc40-4af9-4653-804a-a2c190b2b44f tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:28.251704 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-a0755671-1c34-4a5d-90ae-74f6f5abe2f8 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb901faa8e9410484f83e47e5bcfa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e0691b14804cc5b4fe120fc5dea871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:28.270491 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-a0755671-1c34-4a5d-90ae-74f6f5abe2f8 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] 10.222.0.69 "GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c" status: 200 len: 1315 microversion: 2.1 time: 0.488798 Jul 20 19:24:28.283125 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-70c0fc40-4af9-4653-804a-a2c190b2b44f tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:28.285735 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 57/119] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:27 2022] GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c => generated 1315 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:28.291270 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-41a6baaa-898c-4529-acb3-35cdaa40ac74 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:28.292657 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-41a6baaa-898c-4529-acb3-35cdaa40ac74 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:28.297472 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-70c0fc40-4af9-4653-804a-a2c190b2b44f tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a" status: 200 len: 1364 microversion: 2.1 time: 0.420694 Jul 20 19:24:28.298765 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 63/120] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:27 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a => generated 1364 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:28.299883 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-41a6baaa-898c-4529-acb3-35cdaa40ac74 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:28.300595 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-41a6baaa-898c-4529-acb3-35cdaa40ac74 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:28.301346 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-41a6baaa-898c-4529-acb3-35cdaa40ac74 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:28.301829 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-41a6baaa-898c-4529-acb3-35cdaa40ac74 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:28.431123 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-fffca76c-fc18-49dd-9b87-3618744a555d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:28.432015 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-fffca76c-fc18-49dd-9b87-3618744a555d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:28.439619 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fffca76c-fc18-49dd-9b87-3618744a555d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:28.440244 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fffca76c-fc18-49dd-9b87-3618744a555d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:28.441326 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fffca76c-fc18-49dd-9b87-3618744a555d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:28.442117 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fffca76c-fc18-49dd-9b87-3618744a555d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:28.498634 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-41a6baaa-898c-4529-acb3-35cdaa40ac74 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:28.531380 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-41a6baaa-898c-4529-acb3-35cdaa40ac74 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1321 microversion: 2.1 time: 0.244441 Jul 20 19:24:28.534075 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 58/121] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:28 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1321 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:28.651304 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-fffca76c-fc18-49dd-9b87-3618744a555d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:28.663755 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-fffca76c-fc18-49dd-9b87-3618744a555d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:28.665706 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-fffca76c-fc18-49dd-9b87-3618744a555d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:28.667074 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-fffca76c-fc18-49dd-9b87-3618744a555d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1405 microversion: 2.20 time: 0.240311 Jul 20 19:24:28.680646 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 64/122] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:24:28 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1405 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:24:29.292999 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-6b663e2b-5521-4377-8e8d-e2672da1b1f6 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:29.293682 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-6b663e2b-5521-4377-8e8d-e2672da1b1f6 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] [instance: 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:29.304261 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-6b663e2b-5521-4377-8e8d-e2672da1b1f6 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:29.304879 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-6b663e2b-5521-4377-8e8d-e2672da1b1f6 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:29.305825 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-6b663e2b-5521-4377-8e8d-e2672da1b1f6 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:29.306331 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-6b663e2b-5521-4377-8e8d-e2672da1b1f6 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:29.322186 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-5c6760cb-7781-4f70-8e77-664aad2927c4 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:29.323518 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-5c6760cb-7781-4f70-8e77-664aad2927c4 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:29.334060 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5c6760cb-7781-4f70-8e77-664aad2927c4 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:29.334706 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5c6760cb-7781-4f70-8e77-664aad2927c4 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:29.336544 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5c6760cb-7781-4f70-8e77-664aad2927c4 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:29.337737 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5c6760cb-7781-4f70-8e77-664aad2927c4 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:29.500351 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-6b663e2b-5521-4377-8e8d-e2672da1b1f6 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb901faa8e9410484f83e47e5bcfa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e0691b14804cc5b4fe120fc5dea871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:29.508940 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-6b663e2b-5521-4377-8e8d-e2672da1b1f6 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] 10.222.0.69 "GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c" status: 200 len: 1502 microversion: 2.1 time: 0.224365 Jul 20 19:24:29.510120 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 59/123] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:29 2022] GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c => generated 1502 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:29.549267 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-5c6760cb-7781-4f70-8e77-664aad2927c4 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:29.555166 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-c3f136d6-1b79-416e-8bb4-2d12d5374514 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:29.555801 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-c3f136d6-1b79-416e-8bb4-2d12d5374514 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:29.560229 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-5c6760cb-7781-4f70-8e77-664aad2927c4 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a" status: 200 len: 1364 microversion: 2.1 time: 0.248563 Jul 20 19:24:29.570503 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 65/124] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:29 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a => generated 1364 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:29.570971 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c3f136d6-1b79-416e-8bb4-2d12d5374514 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:29.570971 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c3f136d6-1b79-416e-8bb4-2d12d5374514 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:29.570971 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c3f136d6-1b79-416e-8bb4-2d12d5374514 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:29.570971 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c3f136d6-1b79-416e-8bb4-2d12d5374514 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:29.685147 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-0d397f51-0ec5-49e3-b728-33250c4a6fea tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:29.686240 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-0d397f51-0ec5-49e3-b728-33250c4a6fea tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:29.692491 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0d397f51-0ec5-49e3-b728-33250c4a6fea tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:29.693302 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0d397f51-0ec5-49e3-b728-33250c4a6fea tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:29.694285 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0d397f51-0ec5-49e3-b728-33250c4a6fea tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:29.694882 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0d397f51-0ec5-49e3-b728-33250c4a6fea tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:29.738860 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-c3f136d6-1b79-416e-8bb4-2d12d5374514 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:29.748369 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-c3f136d6-1b79-416e-8bb4-2d12d5374514 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1321 microversion: 2.1 time: 0.199993 Jul 20 19:24:29.758791 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 60/125] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:29 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1321 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:24:29.862980 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0d397f51-0ec5-49e3-b728-33250c4a6fea tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:29.872140 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0d397f51-0ec5-49e3-b728-33250c4a6fea tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:29.874224 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0d397f51-0ec5-49e3-b728-33250c4a6fea tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:29.875757 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-0d397f51-0ec5-49e3-b728-33250c4a6fea tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1405 microversion: 2.20 time: 0.194362 Jul 20 19:24:29.877073 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 66/126] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:24:29 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1405 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:24:30.578199 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-85d808a0-3be4-49d6-bf7d-11ee10e53470 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:30.578707 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-85d808a0-3be4-49d6-bf7d-11ee10e53470 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:30.585725 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-85d808a0-3be4-49d6-bf7d-11ee10e53470 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:30.586174 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-85d808a0-3be4-49d6-bf7d-11ee10e53470 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:30.586941 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-85d808a0-3be4-49d6-bf7d-11ee10e53470 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:30.587374 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-85d808a0-3be4-49d6-bf7d-11ee10e53470 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:30.723526 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-85d808a0-3be4-49d6-bf7d-11ee10e53470 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:30.731139 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-85d808a0-3be4-49d6-bf7d-11ee10e53470 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a" status: 200 len: 1364 microversion: 2.1 time: 0.156757 Jul 20 19:24:30.732422 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 61/127] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:30 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:30.771990 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e0d124c1-dd0b-41bc-b3e6-3106e25a31fd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:30.772735 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e0d124c1-dd0b-41bc-b3e6-3106e25a31fd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:30.779375 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e0d124c1-dd0b-41bc-b3e6-3106e25a31fd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:30.779825 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e0d124c1-dd0b-41bc-b3e6-3106e25a31fd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:30.780658 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e0d124c1-dd0b-41bc-b3e6-3106e25a31fd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:30.781041 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e0d124c1-dd0b-41bc-b3e6-3106e25a31fd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:30.911796 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-938646a4-7859-4b59-a072-f535a2d1b2fd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:30.913473 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-938646a4-7859-4b59-a072-f535a2d1b2fd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:30.924678 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-938646a4-7859-4b59-a072-f535a2d1b2fd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:30.925587 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-938646a4-7859-4b59-a072-f535a2d1b2fd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:30.927844 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-938646a4-7859-4b59-a072-f535a2d1b2fd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:30.929220 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-938646a4-7859-4b59-a072-f535a2d1b2fd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:30.955319 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e0d124c1-dd0b-41bc-b3e6-3106e25a31fd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:30.991939 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e0d124c1-dd0b-41bc-b3e6-3106e25a31fd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1321 microversion: 2.1 time: 0.227984 Jul 20 19:24:31.002774 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 67/128] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:30 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1321 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:31.165823 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-30ad5746-ebba-4496-807a-d9815e97fe1a tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1656623902", "imageRef": "59575804-e013-4dec-af24-b6c2dbbce73a", "flavorRef": "452", "networks": [{"uuid": "100f0542-9a02-4a7d-9b70-eb4cf3a832ac"}]}} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:24:31.224118 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-938646a4-7859-4b59-a072-f535a2d1b2fd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:31.234528 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-938646a4-7859-4b59-a072-f535a2d1b2fd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:31.236563 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-938646a4-7859-4b59-a072-f535a2d1b2fd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:31.238539 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-938646a4-7859-4b59-a072-f535a2d1b2fd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1405 microversion: 2.20 time: 0.337180 Jul 20 19:24:31.239277 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 62/129] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:24:30 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1405 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:24:31.256171 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.network.neutron [None req-30ad5746-ebba-4496-807a-d9815e97fe1a tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] validate_networks() for [('100f0542-9a02-4a7d-9b70-eb4cf3a832ac', None, None, None, None, None)] {{(pid=117761) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 19:24:31.309278 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [req-91d09213-41c7-4a79-b1e8-338ba156cdb1 req-66a134ae-3dcb-4706-88d4-e70db7da27bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b2abd53-4758-462c-b36a-0d1bf0b66a55", "name": "network-vif-plugged", "status": "completed", "tag": "3232872d-df06-40e7-a7c3-7cc3babe684d"}]} {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:24:31.324931 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [req-91d09213-41c7-4a79-b1e8-338ba156cdb1 req-66a134ae-3dcb-4706-88d4-e70db7da27bf service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:31.325385 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [req-91d09213-41c7-4a79-b1e8-338ba156cdb1 req-66a134ae-3dcb-4706-88d4-e70db7da27bf service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:31.345443 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.compute.server_external_events [req-91d09213-41c7-4a79-b1e8-338ba156cdb1 req-66a134ae-3dcb-4706-88d4-e70db7da27bf service nova] Creating event network-vif-plugged:3232872d-df06-40e7-a7c3-7cc3babe684d for instance 3b2abd53-4758-462c-b36a-0d1bf0b66a55 on hv-cinder-83538 Jul 20 19:24:31.364223 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [req-91d09213-41c7-4a79-b1e8-338ba156cdb1 req-66a134ae-3dcb-4706-88d4-e70db7da27bf service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052529 Jul 20 19:24:31.364223 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 63/130] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 19:24:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:24:31.689355 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.virt.hardware [None req-30ad5746-ebba-4496-807a-d9815e97fe1a tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Flavor limits 0:0:0 {{(pid=117761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 19:24:31.689814 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.virt.hardware [None req-30ad5746-ebba-4496-807a-d9815e97fe1a tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Image limits 0:0:0 {{(pid=117761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 19:24:31.690284 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.virt.hardware [None req-30ad5746-ebba-4496-807a-d9815e97fe1a tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Flavor pref 0:0:0 {{(pid=117761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 19:24:31.690687 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.virt.hardware [None req-30ad5746-ebba-4496-807a-d9815e97fe1a tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Image pref 0:0:0 {{(pid=117761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 19:24:31.691120 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.virt.hardware [None req-30ad5746-ebba-4496-807a-d9815e97fe1a tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 19:24:31.700278 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-30ad5746-ebba-4496-807a-d9815e97fe1a tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:31.700727 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-30ad5746-ebba-4496-807a-d9815e97fe1a tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:31.701579 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-30ad5746-ebba-4496-807a-d9815e97fe1a tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:31.702182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-30ad5746-ebba-4496-807a-d9815e97fe1a tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:31.720040 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.quota [None req-30ad5746-ebba-4496-807a-d9815e97fe1a tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Getting quotas for project a51cf9bd2ea44ebe8edd25559baafc4e. Resources: {'cores', 'ram', 'instances'} {{(pid=117761) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:24:31.723970 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.quota [None req-30ad5746-ebba-4496-807a-d9815e97fe1a tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Getting quotas for user afa79c7408524e979cf0e9a595fe731a and project a51cf9bd2ea44ebe8edd25559baafc4e. Resources: {'cores', 'ram', 'instances'} {{(pid=117761) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:24:31.736490 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-30ad5746-ebba-4496-807a-d9815e97fe1a tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Going to run 1 instances... {{(pid=117761) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 19:24:31.738754 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-30ad5746-ebba-4496-807a-d9815e97fe1a tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: af2baaf9-da80-407f-b960-d6b31aa82e24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='59575804-e013-4dec-af24-b6c2dbbce73a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117761) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 19:24:31.752885 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-7ddeb677-3c9f-41ac-8f70-50019fe82ef3 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:31.753631 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-7ddeb677-3c9f-41ac-8f70-50019fe82ef3 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:31.760572 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-7ddeb677-3c9f-41ac-8f70-50019fe82ef3 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:31.761065 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-7ddeb677-3c9f-41ac-8f70-50019fe82ef3 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:31.761808 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-7ddeb677-3c9f-41ac-8f70-50019fe82ef3 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:31.762253 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-7ddeb677-3c9f-41ac-8f70-50019fe82ef3 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:31.791889 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-30ad5746-ebba-4496-807a-d9815e97fe1a tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.634147 Jul 20 19:24:31.794632 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 68/131] 10.222.0.69 () {60 vars in 1146 bytes} [Wed Jul 20 19:24:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 638 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 19:24:31.813889 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-88ad29dc-4c09-437d-8739-3fc61c52afcf tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:31.813889 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-88ad29dc-4c09-437d-8739-3fc61c52afcf tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: af2baaf9-da80-407f-b960-d6b31aa82e24] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:31.900058 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-88ad29dc-4c09-437d-8739-3fc61c52afcf tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:31.909919 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-88ad29dc-4c09-437d-8739-3fc61c52afcf tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24" status: 200 len: 1214 microversion: 2.1 time: 0.105337 Jul 20 19:24:31.910675 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 69/132] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:31 2022] GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24 => generated 1214 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:24:31.961739 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-7ddeb677-3c9f-41ac-8f70-50019fe82ef3 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:31.971499 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-7ddeb677-3c9f-41ac-8f70-50019fe82ef3 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a" status: 200 len: 1364 microversion: 2.1 time: 0.224047 Jul 20 19:24:31.972161 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 64/133] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:31 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a => generated 1364 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:24:32.022385 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a3bfe5f0-3dd2-4710-8d7b-e9b1026eee32 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:32.024426 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a3bfe5f0-3dd2-4710-8d7b-e9b1026eee32 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:32.033077 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a3bfe5f0-3dd2-4710-8d7b-e9b1026eee32 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:32.034256 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a3bfe5f0-3dd2-4710-8d7b-e9b1026eee32 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:32.035193 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a3bfe5f0-3dd2-4710-8d7b-e9b1026eee32 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:32.035655 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a3bfe5f0-3dd2-4710-8d7b-e9b1026eee32 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:32.234162 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a3bfe5f0-3dd2-4710-8d7b-e9b1026eee32 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:32.246464 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a3bfe5f0-3dd2-4710-8d7b-e9b1026eee32 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1321 microversion: 2.1 time: 0.230027 Jul 20 19:24:32.256162 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 70/134] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:32 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1321 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:32.257619 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-06ae74bf-dea3-405c-8d6b-7d7737fd4080 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:32.258310 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-06ae74bf-dea3-405c-8d6b-7d7737fd4080 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:32.274802 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-06ae74bf-dea3-405c-8d6b-7d7737fd4080 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:32.275314 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-06ae74bf-dea3-405c-8d6b-7d7737fd4080 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:32.276140 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-06ae74bf-dea3-405c-8d6b-7d7737fd4080 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:32.276746 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-06ae74bf-dea3-405c-8d6b-7d7737fd4080 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:32.425428 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-06ae74bf-dea3-405c-8d6b-7d7737fd4080 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:32.433861 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-06ae74bf-dea3-405c-8d6b-7d7737fd4080 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:32.435388 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-06ae74bf-dea3-405c-8d6b-7d7737fd4080 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:32.436494 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-06ae74bf-dea3-405c-8d6b-7d7737fd4080 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1405 microversion: 2.20 time: 0.183751 Jul 20 19:24:32.437051 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 65/135] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:24:32 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1405 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:24:32.928992 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-223f35c5-c472-4567-834f-aa8cd47b0268 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:32.929593 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-223f35c5-c472-4567-834f-aa8cd47b0268 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: af2baaf9-da80-407f-b960-d6b31aa82e24] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:32.935705 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-223f35c5-c472-4567-834f-aa8cd47b0268 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:32.936150 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-223f35c5-c472-4567-834f-aa8cd47b0268 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:32.936918 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-223f35c5-c472-4567-834f-aa8cd47b0268 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:32.937341 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-223f35c5-c472-4567-834f-aa8cd47b0268 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:32.988964 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-9594416a-521b-4c2b-9233-c0925c838e78 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:32.990594 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-9594416a-521b-4c2b-9233-c0925c838e78 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:32.997489 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9594416a-521b-4c2b-9233-c0925c838e78 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:32.998006 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9594416a-521b-4c2b-9233-c0925c838e78 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:32.998808 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9594416a-521b-4c2b-9233-c0925c838e78 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:32.999204 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9594416a-521b-4c2b-9233-c0925c838e78 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:33.007829 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-223f35c5-c472-4567-834f-aa8cd47b0268 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:33.015959 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-223f35c5-c472-4567-834f-aa8cd47b0268 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24" status: 200 len: 1218 microversion: 2.1 time: 0.091597 Jul 20 19:24:33.016542 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 71/136] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:32 2022] GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24 => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:24:33.144420 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-9594416a-521b-4c2b-9233-c0925c838e78 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:33.159611 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-9594416a-521b-4c2b-9233-c0925c838e78 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a" status: 200 len: 1364 microversion: 2.1 time: 0.174377 Jul 20 19:24:33.160538 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 66/137] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:32 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a => generated 1364 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:24:33.202059 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-fb0d7cc4-ed7a-4356-9d37-b4c1377e3e15 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fadde97b-59fa-4998-bf56-1c641b7846aa"}} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:24:33.203708 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-fb0d7cc4-ed7a-4356-9d37-b4c1377e3e15 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] [instance: 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:33.210112 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fb0d7cc4-ed7a-4356-9d37-b4c1377e3e15 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:33.210557 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fb0d7cc4-ed7a-4356-9d37-b4c1377e3e15 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:33.211527 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fb0d7cc4-ed7a-4356-9d37-b4c1377e3e15 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:33.212124 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fb0d7cc4-ed7a-4356-9d37-b4c1377e3e15 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:33.266648 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-1985830c-5008-4f5f-bf59-974a5d91fa03 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:33.267369 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-1985830c-5008-4f5f-bf59-974a5d91fa03 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:33.275245 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1985830c-5008-4f5f-bf59-974a5d91fa03 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:33.275780 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1985830c-5008-4f5f-bf59-974a5d91fa03 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:33.276702 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1985830c-5008-4f5f-bf59-974a5d91fa03 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:33.277278 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1985830c-5008-4f5f-bf59-974a5d91fa03 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:33.434957 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-1985830c-5008-4f5f-bf59-974a5d91fa03 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:33.442470 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-1985830c-5008-4f5f-bf59-974a5d91fa03 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1321 microversion: 2.1 time: 0.181207 Jul 20 19:24:33.443714 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 67/138] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:33 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1321 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:33.458413 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-dd490fda-3492-4fdc-b447-027f2d7320e5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:33.459608 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-dd490fda-3492-4fdc-b447-027f2d7320e5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:33.465986 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-dd490fda-3492-4fdc-b447-027f2d7320e5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:33.466434 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-dd490fda-3492-4fdc-b447-027f2d7320e5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:33.467499 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-dd490fda-3492-4fdc-b447-027f2d7320e5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:33.467927 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-dd490fda-3492-4fdc-b447-027f2d7320e5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:33.619814 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-dd490fda-3492-4fdc-b447-027f2d7320e5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:33.628600 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-dd490fda-3492-4fdc-b447-027f2d7320e5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:33.630149 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-dd490fda-3492-4fdc-b447-027f2d7320e5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:33.631711 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-dd490fda-3492-4fdc-b447-027f2d7320e5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1405 microversion: 2.20 time: 0.177419 Jul 20 19:24:33.632430 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 68/139] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:24:33 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1405 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:24:34.034307 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-87482244-a0ba-42df-ab52-dd299f81b9cf tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:34.034975 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-87482244-a0ba-42df-ab52-dd299f81b9cf tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: af2baaf9-da80-407f-b960-d6b31aa82e24] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:34.041624 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-87482244-a0ba-42df-ab52-dd299f81b9cf tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:34.042018 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-87482244-a0ba-42df-ab52-dd299f81b9cf tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:34.042785 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-87482244-a0ba-42df-ab52-dd299f81b9cf tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:34.043214 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-87482244-a0ba-42df-ab52-dd299f81b9cf tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:34.107115 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-87482244-a0ba-42df-ab52-dd299f81b9cf tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:34.115233 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-87482244-a0ba-42df-ab52-dd299f81b9cf tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24" status: 200 len: 1218 microversion: 2.1 time: 0.084817 Jul 20 19:24:34.115782 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 69/140] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:34 2022] GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:24:34.178307 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-8850738e-9c90-4481-ad00-7dd6aaad2311 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:34.179082 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-8850738e-9c90-4481-ad00-7dd6aaad2311 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:34.185752 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8850738e-9c90-4481-ad00-7dd6aaad2311 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:34.186188 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8850738e-9c90-4481-ad00-7dd6aaad2311 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:34.187118 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8850738e-9c90-4481-ad00-7dd6aaad2311 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:34.187546 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8850738e-9c90-4481-ad00-7dd6aaad2311 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:34.190253 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_cell1:SELECT=100 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:34.333199 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-8850738e-9c90-4481-ad00-7dd6aaad2311 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:34.341244 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-8850738e-9c90-4481-ad00-7dd6aaad2311 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a" status: 200 len: 1364 microversion: 2.1 time: 0.167049 Jul 20 19:24:34.342120 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 70/141] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:34 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:24:34.460768 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-6c07ada5-12b2-4099-a0a3-89d2b55b1dc5 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:34.461381 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-6c07ada5-12b2-4099-a0a3-89d2b55b1dc5 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:34.467662 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-6c07ada5-12b2-4099-a0a3-89d2b55b1dc5 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:34.468098 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-6c07ada5-12b2-4099-a0a3-89d2b55b1dc5 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:34.468847 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-6c07ada5-12b2-4099-a0a3-89d2b55b1dc5 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:34.469270 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-6c07ada5-12b2-4099-a0a3-89d2b55b1dc5 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:34.619665 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-6c07ada5-12b2-4099-a0a3-89d2b55b1dc5 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:34.627055 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-6c07ada5-12b2-4099-a0a3-89d2b55b1dc5 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1321 microversion: 2.1 time: 0.171282 Jul 20 19:24:34.627618 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 71/142] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:34 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:24:34.650910 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-e8bedcf0-d79c-4f68-a11e-1a4aa7228661 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:34.651511 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-e8bedcf0-d79c-4f68-a11e-1a4aa7228661 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:34.657807 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e8bedcf0-d79c-4f68-a11e-1a4aa7228661 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:34.658252 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e8bedcf0-d79c-4f68-a11e-1a4aa7228661 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:34.659014 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e8bedcf0-d79c-4f68-a11e-1a4aa7228661 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:34.659447 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e8bedcf0-d79c-4f68-a11e-1a4aa7228661 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:34.804258 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-e8bedcf0-d79c-4f68-a11e-1a4aa7228661 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:34.816936 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-e8bedcf0-d79c-4f68-a11e-1a4aa7228661 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:34.821318 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-e8bedcf0-d79c-4f68-a11e-1a4aa7228661 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:34.823635 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-e8bedcf0-d79c-4f68-a11e-1a4aa7228661 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1405 microversion: 2.20 time: 0.177114 Jul 20 19:24:34.824560 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 72/143] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:24:34 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1405 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:24:35.132838 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-21c0e649-d1fe-4c0a-9868-805ab7a3f03b tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:35.134617 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-21c0e649-d1fe-4c0a-9868-805ab7a3f03b tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: af2baaf9-da80-407f-b960-d6b31aa82e24] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:35.140816 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-21c0e649-d1fe-4c0a-9868-805ab7a3f03b tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:35.141350 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-21c0e649-d1fe-4c0a-9868-805ab7a3f03b tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:35.142165 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-21c0e649-d1fe-4c0a-9868-805ab7a3f03b tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:35.142598 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-21c0e649-d1fe-4c0a-9868-805ab7a3f03b tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:35.207423 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-21c0e649-d1fe-4c0a-9868-805ab7a3f03b tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:35.215335 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-21c0e649-d1fe-4c0a-9868-805ab7a3f03b tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24" status: 200 len: 1218 microversion: 2.1 time: 0.086975 Jul 20 19:24:35.217090 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 73/144] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:35 2022] GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:24:35.267830 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [req-17f897eb-3f31-4fd3-aca6-a9a0e9f9defa req-0859c57a-d14a-4f7a-ac48-5490a4917e1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c33037ed-7b36-43aa-85ad-e48920801b0a", "name": "network-vif-plugged", "status": "completed", "tag": "d530fbe6-76ab-41fc-9fa3-b088835bc0da"}]} {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:24:35.279880 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [req-17f897eb-3f31-4fd3-aca6-a9a0e9f9defa req-0859c57a-d14a-4f7a-ac48-5490a4917e1b service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:35.280535 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [req-17f897eb-3f31-4fd3-aca6-a9a0e9f9defa req-0859c57a-d14a-4f7a-ac48-5490a4917e1b service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:35.295148 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.compute.server_external_events [req-17f897eb-3f31-4fd3-aca6-a9a0e9f9defa req-0859c57a-d14a-4f7a-ac48-5490a4917e1b service nova] Creating event network-vif-plugged:d530fbe6-76ab-41fc-9fa3-b088835bc0da for instance c33037ed-7b36-43aa-85ad-e48920801b0a on hv-cinder-83538 Jul 20 19:24:35.300476 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [req-17f897eb-3f31-4fd3-aca6-a9a0e9f9defa req-0859c57a-d14a-4f7a-ac48-5490a4917e1b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036365 Jul 20 19:24:35.301256 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 74/145] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 19:24:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:24:35.360354 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-064be0e7-83a9-4e12-a99e-0d33f97817aa tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:35.361464 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-064be0e7-83a9-4e12-a99e-0d33f97817aa tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:35.395761 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-064be0e7-83a9-4e12-a99e-0d33f97817aa tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:35.396675 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-064be0e7-83a9-4e12-a99e-0d33f97817aa tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:35.397784 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-064be0e7-83a9-4e12-a99e-0d33f97817aa tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:35.398487 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-064be0e7-83a9-4e12-a99e-0d33f97817aa tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:35.631155 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-064be0e7-83a9-4e12-a99e-0d33f97817aa tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:35.641094 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-064be0e7-83a9-4e12-a99e-0d33f97817aa tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a" status: 200 len: 1364 microversion: 2.1 time: 0.285949 Jul 20 19:24:35.642044 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 75/146] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:35 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a => generated 1364 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:24:35.647519 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-31509731-a539-4bd7-98fb-4d5408068193 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:35.648426 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-31509731-a539-4bd7-98fb-4d5408068193 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:35.655606 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-31509731-a539-4bd7-98fb-4d5408068193 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:35.656551 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-31509731-a539-4bd7-98fb-4d5408068193 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:35.657905 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-31509731-a539-4bd7-98fb-4d5408068193 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:35.658572 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-31509731-a539-4bd7-98fb-4d5408068193 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:36.046437 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-31509731-a539-4bd7-98fb-4d5408068193 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:36.056345 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-31509731-a539-4bd7-98fb-4d5408068193 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1321 microversion: 2.1 time: 0.412755 Jul 20 19:24:36.063402 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 76/147] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:35 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1321 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:36.083268 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-7b51102f-1ba5-48c9-bd18-60bf2f62ee5d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:36.083904 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-7b51102f-1ba5-48c9-bd18-60bf2f62ee5d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:36.091209 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-7b51102f-1ba5-48c9-bd18-60bf2f62ee5d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:36.091707 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-7b51102f-1ba5-48c9-bd18-60bf2f62ee5d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:36.092679 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-7b51102f-1ba5-48c9-bd18-60bf2f62ee5d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:36.093106 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-7b51102f-1ba5-48c9-bd18-60bf2f62ee5d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:36.303632 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-7b51102f-1ba5-48c9-bd18-60bf2f62ee5d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:36.312450 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-7b51102f-1ba5-48c9-bd18-60bf2f62ee5d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:36.327876 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-7b51102f-1ba5-48c9-bd18-60bf2f62ee5d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:36.330979 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-7b51102f-1ba5-48c9-bd18-60bf2f62ee5d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1405 microversion: 2.20 time: 0.251625 Jul 20 19:24:36.331676 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 77/148] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:24:36 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1405 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:24:36.337221 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-b55fc47b-d81e-4e74-b2d0-2d46baebc59d tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:36.338429 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-b55fc47b-d81e-4e74-b2d0-2d46baebc59d tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: af2baaf9-da80-407f-b960-d6b31aa82e24] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:36.345778 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b55fc47b-d81e-4e74-b2d0-2d46baebc59d tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:36.346317 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b55fc47b-d81e-4e74-b2d0-2d46baebc59d tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:36.347191 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b55fc47b-d81e-4e74-b2d0-2d46baebc59d tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:36.347647 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b55fc47b-d81e-4e74-b2d0-2d46baebc59d tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:36.419475 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-b55fc47b-d81e-4e74-b2d0-2d46baebc59d tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:36.430699 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-b55fc47b-d81e-4e74-b2d0-2d46baebc59d tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24" status: 200 len: 1218 microversion: 2.1 time: 0.097876 Jul 20 19:24:36.431499 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 78/149] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:36 2022] GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24 => generated 1218 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:36.658676 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-2c8bca87-4bb5-4b2f-91ad-8335b634adca tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:36.659356 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-2c8bca87-4bb5-4b2f-91ad-8335b634adca tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:36.666434 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2c8bca87-4bb5-4b2f-91ad-8335b634adca tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:36.666881 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2c8bca87-4bb5-4b2f-91ad-8335b634adca tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:36.667654 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2c8bca87-4bb5-4b2f-91ad-8335b634adca tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:36.668119 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2c8bca87-4bb5-4b2f-91ad-8335b634adca tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:36.833984 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-2c8bca87-4bb5-4b2f-91ad-8335b634adca tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:36.844436 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-2c8bca87-4bb5-4b2f-91ad-8335b634adca tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a" status: 200 len: 1364 microversion: 2.1 time: 0.189622 Jul 20 19:24:36.845221 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 79/150] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:36 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a => generated 1364 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:24:37.077113 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-22af75cb-f5ba-4d28-be59-97c9101bc627 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:37.080341 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-22af75cb-f5ba-4d28-be59-97c9101bc627 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:37.103439 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-22af75cb-f5ba-4d28-be59-97c9101bc627 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:37.104005 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-22af75cb-f5ba-4d28-be59-97c9101bc627 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:37.108914 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-22af75cb-f5ba-4d28-be59-97c9101bc627 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:37.110055 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-22af75cb-f5ba-4d28-be59-97c9101bc627 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:37.183840 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-fb0d7cc4-ed7a-4356-9d37-b4c1377e3e15 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] 10.222.0.69 "POST /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.985543 Jul 20 19:24:37.185049 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 72/151] 10.222.0.69 () {60 vars in 1322 bytes} [Wed Jul 20 19:24:33 2022] POST /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c/os-volume_attachments => generated 194 bytes in 3988 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:24:37.354626 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-93d3f1b0-9370-48a0-9ee0-2765106f62d7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:37.355337 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-93d3f1b0-9370-48a0-9ee0-2765106f62d7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:37.390049 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-93d3f1b0-9370-48a0-9ee0-2765106f62d7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:37.390875 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-93d3f1b0-9370-48a0-9ee0-2765106f62d7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:37.392813 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-93d3f1b0-9370-48a0-9ee0-2765106f62d7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:37.394243 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-93d3f1b0-9370-48a0-9ee0-2765106f62d7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:37.401024 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:37.405378 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-22af75cb-f5ba-4d28-be59-97c9101bc627 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:37.415151 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-22af75cb-f5ba-4d28-be59-97c9101bc627 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1514 microversion: 2.1 time: 0.344342 Jul 20 19:24:37.416218 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 80/152] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:37 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1514 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:24:37.435054 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-49f5fd59-44c0-461f-9238-70c856da741f tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:24:37.440374 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-49f5fd59-44c0-461f-9238-70c856da741f tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:37.448642 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-49f5fd59-44c0-461f-9238-70c856da741f tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:37.449328 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-49f5fd59-44c0-461f-9238-70c856da741f tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:37.450824 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-49f5fd59-44c0-461f-9238-70c856da741f tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:37.451676 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-49f5fd59-44c0-461f-9238-70c856da741f tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:37.530329 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.objects.instance [None req-49f5fd59-44c0-461f-9238-70c856da741f tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lazy-loading 'flavor' on Instance uuid 689a26d3-0640-4e71-acf6-10bda1f0f4fc {{(pid=117762) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:24:37.686499 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-49f5fd59-44c0-461f-9238-70c856da741f tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "POST /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc/action" status: 200 len: 32 microversion: 2.1 time: 0.255132 Jul 20 19:24:37.687514 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 81/153] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Jul 20 19:24:37 2022] POST /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc/action => generated 32 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 19:24:37.696461 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-0e41da66-1424-4ca3-a903-807301b08521 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:37.697460 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-0e41da66-1424-4ca3-a903-807301b08521 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: af2baaf9-da80-407f-b960-d6b31aa82e24] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:37.710354 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-0e41da66-1424-4ca3-a903-807301b08521 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:37.710926 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-0e41da66-1424-4ca3-a903-807301b08521 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:37.711776 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-0e41da66-1424-4ca3-a903-807301b08521 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:37.712275 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-0e41da66-1424-4ca3-a903-807301b08521 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:37.723307 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-93d3f1b0-9370-48a0-9ee0-2765106f62d7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:37.732036 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-93d3f1b0-9370-48a0-9ee0-2765106f62d7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:37.733842 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-93d3f1b0-9370-48a0-9ee0-2765106f62d7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:37.735277 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-93d3f1b0-9370-48a0-9ee0-2765106f62d7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1405 microversion: 2.20 time: 0.385635 Jul 20 19:24:37.736289 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 73/154] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:24:37 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1405 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:24:37.750109 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-95967e4c-1865-4fc7-a8b0-2766ac95fe97 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:37.750908 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-95967e4c-1865-4fc7-a8b0-2766ac95fe97 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:37.758679 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-95967e4c-1865-4fc7-a8b0-2766ac95fe97 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:37.759301 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-95967e4c-1865-4fc7-a8b0-2766ac95fe97 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:37.760238 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-95967e4c-1865-4fc7-a8b0-2766ac95fe97 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:37.760883 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-95967e4c-1865-4fc7-a8b0-2766ac95fe97 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:37.809799 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-0e41da66-1424-4ca3-a903-807301b08521 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:37.823320 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-0e41da66-1424-4ca3-a903-807301b08521 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24" status: 200 len: 1266 microversion: 2.1 time: 0.132463 Jul 20 19:24:37.824336 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 82/155] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:37 2022] GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24 => generated 1266 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:37.864316 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-c2995144-108e-491f-ac1c-cb1b0a52adab tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:37.866151 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-c2995144-108e-491f-ac1c-cb1b0a52adab tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:37.872780 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c2995144-108e-491f-ac1c-cb1b0a52adab tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:37.873226 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c2995144-108e-491f-ac1c-cb1b0a52adab tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:37.874046 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c2995144-108e-491f-ac1c-cb1b0a52adab tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:37.874464 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c2995144-108e-491f-ac1c-cb1b0a52adab tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:37.957615 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-95967e4c-1865-4fc7-a8b0-2766ac95fe97 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:37.971020 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-95967e4c-1865-4fc7-a8b0-2766ac95fe97 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1520 microversion: 2.1 time: 0.229377 Jul 20 19:24:37.981415 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 74/156] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:37 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1520 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:38.064493 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-c2995144-108e-491f-ac1c-cb1b0a52adab tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:38.076381 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-c2995144-108e-491f-ac1c-cb1b0a52adab tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a" status: 200 len: 1364 microversion: 2.1 time: 0.216528 Jul 20 19:24:38.086641 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 83/157] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:37 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a => generated 1364 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:24:38.754207 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-3254d05d-4361-4620-b52c-1eb141348ddf tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:38.754944 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-3254d05d-4361-4620-b52c-1eb141348ddf tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:38.762526 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3254d05d-4361-4620-b52c-1eb141348ddf tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:38.763253 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3254d05d-4361-4620-b52c-1eb141348ddf tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:38.764418 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3254d05d-4361-4620-b52c-1eb141348ddf tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:38.765089 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3254d05d-4361-4620-b52c-1eb141348ddf tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:38.841261 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-b29b4aed-964f-4362-aaf2-41de0cff3168 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:38.842063 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-b29b4aed-964f-4362-aaf2-41de0cff3168 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: af2baaf9-da80-407f-b960-d6b31aa82e24] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:38.852710 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b29b4aed-964f-4362-aaf2-41de0cff3168 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:38.853332 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b29b4aed-964f-4362-aaf2-41de0cff3168 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:38.854256 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b29b4aed-964f-4362-aaf2-41de0cff3168 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:38.854819 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b29b4aed-964f-4362-aaf2-41de0cff3168 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:38.931940 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-b29b4aed-964f-4362-aaf2-41de0cff3168 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:38.944743 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-b29b4aed-964f-4362-aaf2-41de0cff3168 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24" status: 200 len: 1266 microversion: 2.1 time: 0.107588 Jul 20 19:24:38.956664 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 84/158] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:38 2022] GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24 => generated 1266 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:24:38.990565 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-981b5e9a-8242-4533-983d-df09d8d82563 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:38.991611 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-981b5e9a-8242-4533-983d-df09d8d82563 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:38.995209 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_api:SELECT=100 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:39.008125 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-981b5e9a-8242-4533-983d-df09d8d82563 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:39.009425 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-981b5e9a-8242-4533-983d-df09d8d82563 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:39.012327 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-981b5e9a-8242-4533-983d-df09d8d82563 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:39.013433 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-981b5e9a-8242-4533-983d-df09d8d82563 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:39.018290 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3254d05d-4361-4620-b52c-1eb141348ddf tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:39.029315 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3254d05d-4361-4620-b52c-1eb141348ddf tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:39.031471 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3254d05d-4361-4620-b52c-1eb141348ddf tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:39.032995 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-3254d05d-4361-4620-b52c-1eb141348ddf tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1405 microversion: 2.20 time: 0.283501 Jul 20 19:24:39.044785 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:39.046742 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 75/159] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:24:38 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1405 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:24:39.097401 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-1c3dcc78-a358-4c89-b35b-5ae1cc50a2cb tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:39.098136 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-1c3dcc78-a358-4c89-b35b-5ae1cc50a2cb tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:39.107133 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1c3dcc78-a358-4c89-b35b-5ae1cc50a2cb tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:39.107935 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1c3dcc78-a358-4c89-b35b-5ae1cc50a2cb tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:39.109551 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1c3dcc78-a358-4c89-b35b-5ae1cc50a2cb tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:39.110173 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1c3dcc78-a358-4c89-b35b-5ae1cc50a2cb tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:39.274246 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-981b5e9a-8242-4533-983d-df09d8d82563 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:39.289373 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-981b5e9a-8242-4533-983d-df09d8d82563 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1520 microversion: 2.1 time: 0.304075 Jul 20 19:24:39.289931 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 85/160] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:38 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1520 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:39.391258 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1c3dcc78-a358-4c89-b35b-5ae1cc50a2cb tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:39.407722 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-1c3dcc78-a358-4c89-b35b-5ae1cc50a2cb tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a" status: 200 len: 1364 microversion: 2.1 time: 0.316793 Jul 20 19:24:39.409290 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 76/161] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:39 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a => generated 1364 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:24:39.964247 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-d4535a95-5a95-43e6-ac26-ddd4a8f95ea1 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:39.965813 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-d4535a95-5a95-43e6-ac26-ddd4a8f95ea1 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: af2baaf9-da80-407f-b960-d6b31aa82e24] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:39.972641 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d4535a95-5a95-43e6-ac26-ddd4a8f95ea1 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:39.973082 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d4535a95-5a95-43e6-ac26-ddd4a8f95ea1 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:39.974053 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d4535a95-5a95-43e6-ac26-ddd4a8f95ea1 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:39.974822 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d4535a95-5a95-43e6-ac26-ddd4a8f95ea1 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:40.054837 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-fdffb036-11db-4e11-ad94-34b7b11dd576 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:40.055766 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-fdffb036-11db-4e11-ad94-34b7b11dd576 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:40.066621 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fdffb036-11db-4e11-ad94-34b7b11dd576 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:40.067415 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fdffb036-11db-4e11-ad94-34b7b11dd576 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:40.071749 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fdffb036-11db-4e11-ad94-34b7b11dd576 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:40.072503 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fdffb036-11db-4e11-ad94-34b7b11dd576 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:40.096636 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-d4535a95-5a95-43e6-ac26-ddd4a8f95ea1 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:40.106176 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-d4535a95-5a95-43e6-ac26-ddd4a8f95ea1 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24" status: 200 len: 1274 microversion: 2.1 time: 0.146739 Jul 20 19:24:40.106988 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 86/162] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:39 2022] GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24 => generated 1274 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:40.313667 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-d7a90d8b-1991-4f3f-9495-cae5d60fcb17 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:40.315452 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-d7a90d8b-1991-4f3f-9495-cae5d60fcb17 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:40.328199 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d7a90d8b-1991-4f3f-9495-cae5d60fcb17 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:40.330056 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d7a90d8b-1991-4f3f-9495-cae5d60fcb17 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:40.331824 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d7a90d8b-1991-4f3f-9495-cae5d60fcb17 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:40.332828 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d7a90d8b-1991-4f3f-9495-cae5d60fcb17 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:40.373887 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-fdffb036-11db-4e11-ad94-34b7b11dd576 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:40.392142 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-fdffb036-11db-4e11-ad94-34b7b11dd576 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:40.397252 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-fdffb036-11db-4e11-ad94-34b7b11dd576 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:40.398732 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-fdffb036-11db-4e11-ad94-34b7b11dd576 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1405 microversion: 2.20 time: 0.349216 Jul 20 19:24:40.401741 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 77/163] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:24:40 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1405 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:24:40.431353 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-7f116c20-59b1-45b8-af36-acb13fc6229c tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:40.432304 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-7f116c20-59b1-45b8-af36-acb13fc6229c tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:40.442313 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7f116c20-59b1-45b8-af36-acb13fc6229c tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:40.447717 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7f116c20-59b1-45b8-af36-acb13fc6229c tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:40.449292 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7f116c20-59b1-45b8-af36-acb13fc6229c tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:40.449990 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7f116c20-59b1-45b8-af36-acb13fc6229c tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:40.745656 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-d7a90d8b-1991-4f3f-9495-cae5d60fcb17 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:40.754262 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-d7a90d8b-1991-4f3f-9495-cae5d60fcb17 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1520 microversion: 2.1 time: 0.450217 Jul 20 19:24:40.756652 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 87/164] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:40 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1520 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:24:40.834455 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-7f116c20-59b1-45b8-af36-acb13fc6229c tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:40.844789 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-7f116c20-59b1-45b8-af36-acb13fc6229c tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a" status: 200 len: 1364 microversion: 2.1 time: 0.419022 Jul 20 19:24:40.845618 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 78/165] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:40 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a => generated 1364 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:41.133335 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-5a3fd4d6-cf52-41c6-a5f6-621102d3e8ea tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:41.134130 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-5a3fd4d6-cf52-41c6-a5f6-621102d3e8ea tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: af2baaf9-da80-407f-b960-d6b31aa82e24] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:41.142348 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-5a3fd4d6-cf52-41c6-a5f6-621102d3e8ea tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:41.142866 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-5a3fd4d6-cf52-41c6-a5f6-621102d3e8ea tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:41.144328 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-5a3fd4d6-cf52-41c6-a5f6-621102d3e8ea tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:41.146837 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-5a3fd4d6-cf52-41c6-a5f6-621102d3e8ea tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:41.212755 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-5a3fd4d6-cf52-41c6-a5f6-621102d3e8ea tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:41.222453 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-5a3fd4d6-cf52-41c6-a5f6-621102d3e8ea tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24" status: 200 len: 1284 microversion: 2.1 time: 0.093650 Jul 20 19:24:41.223152 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 88/166] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:41 2022] GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24 => generated 1284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:41.434585 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-89e29faa-8765-4bb7-9d86-c83014d8991d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:41.435184 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-89e29faa-8765-4bb7-9d86-c83014d8991d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:41.440981 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:41.443642 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-89e29faa-8765-4bb7-9d86-c83014d8991d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:41.444319 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-89e29faa-8765-4bb7-9d86-c83014d8991d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:41.445915 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-89e29faa-8765-4bb7-9d86-c83014d8991d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:41.446510 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-89e29faa-8765-4bb7-9d86-c83014d8991d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:41.711933 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell0:SELECT=2 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:41.774012 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-cfc70a2e-ed72-4176-b736-8ee0f564f8ea tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:41.774591 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-cfc70a2e-ed72-4176-b736-8ee0f564f8ea tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:41.784106 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-cfc70a2e-ed72-4176-b736-8ee0f564f8ea tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:41.789153 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-cfc70a2e-ed72-4176-b736-8ee0f564f8ea tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:41.791374 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-cfc70a2e-ed72-4176-b736-8ee0f564f8ea tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:41.793573 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-cfc70a2e-ed72-4176-b736-8ee0f564f8ea tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:41.906324 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell0:SELECT=8 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:42.014686 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-89e29faa-8765-4bb7-9d86-c83014d8991d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:42.025605 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-89e29faa-8765-4bb7-9d86-c83014d8991d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:42.027203 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-89e29faa-8765-4bb7-9d86-c83014d8991d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:42.029499 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-89e29faa-8765-4bb7-9d86-c83014d8991d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1405 microversion: 2.20 time: 0.598541 Jul 20 19:24:42.030702 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 79/167] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:24:41 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1405 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:24:42.040280 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-1d09dda0-c371-4ee0-8688-5da43ff5e4fd tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:42.041740 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-1d09dda0-c371-4ee0-8688-5da43ff5e4fd tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:42.057343 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1d09dda0-c371-4ee0-8688-5da43ff5e4fd tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:42.058118 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1d09dda0-c371-4ee0-8688-5da43ff5e4fd tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:42.059350 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1d09dda0-c371-4ee0-8688-5da43ff5e4fd tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:42.059997 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1d09dda0-c371-4ee0-8688-5da43ff5e4fd tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:42.174771 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-cfc70a2e-ed72-4176-b736-8ee0f564f8ea tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:42.184539 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-cfc70a2e-ed72-4176-b736-8ee0f564f8ea tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1520 microversion: 2.1 time: 0.414904 Jul 20 19:24:42.196390 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 89/168] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:41 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1520 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:24:42.247707 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-eac6e876-0df1-4547-9a86-47a282e55553 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:42.250189 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-eac6e876-0df1-4547-9a86-47a282e55553 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: af2baaf9-da80-407f-b960-d6b31aa82e24] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:42.259036 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1d09dda0-c371-4ee0-8688-5da43ff5e4fd tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:42.271765 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-eac6e876-0df1-4547-9a86-47a282e55553 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:42.271962 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-1d09dda0-c371-4ee0-8688-5da43ff5e4fd tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a" status: 200 len: 1550 microversion: 2.1 time: 0.238804 Jul 20 19:24:42.272722 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-eac6e876-0df1-4547-9a86-47a282e55553 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:42.273859 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-eac6e876-0df1-4547-9a86-47a282e55553 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:42.274914 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-eac6e876-0df1-4547-9a86-47a282e55553 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:42.282861 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 80/169] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:42 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a => generated 1550 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:42.292881 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-af841c9d-e5f2-47c4-8fbe-34344092e603 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:42.293439 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-af841c9d-e5f2-47c4-8fbe-34344092e603 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:42.300222 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-af841c9d-e5f2-47c4-8fbe-34344092e603 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:42.301259 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-af841c9d-e5f2-47c4-8fbe-34344092e603 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:42.303629 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-af841c9d-e5f2-47c4-8fbe-34344092e603 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:42.304261 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-af841c9d-e5f2-47c4-8fbe-34344092e603 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:42.430547 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-eac6e876-0df1-4547-9a86-47a282e55553 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:42.444976 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-af841c9d-e5f2-47c4-8fbe-34344092e603 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.158375 Jul 20 19:24:42.446355 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 81/170] 10.222.0.69 () {58 vars in 1274 bytes} [Wed Jul 20 19:24:42 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a/os-interface => generated 284 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:24:42.447547 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-eac6e876-0df1-4547-9a86-47a282e55553 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24" status: 200 len: 1272 microversion: 2.1 time: 0.210201 Jul 20 19:24:42.448820 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 90/171] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:42 2022] GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24 => generated 1272 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:43.051679 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ca5c6c97-2d5e-4c08-b1fe-c1d99f1a9eb2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:43.053527 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ca5c6c97-2d5e-4c08-b1fe-c1d99f1a9eb2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:43.061402 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ca5c6c97-2d5e-4c08-b1fe-c1d99f1a9eb2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:43.063416 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ca5c6c97-2d5e-4c08-b1fe-c1d99f1a9eb2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:43.065219 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ca5c6c97-2d5e-4c08-b1fe-c1d99f1a9eb2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:43.066103 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ca5c6c97-2d5e-4c08-b1fe-c1d99f1a9eb2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:43.202691 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-8106c217-8e53-419e-bd4f-273cf31c4e16 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:43.203302 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-8106c217-8e53-419e-bd4f-273cf31c4e16 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:43.215652 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8106c217-8e53-419e-bd4f-273cf31c4e16 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:43.216320 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8106c217-8e53-419e-bd4f-273cf31c4e16 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:43.217651 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8106c217-8e53-419e-bd4f-273cf31c4e16 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:43.224430 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8106c217-8e53-419e-bd4f-273cf31c4e16 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:43.414970 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ca5c6c97-2d5e-4c08-b1fe-c1d99f1a9eb2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:43.426658 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ca5c6c97-2d5e-4c08-b1fe-c1d99f1a9eb2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:43.430780 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ca5c6c97-2d5e-4c08-b1fe-c1d99f1a9eb2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:43.434274 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ca5c6c97-2d5e-4c08-b1fe-c1d99f1a9eb2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1598 microversion: 2.20 time: 0.389167 Jul 20 19:24:43.434862 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 82/172] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:24:43 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1598 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:24:43.455267 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-f5ce0d85-2661-48dd-9f37-0654bcd377ea tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:43.456504 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-f5ce0d85-2661-48dd-9f37-0654bcd377ea tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:43.475308 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f5ce0d85-2661-48dd-9f37-0654bcd377ea tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:43.475877 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f5ce0d85-2661-48dd-9f37-0654bcd377ea tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:43.476674 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f5ce0d85-2661-48dd-9f37-0654bcd377ea tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:43.477351 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f5ce0d85-2661-48dd-9f37-0654bcd377ea tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:43.712172 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-f5ce0d85-2661-48dd-9f37-0654bcd377ea tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.260125 Jul 20 19:24:43.719052 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 83/173] 10.222.0.69 () {60 vars in 1315 bytes} [Wed Jul 20 19:24:43 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55/os-interface => generated 285 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 19:24:43.720866 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-f77902a6-b308-4712-83d2-6b227c6d9569 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:43.725221 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-f77902a6-b308-4712-83d2-6b227c6d9569 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: af2baaf9-da80-407f-b960-d6b31aa82e24] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:43.744618 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f77902a6-b308-4712-83d2-6b227c6d9569 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:43.745559 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f77902a6-b308-4712-83d2-6b227c6d9569 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:43.746880 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f77902a6-b308-4712-83d2-6b227c6d9569 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:43.747438 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f77902a6-b308-4712-83d2-6b227c6d9569 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:43.923249 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-8106c217-8e53-419e-bd4f-273cf31c4e16 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:43.933700 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-8106c217-8e53-419e-bd4f-273cf31c4e16 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1520 microversion: 2.1 time: 0.735155 Jul 20 19:24:43.938053 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 91/174] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:43 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1520 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:44.441210 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-f77902a6-b308-4712-83d2-6b227c6d9569 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:44.452883 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-f77902a6-b308-4712-83d2-6b227c6d9569 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24" status: 200 len: 1314 microversion: 2.1 time: 0.738604 Jul 20 19:24:44.454366 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 84/175] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:43 2022] GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24 => generated 1314 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:44.618134 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [req-e928f0be-dd96-4076-8d13-2f7205e4b0dc req-fa2b277d-eed9-4c59-937e-dcd4ef2a974d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c33037ed-7b36-43aa-85ad-e48920801b0a", "tag": "d530fbe6-76ab-41fc-9fa3-b088835bc0da"}]} {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:24:44.628557 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [req-e928f0be-dd96-4076-8d13-2f7205e4b0dc req-fa2b277d-eed9-4c59-937e-dcd4ef2a974d service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:44.629089 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [req-e928f0be-dd96-4076-8d13-2f7205e4b0dc req-fa2b277d-eed9-4c59-937e-dcd4ef2a974d service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:44.648234 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.compute.server_external_events [req-e928f0be-dd96-4076-8d13-2f7205e4b0dc req-fa2b277d-eed9-4c59-937e-dcd4ef2a974d service nova] Creating event network-changed:d530fbe6-76ab-41fc-9fa3-b088835bc0da for instance c33037ed-7b36-43aa-85ad-e48920801b0a on hv-cinder-83538 Jul 20 19:24:44.654911 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [req-e928f0be-dd96-4076-8d13-2f7205e4b0dc req-fa2b277d-eed9-4c59-937e-dcd4ef2a974d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043080 Jul 20 19:24:44.660230 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 92/176] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 19:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:24:44.968760 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4568ba81-c069-440b-b5c0-4e24bd9be0c0 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:44.970073 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-4568ba81-c069-440b-b5c0-4e24bd9be0c0 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:44.980623 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4568ba81-c069-440b-b5c0-4e24bd9be0c0 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:44.981310 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4568ba81-c069-440b-b5c0-4e24bd9be0c0 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:44.982473 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4568ba81-c069-440b-b5c0-4e24bd9be0c0 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:44.983277 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4568ba81-c069-440b-b5c0-4e24bd9be0c0 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:45.478176 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-bd5a98b3-878e-417f-8198-f1a6dd02a23c tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:45.479701 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-bd5a98b3-878e-417f-8198-f1a6dd02a23c tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: af2baaf9-da80-407f-b960-d6b31aa82e24] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:45.492314 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-bd5a98b3-878e-417f-8198-f1a6dd02a23c tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:45.493448 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-bd5a98b3-878e-417f-8198-f1a6dd02a23c tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:45.497849 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-bd5a98b3-878e-417f-8198-f1a6dd02a23c tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:45.498721 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-bd5a98b3-878e-417f-8198-f1a6dd02a23c tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:45.613978 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-4568ba81-c069-440b-b5c0-4e24bd9be0c0 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:45.633868 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-4568ba81-c069-440b-b5c0-4e24bd9be0c0 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1520 microversion: 2.1 time: 0.681255 Jul 20 19:24:45.634466 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 85/177] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:44 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1520 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:45.770109 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-bd5a98b3-878e-417f-8198-f1a6dd02a23c tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:45.778603 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-bd5a98b3-878e-417f-8198-f1a6dd02a23c tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24" status: 200 len: 1314 microversion: 2.1 time: 0.308453 Jul 20 19:24:45.779768 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 93/178] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:45 2022] GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24 => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:46.651531 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-b5380f62-7a5b-47e9-912e-5cdb397ded8d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:46.652225 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-b5380f62-7a5b-47e9-912e-5cdb397ded8d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:46.661970 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b5380f62-7a5b-47e9-912e-5cdb397ded8d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:46.664470 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b5380f62-7a5b-47e9-912e-5cdb397ded8d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:46.666442 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b5380f62-7a5b-47e9-912e-5cdb397ded8d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:46.669818 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b5380f62-7a5b-47e9-912e-5cdb397ded8d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:46.798145 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-7a692acf-bd74-41f2-933b-4a3d1e5fe994 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:46.799615 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-7a692acf-bd74-41f2-933b-4a3d1e5fe994 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: af2baaf9-da80-407f-b960-d6b31aa82e24] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:46.811629 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-7a692acf-bd74-41f2-933b-4a3d1e5fe994 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:46.812142 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-7a692acf-bd74-41f2-933b-4a3d1e5fe994 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:46.813262 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-7a692acf-bd74-41f2-933b-4a3d1e5fe994 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:46.814941 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-7a692acf-bd74-41f2-933b-4a3d1e5fe994 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:47.221455 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-7a692acf-bd74-41f2-933b-4a3d1e5fe994 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:47.243416 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-7a692acf-bd74-41f2-933b-4a3d1e5fe994 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24" status: 200 len: 1314 microversion: 2.1 time: 0.449683 Jul 20 19:24:47.255467 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 94/179] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:46 2022] GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24 => generated 1314 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:24:47.264859 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [req-b4ed9790-1e91-4c05-b628-268ddbbab5b6 req-222156a0-0cf6-4daf-b722-e82e97c7cbd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af2baaf9-da80-407f-b960-d6b31aa82e24", "tag": "e13796a3-31bf-4f68-b72e-d9d7c014953b"}]} {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:24:47.265948 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-b5380f62-7a5b-47e9-912e-5cdb397ded8d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:47.274971 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [req-b4ed9790-1e91-4c05-b628-268ddbbab5b6 req-222156a0-0cf6-4daf-b722-e82e97c7cbd0 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:47.275187 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-b5380f62-7a5b-47e9-912e-5cdb397ded8d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1520 microversion: 2.1 time: 0.628283 Jul 20 19:24:47.275755 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [req-b4ed9790-1e91-4c05-b628-268ddbbab5b6 req-222156a0-0cf6-4daf-b722-e82e97c7cbd0 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:47.287762 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 86/180] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:46 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1520 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:24:47.297293 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-0e80823d-53db-49ad-94cc-db8b681e6622 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:47.298086 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-0e80823d-53db-49ad-94cc-db8b681e6622 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] [instance: 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:47.299341 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.compute.server_external_events [req-b4ed9790-1e91-4c05-b628-268ddbbab5b6 req-222156a0-0cf6-4daf-b722-e82e97c7cbd0 service nova] Creating event network-changed:e13796a3-31bf-4f68-b72e-d9d7c014953b for instance af2baaf9-da80-407f-b960-d6b31aa82e24 on hv-cinder-83538 Jul 20 19:24:47.306314 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0e80823d-53db-49ad-94cc-db8b681e6622 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:47.307013 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0e80823d-53db-49ad-94cc-db8b681e6622 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:47.308095 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0e80823d-53db-49ad-94cc-db8b681e6622 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:47.308286 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [req-b4ed9790-1e91-4c05-b628-268ddbbab5b6 req-222156a0-0cf6-4daf-b722-e82e97c7cbd0 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046734 Jul 20 19:24:47.308716 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0e80823d-53db-49ad-94cc-db8b681e6622 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:47.310005 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 95/181] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 19:24:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:24:47.350966 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-0e80823d-53db-49ad-94cc-db8b681e6622 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] [instance: 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c] Going to try to terminate instance {{(pid=117761) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 19:24:47.491849 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-0e80823d-53db-49ad-94cc-db8b681e6622 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] 10.222.0.69 "DELETE /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c" status: 204 len: 0 microversion: 2.1 time: 0.201725 Jul 20 19:24:47.493045 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 87/182] 10.222.0.69 () {58 vars in 1238 bytes} [Wed Jul 20 19:24:47 2022] DELETE /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 19:24:47.503630 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-22d33879-96dc-4edb-ae37-119807c9fe03 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:47.505140 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-22d33879-96dc-4edb-ae37-119807c9fe03 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] [instance: 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:47.518476 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-22d33879-96dc-4edb-ae37-119807c9fe03 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:47.521197 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-22d33879-96dc-4edb-ae37-119807c9fe03 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:47.523220 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-22d33879-96dc-4edb-ae37-119807c9fe03 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:47.524852 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-22d33879-96dc-4edb-ae37-119807c9fe03 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:47.707327 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-22d33879-96dc-4edb-ae37-119807c9fe03 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb901faa8e9410484f83e47e5bcfa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e0691b14804cc5b4fe120fc5dea871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:47.716472 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-22d33879-96dc-4edb-ae37-119807c9fe03 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] 10.222.0.69 "GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c" status: 200 len: 1554 microversion: 2.1 time: 0.219006 Jul 20 19:24:47.717993 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 96/183] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:47 2022] GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c => generated 1554 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:48.262275 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-b958326b-4015-408f-981e-744ecdc531be tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:48.264248 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-b958326b-4015-408f-981e-744ecdc531be tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: af2baaf9-da80-407f-b960-d6b31aa82e24] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:48.271975 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b958326b-4015-408f-981e-744ecdc531be tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:48.273110 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b958326b-4015-408f-981e-744ecdc531be tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:48.275035 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b958326b-4015-408f-981e-744ecdc531be tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:48.275649 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b958326b-4015-408f-981e-744ecdc531be tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:48.295689 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-04dab7e5-70bb-4da4-b576-4ec5b8294105 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:48.296363 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-04dab7e5-70bb-4da4-b576-4ec5b8294105 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:48.304176 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-04dab7e5-70bb-4da4-b576-4ec5b8294105 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:48.307669 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-04dab7e5-70bb-4da4-b576-4ec5b8294105 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:48.308587 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-04dab7e5-70bb-4da4-b576-4ec5b8294105 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:48.309034 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-04dab7e5-70bb-4da4-b576-4ec5b8294105 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:48.472079 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-b958326b-4015-408f-981e-744ecdc531be tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:48.475351 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:48.484824 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-b958326b-4015-408f-981e-744ecdc531be tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24" status: 200 len: 1314 microversion: 2.1 time: 0.227677 Jul 20 19:24:48.485408 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 88/184] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:48 2022] GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24 => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:48.522468 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-04dab7e5-70bb-4da4-b576-4ec5b8294105 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:48.530474 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-04dab7e5-70bb-4da4-b576-4ec5b8294105 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1520 microversion: 2.1 time: 0.238585 Jul 20 19:24:48.531052 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 97/185] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:48 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1520 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:48.734820 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ee286070-17ca-4ca5-a104-9c5b430dbe66 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:48.736076 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ee286070-17ca-4ca5-a104-9c5b430dbe66 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] [instance: 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:48.742977 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ee286070-17ca-4ca5-a104-9c5b430dbe66 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:48.743483 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ee286070-17ca-4ca5-a104-9c5b430dbe66 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:48.744269 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ee286070-17ca-4ca5-a104-9c5b430dbe66 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:48.744697 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ee286070-17ca-4ca5-a104-9c5b430dbe66 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:48.910023 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ee286070-17ca-4ca5-a104-9c5b430dbe66 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb901faa8e9410484f83e47e5bcfa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e0691b14804cc5b4fe120fc5dea871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:48.923386 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ee286070-17ca-4ca5-a104-9c5b430dbe66 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] 10.222.0.69 "GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c" status: 200 len: 1554 microversion: 2.1 time: 0.192283 Jul 20 19:24:48.923979 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 89/186] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:48 2022] GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c => generated 1554 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:49.324396 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [req-4f379be9-471a-4da9-a4a3-ac642cbe92d5 req-f34559c9-3851-4ff2-94d7-739e3ff6639a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b2abd53-4758-462c-b36a-0d1bf0b66a55", "tag": "3232872d-df06-40e7-a7c3-7cc3babe684d"}]} {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:24:49.334659 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [req-4f379be9-471a-4da9-a4a3-ac642cbe92d5 req-f34559c9-3851-4ff2-94d7-739e3ff6639a service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:49.335108 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [req-4f379be9-471a-4da9-a4a3-ac642cbe92d5 req-f34559c9-3851-4ff2-94d7-739e3ff6639a service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:49.346841 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.compute.server_external_events [req-4f379be9-471a-4da9-a4a3-ac642cbe92d5 req-f34559c9-3851-4ff2-94d7-739e3ff6639a service nova] Creating event network-changed:3232872d-df06-40e7-a7c3-7cc3babe684d for instance 3b2abd53-4758-462c-b36a-0d1bf0b66a55 on hv-cinder-83538 Jul 20 19:24:49.352699 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [req-4f379be9-471a-4da9-a4a3-ac642cbe92d5 req-f34559c9-3851-4ff2-94d7-739e3ff6639a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031848 Jul 20 19:24:49.353299 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 98/187] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 19:24:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:24:49.506579 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-0d33d18e-58c5-432f-b542-b09bc4b3b7cf tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:49.508077 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-0d33d18e-58c5-432f-b542-b09bc4b3b7cf tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: af2baaf9-da80-407f-b960-d6b31aa82e24] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:49.518752 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0d33d18e-58c5-432f-b542-b09bc4b3b7cf tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:49.520084 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0d33d18e-58c5-432f-b542-b09bc4b3b7cf tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:49.521904 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0d33d18e-58c5-432f-b542-b09bc4b3b7cf tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:49.522706 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0d33d18e-58c5-432f-b542-b09bc4b3b7cf tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:49.549531 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-905b6610-aa85-4a91-8480-c6eddeb40bc1 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:49.550227 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-905b6610-aa85-4a91-8480-c6eddeb40bc1 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:49.561230 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-905b6610-aa85-4a91-8480-c6eddeb40bc1 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:49.561721 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-905b6610-aa85-4a91-8480-c6eddeb40bc1 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:49.566784 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-905b6610-aa85-4a91-8480-c6eddeb40bc1 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:49.567356 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-905b6610-aa85-4a91-8480-c6eddeb40bc1 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:49.733018 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0d33d18e-58c5-432f-b542-b09bc4b3b7cf tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:49.745334 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-0d33d18e-58c5-432f-b542-b09bc4b3b7cf tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24" status: 200 len: 1314 microversion: 2.1 time: 0.244797 Jul 20 19:24:49.746129 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 90/188] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:49 2022] GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24 => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:49.760080 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-905b6610-aa85-4a91-8480-c6eddeb40bc1 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:49.792830 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-905b6610-aa85-4a91-8480-c6eddeb40bc1 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1520 microversion: 2.1 time: 0.224202 Jul 20 19:24:49.796048 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 99/189] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:49 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1520 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:24:49.941396 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-05900794-8054-4ec3-a384-e0af673f0948 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:49.943107 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-05900794-8054-4ec3-a384-e0af673f0948 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] [instance: 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:49.949185 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-05900794-8054-4ec3-a384-e0af673f0948 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:49.949696 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-05900794-8054-4ec3-a384-e0af673f0948 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:49.950540 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-05900794-8054-4ec3-a384-e0af673f0948 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:49.950986 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-05900794-8054-4ec3-a384-e0af673f0948 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:50.185503 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-05900794-8054-4ec3-a384-e0af673f0948 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb901faa8e9410484f83e47e5bcfa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e0691b14804cc5b4fe120fc5dea871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:50.193935 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-05900794-8054-4ec3-a384-e0af673f0948 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] 10.222.0.69 "GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c" status: 200 len: 1554 microversion: 2.1 time: 0.256538 Jul 20 19:24:50.203241 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 91/190] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:49 2022] GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c => generated 1554 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:50.763124 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-df4a292a-56c7-4de8-bf33-e25386226dd6 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:50.764157 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-df4a292a-56c7-4de8-bf33-e25386226dd6 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: af2baaf9-da80-407f-b960-d6b31aa82e24] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:50.771577 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-df4a292a-56c7-4de8-bf33-e25386226dd6 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:50.772018 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-df4a292a-56c7-4de8-bf33-e25386226dd6 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:50.772894 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-df4a292a-56c7-4de8-bf33-e25386226dd6 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:50.776206 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-df4a292a-56c7-4de8-bf33-e25386226dd6 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:50.815784 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ee9d5102-a60b-405e-bf8e-e6f5f823c6e5 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:50.817015 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ee9d5102-a60b-405e-bf8e-e6f5f823c6e5 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:50.824857 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ee9d5102-a60b-405e-bf8e-e6f5f823c6e5 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:50.825315 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ee9d5102-a60b-405e-bf8e-e6f5f823c6e5 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:50.826132 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ee9d5102-a60b-405e-bf8e-e6f5f823c6e5 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:50.826654 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ee9d5102-a60b-405e-bf8e-e6f5f823c6e5 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:50.936710 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-df4a292a-56c7-4de8-bf33-e25386226dd6 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:50.950023 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-df4a292a-56c7-4de8-bf33-e25386226dd6 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24" status: 200 len: 1314 microversion: 2.1 time: 0.190698 Jul 20 19:24:50.950607 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 100/191] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:50 2022] GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:24:50.999658 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ee9d5102-a60b-405e-bf8e-e6f5f823c6e5 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:51.008281 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ee9d5102-a60b-405e-bf8e-e6f5f823c6e5 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1520 microversion: 2.1 time: 0.200011 Jul 20 19:24:51.008851 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 92/192] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:50 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1520 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:24:51.210882 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-f66e45b8-8ba5-4ae8-8069-249285f2a634 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:51.211591 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-f66e45b8-8ba5-4ae8-8069-249285f2a634 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] [instance: 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:51.218523 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f66e45b8-8ba5-4ae8-8069-249285f2a634 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:51.218979 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f66e45b8-8ba5-4ae8-8069-249285f2a634 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:51.219762 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f66e45b8-8ba5-4ae8-8069-249285f2a634 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:51.220188 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f66e45b8-8ba5-4ae8-8069-249285f2a634 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:51.571784 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-f66e45b8-8ba5-4ae8-8069-249285f2a634 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb901faa8e9410484f83e47e5bcfa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e0691b14804cc5b4fe120fc5dea871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:51.580276 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-f66e45b8-8ba5-4ae8-8069-249285f2a634 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] 10.222.0.69 "GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c" status: 200 len: 1554 microversion: 2.1 time: 0.373127 Jul 20 19:24:51.580799 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 101/193] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:51 2022] GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c => generated 1554 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:51.967082 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-af4ab20b-e054-4265-9557-7a5d9f5fc59a tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:51.967689 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-af4ab20b-e054-4265-9557-7a5d9f5fc59a tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: af2baaf9-da80-407f-b960-d6b31aa82e24] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:51.974221 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-af4ab20b-e054-4265-9557-7a5d9f5fc59a tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:51.974661 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-af4ab20b-e054-4265-9557-7a5d9f5fc59a tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:51.975411 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-af4ab20b-e054-4265-9557-7a5d9f5fc59a tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:51.975837 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-af4ab20b-e054-4265-9557-7a5d9f5fc59a tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:52.027091 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-41eeff7e-b9b4-4280-a5aa-2d4b737ebbd0 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:52.027826 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-41eeff7e-b9b4-4280-a5aa-2d4b737ebbd0 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:52.033924 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-41eeff7e-b9b4-4280-a5aa-2d4b737ebbd0 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:52.034441 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-41eeff7e-b9b4-4280-a5aa-2d4b737ebbd0 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:52.035269 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-41eeff7e-b9b4-4280-a5aa-2d4b737ebbd0 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:52.035770 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-41eeff7e-b9b4-4280-a5aa-2d4b737ebbd0 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:52.116499 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-af4ab20b-e054-4265-9557-7a5d9f5fc59a tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:52.137690 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-af4ab20b-e054-4265-9557-7a5d9f5fc59a tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24" status: 200 len: 1314 microversion: 2.1 time: 0.174270 Jul 20 19:24:52.138632 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 93/194] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:51 2022] GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:52.184525 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-41eeff7e-b9b4-4280-a5aa-2d4b737ebbd0 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:52.191724 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-41eeff7e-b9b4-4280-a5aa-2d4b737ebbd0 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1520 microversion: 2.1 time: 0.168450 Jul 20 19:24:52.192860 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 102/195] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:52 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:52.598775 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-8537845e-579d-4a20-a4da-1d32f6d507b0 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:52.599555 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-8537845e-579d-4a20-a4da-1d32f6d507b0 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] [instance: 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:52.605484 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8537845e-579d-4a20-a4da-1d32f6d507b0 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:52.605953 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8537845e-579d-4a20-a4da-1d32f6d507b0 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:52.606690 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8537845e-579d-4a20-a4da-1d32f6d507b0 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:52.607112 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8537845e-579d-4a20-a4da-1d32f6d507b0 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:52.743981 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8537845e-579d-4a20-a4da-1d32f6d507b0 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb901faa8e9410484f83e47e5bcfa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e0691b14804cc5b4fe120fc5dea871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:52.751869 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-8537845e-579d-4a20-a4da-1d32f6d507b0 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] 10.222.0.69 "GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c" status: 200 len: 1554 microversion: 2.1 time: 0.157490 Jul 20 19:24:52.752433 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 94/196] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:52 2022] GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:53.164689 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-9f4c0c1b-aee7-4a6b-9b09-b3a914fb7901 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:53.165539 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-9f4c0c1b-aee7-4a6b-9b09-b3a914fb7901 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: af2baaf9-da80-407f-b960-d6b31aa82e24] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:53.172154 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9f4c0c1b-aee7-4a6b-9b09-b3a914fb7901 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:53.172600 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9f4c0c1b-aee7-4a6b-9b09-b3a914fb7901 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:53.173360 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9f4c0c1b-aee7-4a6b-9b09-b3a914fb7901 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:53.173814 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9f4c0c1b-aee7-4a6b-9b09-b3a914fb7901 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:53.209929 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-90fe5748-fdac-41d5-89a7-24126d5491fd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:53.210908 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-90fe5748-fdac-41d5-89a7-24126d5491fd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:53.219464 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-90fe5748-fdac-41d5-89a7-24126d5491fd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:53.219464 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-90fe5748-fdac-41d5-89a7-24126d5491fd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:53.219464 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-90fe5748-fdac-41d5-89a7-24126d5491fd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:53.219882 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-90fe5748-fdac-41d5-89a7-24126d5491fd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:53.337160 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-9f4c0c1b-aee7-4a6b-9b09-b3a914fb7901 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:53.346074 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-9f4c0c1b-aee7-4a6b-9b09-b3a914fb7901 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24" status: 200 len: 1314 microversion: 2.1 time: 0.186847 Jul 20 19:24:53.354738 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 103/197] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:53 2022] GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:53.386136 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-90fe5748-fdac-41d5-89a7-24126d5491fd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:53.393493 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-90fe5748-fdac-41d5-89a7-24126d5491fd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1520 microversion: 2.1 time: 0.188681 Jul 20 19:24:53.394088 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 95/198] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:53 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1520 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:53.769657 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-6e627756-de0c-42cf-836a-771c35439f46 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:53.771357 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-6e627756-de0c-42cf-836a-771c35439f46 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] [instance: 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:53.778278 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-6e627756-de0c-42cf-836a-771c35439f46 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:53.780161 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-6e627756-de0c-42cf-836a-771c35439f46 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:53.781363 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-6e627756-de0c-42cf-836a-771c35439f46 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:53.781844 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-6e627756-de0c-42cf-836a-771c35439f46 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:53.788631 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_cell1:SELECT=100 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:53.932739 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-6e627756-de0c-42cf-836a-771c35439f46 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb901faa8e9410484f83e47e5bcfa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e0691b14804cc5b4fe120fc5dea871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:53.940861 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-6e627756-de0c-42cf-836a-771c35439f46 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] 10.222.0.69 "GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c" status: 200 len: 1554 microversion: 2.1 time: 0.175148 Jul 20 19:24:53.941423 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 104/199] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:53 2022] GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c => generated 1554 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:54.366825 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-b66a8023-3a9e-4d64-94bd-b5d1accd0bc7 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:54.367490 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-b66a8023-3a9e-4d64-94bd-b5d1accd0bc7 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: af2baaf9-da80-407f-b960-d6b31aa82e24] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:54.374228 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b66a8023-3a9e-4d64-94bd-b5d1accd0bc7 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:54.374675 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b66a8023-3a9e-4d64-94bd-b5d1accd0bc7 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:54.375454 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b66a8023-3a9e-4d64-94bd-b5d1accd0bc7 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:54.375908 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b66a8023-3a9e-4d64-94bd-b5d1accd0bc7 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:54.412046 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-2e0488e0-c44e-4c2d-97c9-bebf9ebaaf71 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:54.413340 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-2e0488e0-c44e-4c2d-97c9-bebf9ebaaf71 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:54.420484 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2e0488e0-c44e-4c2d-97c9-bebf9ebaaf71 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:54.421216 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2e0488e0-c44e-4c2d-97c9-bebf9ebaaf71 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:54.422364 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2e0488e0-c44e-4c2d-97c9-bebf9ebaaf71 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:54.422833 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2e0488e0-c44e-4c2d-97c9-bebf9ebaaf71 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:54.652910 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-2e0488e0-c44e-4c2d-97c9-bebf9ebaaf71 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:54.654440 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-b66a8023-3a9e-4d64-94bd-b5d1accd0bc7 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:54.662703 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-2e0488e0-c44e-4c2d-97c9-bebf9ebaaf71 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1520 microversion: 2.1 time: 0.255503 Jul 20 19:24:54.663883 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 105/200] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:54 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1520 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:24:54.666938 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-b66a8023-3a9e-4d64-94bd-b5d1accd0bc7 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24" status: 200 len: 1314 microversion: 2.1 time: 0.305222 Jul 20 19:24:54.669307 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 96/201] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:54 2022] GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24 => generated 1314 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:54.960721 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-b156187a-4088-4699-b493-fbec48b1e969 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:54.961442 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-b156187a-4088-4699-b493-fbec48b1e969 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] [instance: 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:54.968386 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b156187a-4088-4699-b493-fbec48b1e969 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:54.968923 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b156187a-4088-4699-b493-fbec48b1e969 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:54.981188 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b156187a-4088-4699-b493-fbec48b1e969 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:54.981791 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b156187a-4088-4699-b493-fbec48b1e969 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:55.122698 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-b156187a-4088-4699-b493-fbec48b1e969 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb901faa8e9410484f83e47e5bcfa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e0691b14804cc5b4fe120fc5dea871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:55.131289 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-b156187a-4088-4699-b493-fbec48b1e969 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] 10.222.0.69 "GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c" status: 200 len: 1554 microversion: 2.1 time: 0.176204 Jul 20 19:24:55.131881 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 106/202] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:54 2022] GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c => generated 1554 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:55.674128 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [req-936833c4-5895-4830-962f-da854e3c12e7 req-4163c84e-d680-4064-b1db-01e9fea463a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3579edbc-f4b6-4ba1-beb5-a095d7d9c21c", "name": "network-vif-deleted", "tag": "ae517b12-2e27-423c-bb01-b994d91ccefb"}]} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:24:55.679642 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-829b869a-40ff-4b15-9554-a40c971a43ab tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:55.680795 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-829b869a-40ff-4b15-9554-a40c971a43ab tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:55.684394 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-936833c4-5895-4830-962f-da854e3c12e7 req-4163c84e-d680-4064-b1db-01e9fea463a0 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:55.684874 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-936833c4-5895-4830-962f-da854e3c12e7 req-4163c84e-d680-4064-b1db-01e9fea463a0 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:55.687699 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-829b869a-40ff-4b15-9554-a40c971a43ab tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:55.688150 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-829b869a-40ff-4b15-9554-a40c971a43ab tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:55.688911 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-829b869a-40ff-4b15-9554-a40c971a43ab tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:55.689534 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-829b869a-40ff-4b15-9554-a40c971a43ab tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:55.700179 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.compute.server_external_events [req-936833c4-5895-4830-962f-da854e3c12e7 req-4163c84e-d680-4064-b1db-01e9fea463a0 service nova] Creating event network-vif-deleted:ae517b12-2e27-423c-bb01-b994d91ccefb for instance 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c on hv-cinder-83538 Jul 20 19:24:55.705468 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [req-936833c4-5895-4830-962f-da854e3c12e7 req-4163c84e-d680-4064-b1db-01e9fea463a0 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034880 Jul 20 19:24:55.706163 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 97/203] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 19:24:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:24:55.722400 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-939b805d-f64d-44c7-9991-a0db5cd11174 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:55.723432 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-939b805d-f64d-44c7-9991-a0db5cd11174 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: af2baaf9-da80-407f-b960-d6b31aa82e24] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:55.732303 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-939b805d-f64d-44c7-9991-a0db5cd11174 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:55.732967 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-939b805d-f64d-44c7-9991-a0db5cd11174 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:55.733909 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-939b805d-f64d-44c7-9991-a0db5cd11174 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:55.734551 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-939b805d-f64d-44c7-9991-a0db5cd11174 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:55.885176 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-829b869a-40ff-4b15-9554-a40c971a43ab tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:55.893653 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-829b869a-40ff-4b15-9554-a40c971a43ab tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1520 microversion: 2.1 time: 0.217617 Jul 20 19:24:55.894342 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 107/204] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:55 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1520 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:55.916040 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-939b805d-f64d-44c7-9991-a0db5cd11174 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:55.924488 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-939b805d-f64d-44c7-9991-a0db5cd11174 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24" status: 200 len: 1314 microversion: 2.1 time: 0.216980 Jul 20 19:24:55.925046 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 98/205] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:55 2022] GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:56.149106 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-e09ac8b2-5c75-4ed8-9dda-0be2779edec3 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:56.149737 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-e09ac8b2-5c75-4ed8-9dda-0be2779edec3 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] [instance: 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:56.155797 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e09ac8b2-5c75-4ed8-9dda-0be2779edec3 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:56.156248 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e09ac8b2-5c75-4ed8-9dda-0be2779edec3 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:56.157000 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e09ac8b2-5c75-4ed8-9dda-0be2779edec3 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:56.157431 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e09ac8b2-5c75-4ed8-9dda-0be2779edec3 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:56.222554 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-e09ac8b2-5c75-4ed8-9dda-0be2779edec3 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb901faa8e9410484f83e47e5bcfa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e0691b14804cc5b4fe120fc5dea871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:56.232739 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-e09ac8b2-5c75-4ed8-9dda-0be2779edec3 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] 10.222.0.69 "GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c" status: 200 len: 1512 microversion: 2.1 time: 0.087982 Jul 20 19:24:56.233314 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 108/206] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:56 2022] GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c => generated 1512 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:56.911438 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-98e4b359-ace6-44ff-baeb-fe5750622e33 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:56.912077 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-98e4b359-ace6-44ff-baeb-fe5750622e33 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:56.918624 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-98e4b359-ace6-44ff-baeb-fe5750622e33 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:56.919072 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-98e4b359-ace6-44ff-baeb-fe5750622e33 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:56.919836 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-98e4b359-ace6-44ff-baeb-fe5750622e33 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:56.920271 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-98e4b359-ace6-44ff-baeb-fe5750622e33 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:56.942635 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-404a6132-0843-424a-b60e-f3b4e04b1cb0 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:56.943309 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-404a6132-0843-424a-b60e-f3b4e04b1cb0 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: af2baaf9-da80-407f-b960-d6b31aa82e24] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:56.949310 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-404a6132-0843-424a-b60e-f3b4e04b1cb0 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:56.949801 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-404a6132-0843-424a-b60e-f3b4e04b1cb0 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:56.950555 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-404a6132-0843-424a-b60e-f3b4e04b1cb0 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:56.950982 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-404a6132-0843-424a-b60e-f3b4e04b1cb0 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:57.062940 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-98e4b359-ace6-44ff-baeb-fe5750622e33 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:57.072332 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-98e4b359-ace6-44ff-baeb-fe5750622e33 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1520 microversion: 2.1 time: 0.164901 Jul 20 19:24:57.072898 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 99/207] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:56 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:57.098857 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-404a6132-0843-424a-b60e-f3b4e04b1cb0 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:57.106202 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-404a6132-0843-424a-b60e-f3b4e04b1cb0 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24" status: 200 len: 1314 microversion: 2.1 time: 0.168113 Jul 20 19:24:57.106706 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 109/208] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:56 2022] GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:24:57.249913 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-2c1db066-5819-4e8f-8b72-3dacd63ae080 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:57.250563 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-2c1db066-5819-4e8f-8b72-3dacd63ae080 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] [instance: 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:57.257401 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2c1db066-5819-4e8f-8b72-3dacd63ae080 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:57.258238 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2c1db066-5819-4e8f-8b72-3dacd63ae080 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:57.259159 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2c1db066-5819-4e8f-8b72-3dacd63ae080 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:57.259596 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2c1db066-5819-4e8f-8b72-3dacd63ae080 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:57.323327 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-2c1db066-5819-4e8f-8b72-3dacd63ae080 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb901faa8e9410484f83e47e5bcfa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e0691b14804cc5b4fe120fc5dea871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:57.332186 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-2c1db066-5819-4e8f-8b72-3dacd63ae080 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] 10.222.0.69 "GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c" status: 200 len: 1512 microversion: 2.1 time: 0.085989 Jul 20 19:24:57.332920 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 100/209] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:57 2022] GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c => generated 1512 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:58.089756 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-d3659eb8-1f3d-418e-8d9d-1ab9712c79da tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:58.090414 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-d3659eb8-1f3d-418e-8d9d-1ab9712c79da tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:58.096545 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d3659eb8-1f3d-418e-8d9d-1ab9712c79da tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:58.096982 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d3659eb8-1f3d-418e-8d9d-1ab9712c79da tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:58.097792 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d3659eb8-1f3d-418e-8d9d-1ab9712c79da tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:58.098826 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d3659eb8-1f3d-418e-8d9d-1ab9712c79da tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:58.124011 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-86231481-106f-4c37-a601-c98fc982e67c tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:58.125260 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-86231481-106f-4c37-a601-c98fc982e67c tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: af2baaf9-da80-407f-b960-d6b31aa82e24] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:58.132952 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-86231481-106f-4c37-a601-c98fc982e67c tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:58.133675 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-86231481-106f-4c37-a601-c98fc982e67c tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:58.134525 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-86231481-106f-4c37-a601-c98fc982e67c tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:58.135032 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-86231481-106f-4c37-a601-c98fc982e67c tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:58.243566 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-d3659eb8-1f3d-418e-8d9d-1ab9712c79da tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:58.251424 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-d3659eb8-1f3d-418e-8d9d-1ab9712c79da tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1520 microversion: 2.1 time: 0.166009 Jul 20 19:24:58.252008 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 110/210] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:58 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:58.274437 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-86231481-106f-4c37-a601-c98fc982e67c tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:58.281925 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-86231481-106f-4c37-a601-c98fc982e67c tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24" status: 200 len: 1314 microversion: 2.1 time: 0.162317 Jul 20 19:24:58.282512 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 101/211] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:58 2022] GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:58.350410 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-a52b136e-cf0a-4292-87c8-dc6bd4705ad6 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:58.351107 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-a52b136e-cf0a-4292-87c8-dc6bd4705ad6 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] [instance: 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:58.357214 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a52b136e-cf0a-4292-87c8-dc6bd4705ad6 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:58.357698 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a52b136e-cf0a-4292-87c8-dc6bd4705ad6 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:58.358475 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a52b136e-cf0a-4292-87c8-dc6bd4705ad6 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:58.358895 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a52b136e-cf0a-4292-87c8-dc6bd4705ad6 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:58.423712 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-a52b136e-cf0a-4292-87c8-dc6bd4705ad6 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb901faa8e9410484f83e47e5bcfa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e0691b14804cc5b4fe120fc5dea871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:58.431724 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-a52b136e-cf0a-4292-87c8-dc6bd4705ad6 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] 10.222.0.69 "GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c" status: 200 len: 1512 microversion: 2.1 time: 0.086283 Jul 20 19:24:58.432296 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 111/212] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:58 2022] GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c => generated 1512 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:59.268498 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e5c76c31-bba9-4933-878e-a0d8468f49ac tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:59.269091 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e5c76c31-bba9-4933-878e-a0d8468f49ac tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:59.276758 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e5c76c31-bba9-4933-878e-a0d8468f49ac tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:59.277199 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e5c76c31-bba9-4933-878e-a0d8468f49ac tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:59.277987 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e5c76c31-bba9-4933-878e-a0d8468f49ac tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:59.278411 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e5c76c31-bba9-4933-878e-a0d8468f49ac tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:59.299858 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-56a1e86d-2dd8-43d0-9d0f-f7be70d58af6 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:59.300461 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-56a1e86d-2dd8-43d0-9d0f-f7be70d58af6 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: af2baaf9-da80-407f-b960-d6b31aa82e24] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:59.307538 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-56a1e86d-2dd8-43d0-9d0f-f7be70d58af6 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:59.307975 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-56a1e86d-2dd8-43d0-9d0f-f7be70d58af6 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:59.308786 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-56a1e86d-2dd8-43d0-9d0f-f7be70d58af6 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:59.309212 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-56a1e86d-2dd8-43d0-9d0f-f7be70d58af6 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:59.421122 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e5c76c31-bba9-4933-878e-a0d8468f49ac tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:59.429445 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e5c76c31-bba9-4933-878e-a0d8468f49ac tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1520 microversion: 2.1 time: 0.164838 Jul 20 19:24:59.430141 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 102/213] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:59 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:59.447063 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-56a1e86d-2dd8-43d0-9d0f-f7be70d58af6 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:59.448579 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-548c1b67-eb79-418c-b3cc-33b78b62b26e tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:59.449277 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-548c1b67-eb79-418c-b3cc-33b78b62b26e tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] [instance: 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:59.455514 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-548c1b67-eb79-418c-b3cc-33b78b62b26e tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:59.456033 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-548c1b67-eb79-418c-b3cc-33b78b62b26e tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:59.456240 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-56a1e86d-2dd8-43d0-9d0f-f7be70d58af6 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24" status: 200 len: 1314 microversion: 2.1 time: 0.160209 Jul 20 19:24:59.456812 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 112/214] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:59 2022] GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:24:59.456963 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-548c1b67-eb79-418c-b3cc-33b78b62b26e tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:59.457735 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-548c1b67-eb79-418c-b3cc-33b78b62b26e tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:59.519849 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-548c1b67-eb79-418c-b3cc-33b78b62b26e tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb901faa8e9410484f83e47e5bcfa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e0691b14804cc5b4fe120fc5dea871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:59.528025 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-548c1b67-eb79-418c-b3cc-33b78b62b26e tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] 10.222.0.69 "GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c" status: 200 len: 1512 microversion: 2.1 time: 0.083334 Jul 20 19:24:59.528598 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 103/215] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:59 2022] GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c => generated 1512 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:00.446923 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-875134ac-b24a-4b35-ab69-46f2023acbee tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:00.447528 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-875134ac-b24a-4b35-ab69-46f2023acbee tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:00.453617 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-875134ac-b24a-4b35-ab69-46f2023acbee tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:00.454062 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-875134ac-b24a-4b35-ab69-46f2023acbee tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:00.454813 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-875134ac-b24a-4b35-ab69-46f2023acbee tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:00.455244 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-875134ac-b24a-4b35-ab69-46f2023acbee tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:00.473564 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-dd7951f5-7636-4dea-9ce0-9debcdbfb9e2 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:00.474400 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-dd7951f5-7636-4dea-9ce0-9debcdbfb9e2 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: af2baaf9-da80-407f-b960-d6b31aa82e24] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:00.480795 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-dd7951f5-7636-4dea-9ce0-9debcdbfb9e2 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:00.481323 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-dd7951f5-7636-4dea-9ce0-9debcdbfb9e2 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:00.482113 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-dd7951f5-7636-4dea-9ce0-9debcdbfb9e2 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:00.482538 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-dd7951f5-7636-4dea-9ce0-9debcdbfb9e2 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:00.589052 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-875134ac-b24a-4b35-ab69-46f2023acbee tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:00.596778 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-875134ac-b24a-4b35-ab69-46f2023acbee tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1520 microversion: 2.1 time: 0.153681 Jul 20 19:25:00.597430 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 113/216] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:00 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:25:00.603079 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-50648dce-5147-43ab-a7c5-64d5cb2680d2 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:00.603761 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-50648dce-5147-43ab-a7c5-64d5cb2680d2 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] [instance: 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:00.609645 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-50648dce-5147-43ab-a7c5-64d5cb2680d2 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:00.610084 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-50648dce-5147-43ab-a7c5-64d5cb2680d2 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:00.610831 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-50648dce-5147-43ab-a7c5-64d5cb2680d2 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:00.611259 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-50648dce-5147-43ab-a7c5-64d5cb2680d2 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:00.615705 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-dd7951f5-7636-4dea-9ce0-9debcdbfb9e2 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:00.623350 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-dd7951f5-7636-4dea-9ce0-9debcdbfb9e2 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24" status: 200 len: 1314 microversion: 2.1 time: 0.154515 Jul 20 19:25:00.623925 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 104/217] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:00 2022] GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:25:00.678030 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-50648dce-5147-43ab-a7c5-64d5cb2680d2 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb901faa8e9410484f83e47e5bcfa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e0691b14804cc5b4fe120fc5dea871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:00.686005 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-50648dce-5147-43ab-a7c5-64d5cb2680d2 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] 10.222.0.69 "GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c" status: 200 len: 1512 microversion: 2.1 time: 0.086898 Jul 20 19:25:00.686751 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 114/218] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:00 2022] GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c => generated 1512 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:01.614742 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a5e8ff03-2060-4d3e-b77f-ab971d401b7b tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:01.615345 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a5e8ff03-2060-4d3e-b77f-ab971d401b7b tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:01.621802 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a5e8ff03-2060-4d3e-b77f-ab971d401b7b tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:01.622244 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a5e8ff03-2060-4d3e-b77f-ab971d401b7b tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:01.622999 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a5e8ff03-2060-4d3e-b77f-ab971d401b7b tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:01.623434 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a5e8ff03-2060-4d3e-b77f-ab971d401b7b tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:01.641434 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-00716a75-11ca-458f-9cef-b3a8d87ca043 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:01.642066 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-00716a75-11ca-458f-9cef-b3a8d87ca043 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: af2baaf9-da80-407f-b960-d6b31aa82e24] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:01.649810 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-00716a75-11ca-458f-9cef-b3a8d87ca043 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:01.650262 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-00716a75-11ca-458f-9cef-b3a8d87ca043 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:01.651055 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-00716a75-11ca-458f-9cef-b3a8d87ca043 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:01.651501 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-00716a75-11ca-458f-9cef-b3a8d87ca043 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:01.768345 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a5e8ff03-2060-4d3e-b77f-ab971d401b7b tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:01.777919 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a5e8ff03-2060-4d3e-b77f-ab971d401b7b tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1520 microversion: 2.1 time: 0.167169 Jul 20 19:25:01.787811 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 105/219] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:01 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:01.787811 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-8a616c3b-6db2-438e-a695-15c1fed65f0b tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:01.787811 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-8a616c3b-6db2-438e-a695-15c1fed65f0b tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] [instance: 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:01.792000 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8a616c3b-6db2-438e-a695-15c1fed65f0b tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:01.792480 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8a616c3b-6db2-438e-a695-15c1fed65f0b tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:01.793334 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8a616c3b-6db2-438e-a695-15c1fed65f0b tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:01.793807 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8a616c3b-6db2-438e-a695-15c1fed65f0b tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:01.796352 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-00716a75-11ca-458f-9cef-b3a8d87ca043 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:01.796637 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:01.804530 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-00716a75-11ca-458f-9cef-b3a8d87ca043 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24" status: 200 len: 1314 microversion: 2.1 time: 0.166871 Jul 20 19:25:01.805289 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 115/220] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:01 2022] GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:25:01.858191 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8a616c3b-6db2-438e-a695-15c1fed65f0b tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb901faa8e9410484f83e47e5bcfa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e0691b14804cc5b4fe120fc5dea871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:01.866139 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-8a616c3b-6db2-438e-a695-15c1fed65f0b tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] 10.222.0.69 "GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c" status: 200 len: 1346 microversion: 2.1 time: 0.086478 Jul 20 19:25:01.866641 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 106/221] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:01 2022] GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c => generated 1346 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:02.795690 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-36daba2e-6ca0-48ab-8e51-925090f1e5c6 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:02.796294 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-36daba2e-6ca0-48ab-8e51-925090f1e5c6 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:02.802960 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-36daba2e-6ca0-48ab-8e51-925090f1e5c6 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:02.803405 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-36daba2e-6ca0-48ab-8e51-925090f1e5c6 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:02.804169 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-36daba2e-6ca0-48ab-8e51-925090f1e5c6 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:02.804591 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-36daba2e-6ca0-48ab-8e51-925090f1e5c6 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:02.823727 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-5db02eab-9f18-4ed7-a1a6-6f793ef624b4 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:02.825928 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-5db02eab-9f18-4ed7-a1a6-6f793ef624b4 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: af2baaf9-da80-407f-b960-d6b31aa82e24] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:02.842279 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5db02eab-9f18-4ed7-a1a6-6f793ef624b4 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:02.843141 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5db02eab-9f18-4ed7-a1a6-6f793ef624b4 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:02.843922 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5db02eab-9f18-4ed7-a1a6-6f793ef624b4 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:02.845874 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5db02eab-9f18-4ed7-a1a6-6f793ef624b4 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:02.942423 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-36daba2e-6ca0-48ab-8e51-925090f1e5c6 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:02.950866 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-36daba2e-6ca0-48ab-8e51-925090f1e5c6 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1520 microversion: 2.1 time: 0.159347 Jul 20 19:25:02.951516 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 116/222] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:02 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:02.963704 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-cd2bb67b-ab51-42b4-85bc-941216420d4b tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:02.964316 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-cd2bb67b-ab51-42b4-85bc-941216420d4b tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] [instance: 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:02.970845 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-cd2bb67b-ab51-42b4-85bc-941216420d4b tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:02.971352 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-cd2bb67b-ab51-42b4-85bc-941216420d4b tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:02.972271 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-cd2bb67b-ab51-42b4-85bc-941216420d4b tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:02.973361 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-cd2bb67b-ab51-42b4-85bc-941216420d4b tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:02.987772 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.wsgi [None req-cd2bb67b-ab51-42b4-85bc-941216420d4b tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] HTTP exception thrown: Instance 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c could not be found. Jul 20 19:25:02.992940 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-cd2bb67b-ab51-42b4-85bc-941216420d4b tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Request method failure captured: Jul 20 19:25:02.992940 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: request: GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c HTTP/1.1 Jul 20 19:25:02.992940 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: Accept: application/json Jul 20 19:25:02.992940 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: Accept-Encoding: identity Jul 20 19:25:02.992940 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: Connection: close Jul 20 19:25:02.992940 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: Content-Length: 0 Jul 20 19:25:02.992940 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: Content-Type: application/json Jul 20 19:25:02.992940 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: Host: 10.222.0.69 Jul 20 19:25:02.992940 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: Openstack-System-Scope: None Jul 20 19:25:02.992940 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: User-Agent: python-urllib3/1.26.9 Jul 20 19:25:02.992940 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Auth-Token: gAAAAABi2FY9flzDOWo5qwKvg44imts_W2LnSCaDPjoWVmv_UIrPGWLkWZNxi3epg7JQ5Tf4wvwsd18CtGSjjoTT1yYQvkgGM7v5qESbJeYY3ZgLl9mZWuYh4Fwbadmx7eOXlJLsBnV9RFfkMgUN6YbvccHZN_c9KUMStaO0qtuU0Pq9f4v6Dwc Jul 20 19:25:02.992940 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Domain-Id: None Jul 20 19:25:02.992940 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Domain-Name: None Jul 20 19:25:02.992940 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Identity-Status: Confirmed Jul 20 19:25:02.992940 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Is-Admin-Project: True Jul 20 19:25:02.992940 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Project-Domain-Id: default Jul 20 19:25:02.992940 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Project-Domain-Name: Default Jul 20 19:25:02.992940 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Project-Id: 05e0691b14804cc5b4fe120fc5dea871 Jul 20 19:25:02.992940 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Project-Name: tempest-DeleteServersTestJSON-967239455 Jul 20 19:25:02.992940 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Role: reader,member Jul 20 19:25:02.992940 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Roles: reader,member Jul 20 19:25:02.994494 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/05e0691b14804cc5b4fe120fc5dea871"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/05e0691b14804cc5b4fe120fc5dea871"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_05e0691b14804cc5b4fe120fc5dea871", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/05e0691b14804cc5b4fe120fc5dea871"}]}] Jul 20 19:25:02.994494 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Tenant: tempest-DeleteServersTestJSON-967239455 Jul 20 19:25:02.994494 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Tenant-Id: 05e0691b14804cc5b4fe120fc5dea871 Jul 20 19:25:02.994494 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Tenant-Name: tempest-DeleteServersTestJSON-967239455 Jul 20 19:25:02.994494 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-User: tempest-DeleteServersTestJSON-967239455-project Jul 20 19:25:02.994494 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-User-Domain-Id: default Jul 20 19:25:02.994494 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-User-Domain-Name: Default Jul 20 19:25:02.994494 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-User-Id: beb901faa8e9410484f83e47e5bcfa8c Jul 20 19:25:02.994494 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-User-Name: tempest-DeleteServersTestJSON-967239455-project Jul 20 19:25:02.994494 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: method: > Jul 20 19:25:02.994494 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: exception: Instance 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c could not be found. Jul 20 19:25:02.994494 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: action_args: {'id': '3579edbc-f4b6-4ba1-beb5-a095d7d9c21c'} Jul 20 19:25:02.995292 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:25:02.995292 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:25:02.995292 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:25:02.995292 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:25:02.995292 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:25:02.995292 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:25:02.995292 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:25:02.995292 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:25:02.995292 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:25:02.995292 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:25:02.995292 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c could not be found. Jul 20 19:25:02.995292 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Jul 20 19:25:02.995292 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:25:02.995292 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Jul 20 19:25:02.995292 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:25:02.995292 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:25:02.995292 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:25:02.995292 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:25:02.995292 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:25:02.995292 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:25:02.996647 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:25:02.996647 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:25:02.996647 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:25:02.996647 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:25:02.996647 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:25:02.996647 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:25:02.996647 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:25:02.996647 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c could not be found. Jul 20 19:25:02.996647 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Jul 20 19:25:02.996647 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:25:02.996647 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Jul 20 19:25:02.996647 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:25:02.996647 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:25:02.996647 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:25:02.996647 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:25:02.996647 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:25:02.996647 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c could not be found. Jul 20 19:25:02.996647 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Jul 20 19:25:02.998183 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-cd2bb67b-ab51-42b4-85bc-941216420d4b tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Returning 404 to user: Instance 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c could not be found. {{(pid=117762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:25:02.998183 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-cd2bb67b-ab51-42b4-85bc-941216420d4b tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] 10.222.0.69 "GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c" status: 404 len: 111 microversion: 2.1 time: 0.039216 Jul 20 19:25:02.998183 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 117/223] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:02 2022] GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:25:02.999296 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-5db02eab-9f18-4ed7-a1a6-6f793ef624b4 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:03.007471 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-5db02eab-9f18-4ed7-a1a6-6f793ef624b4 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24" status: 200 len: 1314 microversion: 2.1 time: 0.190344 Jul 20 19:25:03.008135 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 107/224] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:02 2022] GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:03.100967 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-7c45c225-2662-468f-a10a-5e4860a048e1 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:03.101983 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-7c45c225-2662-468f-a10a-5e4860a048e1 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] [instance: 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:03.108105 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-7c45c225-2662-468f-a10a-5e4860a048e1 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:03.108547 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-7c45c225-2662-468f-a10a-5e4860a048e1 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:03.109296 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-7c45c225-2662-468f-a10a-5e4860a048e1 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:03.109765 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-7c45c225-2662-468f-a10a-5e4860a048e1 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:03.122869 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.wsgi [None req-7c45c225-2662-468f-a10a-5e4860a048e1 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] HTTP exception thrown: Instance 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c could not be found. Jul 20 19:25:03.124616 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-7c45c225-2662-468f-a10a-5e4860a048e1 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Request method failure captured: Jul 20 19:25:03.124616 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: request: GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c/os-volume_attachments HTTP/1.1 Jul 20 19:25:03.124616 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: Accept: application/json Jul 20 19:25:03.124616 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: Accept-Encoding: identity Jul 20 19:25:03.124616 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: Connection: close Jul 20 19:25:03.124616 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: Content-Length: 0 Jul 20 19:25:03.124616 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: Content-Type: application/json Jul 20 19:25:03.124616 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: Host: 10.222.0.69 Jul 20 19:25:03.124616 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: Openstack-System-Scope: None Jul 20 19:25:03.124616 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: User-Agent: python-urllib3/1.26.9 Jul 20 19:25:03.124616 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Auth-Token: gAAAAABi2FY9flzDOWo5qwKvg44imts_W2LnSCaDPjoWVmv_UIrPGWLkWZNxi3epg7JQ5Tf4wvwsd18CtGSjjoTT1yYQvkgGM7v5qESbJeYY3ZgLl9mZWuYh4Fwbadmx7eOXlJLsBnV9RFfkMgUN6YbvccHZN_c9KUMStaO0qtuU0Pq9f4v6Dwc Jul 20 19:25:03.124616 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Domain-Id: None Jul 20 19:25:03.124616 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Domain-Name: None Jul 20 19:25:03.124616 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Identity-Status: Confirmed Jul 20 19:25:03.124616 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Is-Admin-Project: True Jul 20 19:25:03.124616 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Project-Domain-Id: default Jul 20 19:25:03.124616 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Project-Domain-Name: Default Jul 20 19:25:03.124616 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Project-Id: 05e0691b14804cc5b4fe120fc5dea871 Jul 20 19:25:03.124616 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Project-Name: tempest-DeleteServersTestJSON-967239455 Jul 20 19:25:03.124616 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Role: reader,member Jul 20 19:25:03.124616 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Roles: reader,member Jul 20 19:25:03.126013 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/05e0691b14804cc5b4fe120fc5dea871"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/05e0691b14804cc5b4fe120fc5dea871"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_05e0691b14804cc5b4fe120fc5dea871", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/05e0691b14804cc5b4fe120fc5dea871"}]}] Jul 20 19:25:03.126013 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Tenant: tempest-DeleteServersTestJSON-967239455 Jul 20 19:25:03.126013 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Tenant-Id: 05e0691b14804cc5b4fe120fc5dea871 Jul 20 19:25:03.126013 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Tenant-Name: tempest-DeleteServersTestJSON-967239455 Jul 20 19:25:03.126013 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-User: tempest-DeleteServersTestJSON-967239455-project Jul 20 19:25:03.126013 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-User-Domain-Id: default Jul 20 19:25:03.126013 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-User-Domain-Name: Default Jul 20 19:25:03.126013 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-User-Id: beb901faa8e9410484f83e47e5bcfa8c Jul 20 19:25:03.126013 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-User-Name: tempest-DeleteServersTestJSON-967239455-project Jul 20 19:25:03.126013 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: method: > Jul 20 19:25:03.126013 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: exception: Instance 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c could not be found. Jul 20 19:25:03.126013 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: action_args: {'server_id': '3579edbc-f4b6-4ba1-beb5-a095d7d9c21c'} Jul 20 19:25:03.126788 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:25:03.126788 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:25:03.126788 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:25:03.126788 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:25:03.126788 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:25:03.126788 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:25:03.126788 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:25:03.126788 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:25:03.126788 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:25:03.126788 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:25:03.126788 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c could not be found. Jul 20 19:25:03.126788 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Jul 20 19:25:03.126788 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:25:03.126788 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Jul 20 19:25:03.126788 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:25:03.126788 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:25:03.126788 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:25:03.126788 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:25:03.126788 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:25:03.126788 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:25:03.127869 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:25:03.127869 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 19:25:03.127869 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 19:25:03.127869 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 19:25:03.127869 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 19:25:03.127869 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 20 19:25:03.127869 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 20 19:25:03.127869 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:25:03.127869 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:25:03.127869 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c could not be found. Jul 20 19:25:03.127869 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Jul 20 19:25:03.127869 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:25:03.127869 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Jul 20 19:25:03.127869 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:25:03.127869 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:25:03.127869 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:25:03.127869 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:25:03.127869 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:25:03.127869 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c could not be found. Jul 20 19:25:03.127869 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Jul 20 19:25:03.129992 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-7c45c225-2662-468f-a10a-5e4860a048e1 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Returning 404 to user: Instance 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c could not be found. {{(pid=117762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:25:03.129992 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-7c45c225-2662-468f-a10a-5e4860a048e1 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] 10.222.0.69 "GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.030103 Jul 20 19:25:03.129992 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 118/225] 10.222.0.69 () {58 vars in 1301 bytes} [Wed Jul 20 19:25:03 2022] GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c/os-volume_attachments => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:25:03.970479 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-850a5564-4575-4155-9e50-4005066621c2 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:03.971067 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-850a5564-4575-4155-9e50-4005066621c2 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:03.978007 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-850a5564-4575-4155-9e50-4005066621c2 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:03.978456 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-850a5564-4575-4155-9e50-4005066621c2 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:03.979212 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-850a5564-4575-4155-9e50-4005066621c2 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:03.979643 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-850a5564-4575-4155-9e50-4005066621c2 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:04.024319 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-ec5de6b1-d376-4d44-ae35-267f9faa738a tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:04.024961 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-ec5de6b1-d376-4d44-ae35-267f9faa738a tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: af2baaf9-da80-407f-b960-d6b31aa82e24] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:04.031533 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-ec5de6b1-d376-4d44-ae35-267f9faa738a tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:04.031980 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-ec5de6b1-d376-4d44-ae35-267f9faa738a tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:04.032739 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-ec5de6b1-d376-4d44-ae35-267f9faa738a tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:04.033173 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-ec5de6b1-d376-4d44-ae35-267f9faa738a tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:04.110645 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-850a5564-4575-4155-9e50-4005066621c2 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:04.119134 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-850a5564-4575-4155-9e50-4005066621c2 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1520 microversion: 2.1 time: 0.153036 Jul 20 19:25:04.119709 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 108/226] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:03 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:04.167993 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-ec5de6b1-d376-4d44-ae35-267f9faa738a tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:04.175368 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-ec5de6b1-d376-4d44-ae35-267f9faa738a tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24" status: 200 len: 1314 microversion: 2.1 time: 0.154933 Jul 20 19:25:04.176556 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 119/227] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:04 2022] GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:05.136112 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-3fbb1bbb-3193-40be-9392-5564c27b6dd5 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:05.136721 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-3fbb1bbb-3193-40be-9392-5564c27b6dd5 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:05.143196 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3fbb1bbb-3193-40be-9392-5564c27b6dd5 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:05.143645 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3fbb1bbb-3193-40be-9392-5564c27b6dd5 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:05.144431 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3fbb1bbb-3193-40be-9392-5564c27b6dd5 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:05.144868 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3fbb1bbb-3193-40be-9392-5564c27b6dd5 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:05.192956 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-9dc544d0-109e-48cb-8ed0-c920eecd5a28 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:05.193564 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-9dc544d0-109e-48cb-8ed0-c920eecd5a28 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: af2baaf9-da80-407f-b960-d6b31aa82e24] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:05.200120 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9dc544d0-109e-48cb-8ed0-c920eecd5a28 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:05.200637 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9dc544d0-109e-48cb-8ed0-c920eecd5a28 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:05.201469 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9dc544d0-109e-48cb-8ed0-c920eecd5a28 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:05.201930 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9dc544d0-109e-48cb-8ed0-c920eecd5a28 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:05.280406 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3fbb1bbb-3193-40be-9392-5564c27b6dd5 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:05.288266 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-3fbb1bbb-3193-40be-9392-5564c27b6dd5 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1520 microversion: 2.1 time: 0.155929 Jul 20 19:25:05.288851 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 109/228] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:05 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:05.334955 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-9dc544d0-109e-48cb-8ed0-c920eecd5a28 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:05.343395 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-9dc544d0-109e-48cb-8ed0-c920eecd5a28 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24" status: 200 len: 1314 microversion: 2.1 time: 0.154677 Jul 20 19:25:05.343696 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 120/229] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:05 2022] GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:25:06.305048 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a243143f-a241-49dd-a9c8-8fa3b346e583 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:06.305591 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a243143f-a241-49dd-a9c8-8fa3b346e583 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:06.312012 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a243143f-a241-49dd-a9c8-8fa3b346e583 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:06.312491 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a243143f-a241-49dd-a9c8-8fa3b346e583 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:06.313254 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a243143f-a241-49dd-a9c8-8fa3b346e583 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:06.313718 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a243143f-a241-49dd-a9c8-8fa3b346e583 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:06.367448 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-b7fd6efd-2b2c-4f60-9fca-a466b25547e1 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:06.368141 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-b7fd6efd-2b2c-4f60-9fca-a466b25547e1 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: af2baaf9-da80-407f-b960-d6b31aa82e24] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:06.374308 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b7fd6efd-2b2c-4f60-9fca-a466b25547e1 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:06.374961 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b7fd6efd-2b2c-4f60-9fca-a466b25547e1 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:06.375713 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b7fd6efd-2b2c-4f60-9fca-a466b25547e1 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:06.376136 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b7fd6efd-2b2c-4f60-9fca-a466b25547e1 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:06.451411 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a243143f-a241-49dd-a9c8-8fa3b346e583 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:06.459791 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a243143f-a241-49dd-a9c8-8fa3b346e583 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1520 microversion: 2.1 time: 0.159337 Jul 20 19:25:06.460643 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 110/230] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:06 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:06.516819 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-b7fd6efd-2b2c-4f60-9fca-a466b25547e1 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:06.524701 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-b7fd6efd-2b2c-4f60-9fca-a466b25547e1 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24" status: 200 len: 1314 microversion: 2.1 time: 0.162147 Jul 20 19:25:06.525285 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 121/231] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:06 2022] GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:25:07.476955 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-46b8f4dc-9eb9-4528-82e9-077337ff3e6a tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:07.477576 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-46b8f4dc-9eb9-4528-82e9-077337ff3e6a tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:07.484087 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-46b8f4dc-9eb9-4528-82e9-077337ff3e6a tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:07.484532 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-46b8f4dc-9eb9-4528-82e9-077337ff3e6a tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:07.485293 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-46b8f4dc-9eb9-4528-82e9-077337ff3e6a tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:07.485753 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-46b8f4dc-9eb9-4528-82e9-077337ff3e6a tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:07.542134 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-c9787fea-5327-4665-8153-f3c4c8a32ea0 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:07.542770 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-c9787fea-5327-4665-8153-f3c4c8a32ea0 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: af2baaf9-da80-407f-b960-d6b31aa82e24] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:07.548723 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c9787fea-5327-4665-8153-f3c4c8a32ea0 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:07.549171 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c9787fea-5327-4665-8153-f3c4c8a32ea0 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:07.550062 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c9787fea-5327-4665-8153-f3c4c8a32ea0 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:07.550537 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c9787fea-5327-4665-8153-f3c4c8a32ea0 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:07.554671 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_cell1:SELECT=100 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:07.616302 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-46b8f4dc-9eb9-4528-82e9-077337ff3e6a tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:07.623658 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-46b8f4dc-9eb9-4528-82e9-077337ff3e6a tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1520 microversion: 2.1 time: 0.151354 Jul 20 19:25:07.624222 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 111/232] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:07 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:07.684872 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-c9787fea-5327-4665-8153-f3c4c8a32ea0 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:07.693243 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-c9787fea-5327-4665-8153-f3c4c8a32ea0 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24" status: 200 len: 1314 microversion: 2.1 time: 0.154717 Jul 20 19:25:07.693607 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 122/233] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:07 2022] GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:25:08.602299 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [req-b8ec23d3-55c5-4e6b-a440-95d162c67cf7 req-b163baef-28cd-490a-8eb2-460427d6da18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af2baaf9-da80-407f-b960-d6b31aa82e24", "name": "network-vif-plugged", "status": "completed", "tag": "e13796a3-31bf-4f68-b72e-d9d7c014953b"}]} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:25:08.611900 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-b8ec23d3-55c5-4e6b-a440-95d162c67cf7 req-b163baef-28cd-490a-8eb2-460427d6da18 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:08.612339 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-b8ec23d3-55c5-4e6b-a440-95d162c67cf7 req-b163baef-28cd-490a-8eb2-460427d6da18 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:08.624624 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.compute.server_external_events [req-b8ec23d3-55c5-4e6b-a440-95d162c67cf7 req-b163baef-28cd-490a-8eb2-460427d6da18 service nova] Creating event network-vif-plugged:e13796a3-31bf-4f68-b72e-d9d7c014953b for instance af2baaf9-da80-407f-b960-d6b31aa82e24 on hv-cinder-83538 Jul 20 19:25:08.631261 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [req-b8ec23d3-55c5-4e6b-a440-95d162c67cf7 req-b163baef-28cd-490a-8eb2-460427d6da18 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032516 Jul 20 19:25:08.631890 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 112/234] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 19:25:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:25:08.641711 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-a1b4f083-c527-427d-b231-e04153899405 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:08.642394 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-a1b4f083-c527-427d-b231-e04153899405 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:08.649383 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a1b4f083-c527-427d-b231-e04153899405 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:08.650041 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a1b4f083-c527-427d-b231-e04153899405 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:08.650879 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a1b4f083-c527-427d-b231-e04153899405 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:08.651479 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a1b4f083-c527-427d-b231-e04153899405 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:08.722155 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-251603aa-d8d5-4d94-a1c6-badbc0bc94b5 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:08.723833 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-251603aa-d8d5-4d94-a1c6-badbc0bc94b5 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: af2baaf9-da80-407f-b960-d6b31aa82e24] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:08.731637 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-251603aa-d8d5-4d94-a1c6-badbc0bc94b5 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:08.732090 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-251603aa-d8d5-4d94-a1c6-badbc0bc94b5 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:08.733332 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-251603aa-d8d5-4d94-a1c6-badbc0bc94b5 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:08.734727 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-251603aa-d8d5-4d94-a1c6-badbc0bc94b5 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:08.809825 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-a1b4f083-c527-427d-b231-e04153899405 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:08.818395 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-a1b4f083-c527-427d-b231-e04153899405 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1520 microversion: 2.1 time: 0.180820 Jul 20 19:25:08.819074 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 123/235] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:08 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:08.974678 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-251603aa-d8d5-4d94-a1c6-badbc0bc94b5 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:08.983767 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-251603aa-d8d5-4d94-a1c6-badbc0bc94b5 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24" status: 200 len: 1314 microversion: 2.1 time: 0.270960 Jul 20 19:25:08.983767 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 113/236] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:08 2022] GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24 => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:09.839155 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-32d718f1-16e0-4a74-b95f-ccf930e64731 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:09.839809 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-32d718f1-16e0-4a74-b95f-ccf930e64731 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:09.841929 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_api:SELECT=78 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:09.848071 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-32d718f1-16e0-4a74-b95f-ccf930e64731 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:09.848525 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-32d718f1-16e0-4a74-b95f-ccf930e64731 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:09.849307 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-32d718f1-16e0-4a74-b95f-ccf930e64731 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:09.849777 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-32d718f1-16e0-4a74-b95f-ccf930e64731 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:10.001055 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-32d718f1-16e0-4a74-b95f-ccf930e64731 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:10.003524 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-2eff0bed-7ee7-4112-8235-a287378d586b tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:10.004136 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-2eff0bed-7ee7-4112-8235-a287378d586b tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: af2baaf9-da80-407f-b960-d6b31aa82e24] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:10.013495 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2eff0bed-7ee7-4112-8235-a287378d586b tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:10.013495 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2eff0bed-7ee7-4112-8235-a287378d586b tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:10.014358 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2eff0bed-7ee7-4112-8235-a287378d586b tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:10.014824 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2eff0bed-7ee7-4112-8235-a287378d586b tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:10.015288 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-32d718f1-16e0-4a74-b95f-ccf930e64731 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1520 microversion: 2.1 time: 0.180056 Jul 20 19:25:10.015869 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 124/237] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:09 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:10.163570 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-2eff0bed-7ee7-4112-8235-a287378d586b tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:10.171530 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-2eff0bed-7ee7-4112-8235-a287378d586b tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24" status: 200 len: 1314 microversion: 2.1 time: 0.175295 Jul 20 19:25:10.172109 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 114/238] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:09 2022] GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:10.641810 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-44bd378e-db9c-4d9f-b725-8e4aeccad894 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:10.642941 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-44bd378e-db9c-4d9f-b725-8e4aeccad894 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] [instance: 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:10.649663 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-44bd378e-db9c-4d9f-b725-8e4aeccad894 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:10.650122 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-44bd378e-db9c-4d9f-b725-8e4aeccad894 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:10.650883 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-44bd378e-db9c-4d9f-b725-8e4aeccad894 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:10.651319 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-44bd378e-db9c-4d9f-b725-8e4aeccad894 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:10.666257 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.wsgi [None req-44bd378e-db9c-4d9f-b725-8e4aeccad894 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] HTTP exception thrown: Instance 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c could not be found. Jul 20 19:25:10.667858 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-44bd378e-db9c-4d9f-b725-8e4aeccad894 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Request method failure captured: Jul 20 19:25:10.667858 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: request: DELETE /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c HTTP/1.1 Jul 20 19:25:10.667858 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: Accept: application/json Jul 20 19:25:10.667858 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: Accept-Encoding: identity Jul 20 19:25:10.667858 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: Connection: close Jul 20 19:25:10.667858 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: Content-Length: 0 Jul 20 19:25:10.667858 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: Content-Type: application/json Jul 20 19:25:10.667858 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: Host: 10.222.0.69 Jul 20 19:25:10.667858 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: Openstack-System-Scope: None Jul 20 19:25:10.667858 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: User-Agent: python-urllib3/1.26.9 Jul 20 19:25:10.667858 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Auth-Token: gAAAAABi2FY9flzDOWo5qwKvg44imts_W2LnSCaDPjoWVmv_UIrPGWLkWZNxi3epg7JQ5Tf4wvwsd18CtGSjjoTT1yYQvkgGM7v5qESbJeYY3ZgLl9mZWuYh4Fwbadmx7eOXlJLsBnV9RFfkMgUN6YbvccHZN_c9KUMStaO0qtuU0Pq9f4v6Dwc Jul 20 19:25:10.667858 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Domain-Id: None Jul 20 19:25:10.667858 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Domain-Name: None Jul 20 19:25:10.667858 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Identity-Status: Confirmed Jul 20 19:25:10.667858 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Is-Admin-Project: True Jul 20 19:25:10.667858 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Project-Domain-Id: default Jul 20 19:25:10.667858 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Project-Domain-Name: Default Jul 20 19:25:10.667858 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Project-Id: 05e0691b14804cc5b4fe120fc5dea871 Jul 20 19:25:10.667858 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Project-Name: tempest-DeleteServersTestJSON-967239455 Jul 20 19:25:10.667858 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Role: reader,member Jul 20 19:25:10.667858 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Roles: reader,member Jul 20 19:25:10.669291 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/05e0691b14804cc5b4fe120fc5dea871"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/05e0691b14804cc5b4fe120fc5dea871"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_05e0691b14804cc5b4fe120fc5dea871", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/05e0691b14804cc5b4fe120fc5dea871"}]}] Jul 20 19:25:10.669291 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Tenant: tempest-DeleteServersTestJSON-967239455 Jul 20 19:25:10.669291 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Tenant-Id: 05e0691b14804cc5b4fe120fc5dea871 Jul 20 19:25:10.669291 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Tenant-Name: tempest-DeleteServersTestJSON-967239455 Jul 20 19:25:10.669291 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-User: tempest-DeleteServersTestJSON-967239455-project Jul 20 19:25:10.669291 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-User-Domain-Id: default Jul 20 19:25:10.669291 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-User-Domain-Name: Default Jul 20 19:25:10.669291 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-User-Id: beb901faa8e9410484f83e47e5bcfa8c Jul 20 19:25:10.669291 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-User-Name: tempest-DeleteServersTestJSON-967239455-project Jul 20 19:25:10.669291 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: method: > Jul 20 19:25:10.669291 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: exception: Instance 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c could not be found. Jul 20 19:25:10.669291 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: action_args: {'id': '3579edbc-f4b6-4ba1-beb5-a095d7d9c21c'} Jul 20 19:25:10.670112 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:25:10.670112 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:25:10.670112 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:25:10.670112 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:25:10.670112 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:25:10.670112 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:25:10.670112 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:25:10.670112 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:25:10.670112 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:25:10.670112 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:25:10.670112 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c could not be found. Jul 20 19:25:10.670112 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Jul 20 19:25:10.670112 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:25:10.670112 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Jul 20 19:25:10.670112 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:25:10.670112 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:25:10.670112 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:25:10.670112 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:25:10.670112 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:25:10.670112 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:25:10.671425 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:25:10.671425 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 19:25:10.671425 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 19:25:10.671425 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 19:25:10.671425 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 19:25:10.671425 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:25:10.671425 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:25:10.671425 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:25:10.671425 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:25:10.671425 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c could not be found. Jul 20 19:25:10.671425 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Jul 20 19:25:10.671425 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:25:10.671425 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Jul 20 19:25:10.671425 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:25:10.671425 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:25:10.671425 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:25:10.671425 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:25:10.671425 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:25:10.671425 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c could not be found. Jul 20 19:25:10.671425 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Jul 20 19:25:10.673001 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-44bd378e-db9c-4d9f-b725-8e4aeccad894 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Returning 404 to user: Instance 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c could not be found. {{(pid=117762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:25:10.673001 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-44bd378e-db9c-4d9f-b725-8e4aeccad894 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] 10.222.0.69 "DELETE /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c" status: 404 len: 111 microversion: 2.1 time: 0.031419 Jul 20 19:25:10.673001 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 125/239] 10.222.0.69 () {58 vars in 1238 bytes} [Wed Jul 20 19:25:10 2022] DELETE /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:25:10.678626 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-99567542-8fa5-443a-936a-f260a0837290 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:10.679231 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-99567542-8fa5-443a-936a-f260a0837290 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] [instance: 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:10.685297 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-99567542-8fa5-443a-936a-f260a0837290 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:10.685789 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-99567542-8fa5-443a-936a-f260a0837290 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:10.686551 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-99567542-8fa5-443a-936a-f260a0837290 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:10.686986 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-99567542-8fa5-443a-936a-f260a0837290 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:10.699927 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.wsgi [None req-99567542-8fa5-443a-936a-f260a0837290 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] HTTP exception thrown: Instance 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c could not be found. Jul 20 19:25:10.704441 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-99567542-8fa5-443a-936a-f260a0837290 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Request method failure captured: Jul 20 19:25:10.704441 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c HTTP/1.1 Jul 20 19:25:10.704441 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 19:25:10.704441 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 19:25:10.704441 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 19:25:10.704441 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 0 Jul 20 19:25:10.704441 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 19:25:10.704441 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 19:25:10.704441 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 19:25:10.704441 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 19:25:10.704441 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2FY9flzDOWo5qwKvg44imts_W2LnSCaDPjoWVmv_UIrPGWLkWZNxi3epg7JQ5Tf4wvwsd18CtGSjjoTT1yYQvkgGM7v5qESbJeYY3ZgLl9mZWuYh4Fwbadmx7eOXlJLsBnV9RFfkMgUN6YbvccHZN_c9KUMStaO0qtuU0Pq9f4v6Dwc Jul 20 19:25:10.704441 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 19:25:10.704441 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 19:25:10.704441 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 19:25:10.704441 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 19:25:10.704441 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 19:25:10.704441 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 19:25:10.704441 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: 05e0691b14804cc5b4fe120fc5dea871 Jul 20 19:25:10.704441 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-DeleteServersTestJSON-967239455 Jul 20 19:25:10.704441 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 19:25:10.704441 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 19:25:10.705924 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/05e0691b14804cc5b4fe120fc5dea871"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/05e0691b14804cc5b4fe120fc5dea871"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_05e0691b14804cc5b4fe120fc5dea871", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/05e0691b14804cc5b4fe120fc5dea871"}]}] Jul 20 19:25:10.705924 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-DeleteServersTestJSON-967239455 Jul 20 19:25:10.705924 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: 05e0691b14804cc5b4fe120fc5dea871 Jul 20 19:25:10.705924 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-DeleteServersTestJSON-967239455 Jul 20 19:25:10.705924 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-DeleteServersTestJSON-967239455-project Jul 20 19:25:10.705924 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 19:25:10.705924 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 19:25:10.705924 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: beb901faa8e9410484f83e47e5bcfa8c Jul 20 19:25:10.705924 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-DeleteServersTestJSON-967239455-project Jul 20 19:25:10.705924 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: > Jul 20 19:25:10.705924 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Instance 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c could not be found. Jul 20 19:25:10.705924 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'id': '3579edbc-f4b6-4ba1-beb5-a095d7d9c21c'} Jul 20 19:25:10.707018 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:25:10.707018 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:25:10.707018 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:25:10.707018 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:25:10.707018 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:25:10.707018 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:25:10.707018 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:25:10.707018 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:25:10.707018 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:25:10.707018 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:25:10.707018 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c could not be found. Jul 20 19:25:10.707018 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:25:10.707018 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:25:10.707018 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:25:10.707018 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:25:10.707018 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:25:10.707018 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:25:10.707018 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:25:10.707018 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:25:10.707018 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:25:10.708812 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:25:10.708812 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:25:10.708812 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:25:10.708812 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:25:10.708812 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:25:10.708812 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:25:10.708812 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:25:10.708812 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c could not be found. Jul 20 19:25:10.708812 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:25:10.708812 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:25:10.708812 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:25:10.708812 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:25:10.708812 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:25:10.708812 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:25:10.708812 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:25:10.708812 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:25:10.708812 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c could not be found. Jul 20 19:25:10.708812 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:25:10.710132 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-99567542-8fa5-443a-936a-f260a0837290 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] Returning 404 to user: Instance 3579edbc-f4b6-4ba1-beb5-a095d7d9c21c could not be found. {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:25:10.710132 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-99567542-8fa5-443a-936a-f260a0837290 tempest-DeleteServersTestJSON-967239455 tempest-DeleteServersTestJSON-967239455-project] 10.222.0.69 "GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c" status: 404 len: 111 microversion: 2.1 time: 0.031971 Jul 20 19:25:10.710132 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 115/240] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:10 2022] GET /compute/v2.1/servers/3579edbc-f4b6-4ba1-beb5-a095d7d9c21c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:25:11.032338 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-9d02b993-9548-4d1c-b495-e375ac3fde27 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:11.032954 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-9d02b993-9548-4d1c-b495-e375ac3fde27 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:11.040105 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9d02b993-9548-4d1c-b495-e375ac3fde27 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:11.040555 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9d02b993-9548-4d1c-b495-e375ac3fde27 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:11.041315 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9d02b993-9548-4d1c-b495-e375ac3fde27 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:11.041776 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9d02b993-9548-4d1c-b495-e375ac3fde27 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:11.189360 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-39dfe6b5-eaf4-4ac1-8fa2-9c3d8979c307 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:11.190756 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-39dfe6b5-eaf4-4ac1-8fa2-9c3d8979c307 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: af2baaf9-da80-407f-b960-d6b31aa82e24] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:11.198849 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-39dfe6b5-eaf4-4ac1-8fa2-9c3d8979c307 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:11.199310 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-39dfe6b5-eaf4-4ac1-8fa2-9c3d8979c307 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:11.203024 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-39dfe6b5-eaf4-4ac1-8fa2-9c3d8979c307 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:11.203024 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-39dfe6b5-eaf4-4ac1-8fa2-9c3d8979c307 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:11.290268 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-9d02b993-9548-4d1c-b495-e375ac3fde27 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:11.299074 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-9d02b993-9548-4d1c-b495-e375ac3fde27 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1520 microversion: 2.1 time: 0.270594 Jul 20 19:25:11.307592 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 126/241] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:11 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1520 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:11.375339 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-39dfe6b5-eaf4-4ac1-8fa2-9c3d8979c307 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:11.383815 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-39dfe6b5-eaf4-4ac1-8fa2-9c3d8979c307 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24" status: 200 len: 1314 microversion: 2.1 time: 0.198600 Jul 20 19:25:11.384382 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 116/242] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:11 2022] GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:12.316466 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-06dee2c3-c159-48aa-9992-90e26ad79056 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:12.317630 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-06dee2c3-c159-48aa-9992-90e26ad79056 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:12.324483 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-06dee2c3-c159-48aa-9992-90e26ad79056 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:12.325295 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-06dee2c3-c159-48aa-9992-90e26ad79056 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:12.329299 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-06dee2c3-c159-48aa-9992-90e26ad79056 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:12.330133 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-06dee2c3-c159-48aa-9992-90e26ad79056 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:12.402283 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e785193c-21f0-4f95-af97-00c07f7deac6 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:12.402992 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e785193c-21f0-4f95-af97-00c07f7deac6 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: af2baaf9-da80-407f-b960-d6b31aa82e24] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:12.405337 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:12.411437 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e785193c-21f0-4f95-af97-00c07f7deac6 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:12.412813 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e785193c-21f0-4f95-af97-00c07f7deac6 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:12.413787 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e785193c-21f0-4f95-af97-00c07f7deac6 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:12.414232 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e785193c-21f0-4f95-af97-00c07f7deac6 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:12.571029 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e785193c-21f0-4f95-af97-00c07f7deac6 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:12.578732 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e785193c-21f0-4f95-af97-00c07f7deac6 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24" status: 200 len: 1497 microversion: 2.1 time: 0.181058 Jul 20 19:25:12.579435 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 117/243] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:12 2022] GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24 => generated 1497 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:25:12.654736 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-06dee2c3-c159-48aa-9992-90e26ad79056 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:12.662698 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-06dee2c3-c159-48aa-9992-90e26ad79056 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1520 microversion: 2.1 time: 0.350035 Jul 20 19:25:12.663318 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 127/244] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:12 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1520 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:13.681159 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-0c06ef26-8bac-4728-9167-02ba08f7016d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:13.682487 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-0c06ef26-8bac-4728-9167-02ba08f7016d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:13.690011 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0c06ef26-8bac-4728-9167-02ba08f7016d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:13.690782 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0c06ef26-8bac-4728-9167-02ba08f7016d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:13.691770 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0c06ef26-8bac-4728-9167-02ba08f7016d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:13.692971 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0c06ef26-8bac-4728-9167-02ba08f7016d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:13.935672 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0c06ef26-8bac-4728-9167-02ba08f7016d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:13.947835 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-0c06ef26-8bac-4728-9167-02ba08f7016d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1520 microversion: 2.1 time: 0.271707 Jul 20 19:25:13.948425 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 118/245] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:13 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1520 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:14.965738 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-ef65c1be-64c9-4aad-8563-46a39d311a45 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:14.967614 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-ef65c1be-64c9-4aad-8563-46a39d311a45 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:14.983269 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-ef65c1be-64c9-4aad-8563-46a39d311a45 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:14.983764 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-ef65c1be-64c9-4aad-8563-46a39d311a45 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:14.984716 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-ef65c1be-64c9-4aad-8563-46a39d311a45 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:14.985110 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-ef65c1be-64c9-4aad-8563-46a39d311a45 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:15.149541 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-ef65c1be-64c9-4aad-8563-46a39d311a45 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:15.163909 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-ef65c1be-64c9-4aad-8563-46a39d311a45 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1520 microversion: 2.1 time: 0.202636 Jul 20 19:25:15.165928 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 128/246] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:14 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1520 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:16.182612 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-5754a46d-45b8-4085-81f8-3d7f58189953 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:16.183374 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-5754a46d-45b8-4085-81f8-3d7f58189953 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:16.189683 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5754a46d-45b8-4085-81f8-3d7f58189953 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:16.190127 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5754a46d-45b8-4085-81f8-3d7f58189953 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:16.190906 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5754a46d-45b8-4085-81f8-3d7f58189953 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:16.191339 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5754a46d-45b8-4085-81f8-3d7f58189953 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:16.338266 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-5754a46d-45b8-4085-81f8-3d7f58189953 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:16.346882 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-5754a46d-45b8-4085-81f8-3d7f58189953 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1520 microversion: 2.1 time: 0.168351 Jul 20 19:25:16.347646 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 119/247] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:16 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:17.364035 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-ddd51de3-bf39-4bcd-8edb-6475bce15c0a tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:17.364641 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-ddd51de3-bf39-4bcd-8edb-6475bce15c0a tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:17.370925 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-ddd51de3-bf39-4bcd-8edb-6475bce15c0a tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:17.371373 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-ddd51de3-bf39-4bcd-8edb-6475bce15c0a tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:17.372135 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-ddd51de3-bf39-4bcd-8edb-6475bce15c0a tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:17.372566 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-ddd51de3-bf39-4bcd-8edb-6475bce15c0a tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:17.516315 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-ddd51de3-bf39-4bcd-8edb-6475bce15c0a tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:17.526052 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-ddd51de3-bf39-4bcd-8edb-6475bce15c0a tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1520 microversion: 2.1 time: 0.165948 Jul 20 19:25:17.526704 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 129/248] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:17 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:18.546439 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-9ffe406f-b13d-43cf-86ef-4552b70916b5 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:18.547033 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-9ffe406f-b13d-43cf-86ef-4552b70916b5 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:18.553832 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9ffe406f-b13d-43cf-86ef-4552b70916b5 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:18.554330 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9ffe406f-b13d-43cf-86ef-4552b70916b5 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:18.555108 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9ffe406f-b13d-43cf-86ef-4552b70916b5 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:18.555539 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9ffe406f-b13d-43cf-86ef-4552b70916b5 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:18.691974 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-9ffe406f-b13d-43cf-86ef-4552b70916b5 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:18.700308 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-9ffe406f-b13d-43cf-86ef-4552b70916b5 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1520 microversion: 2.1 time: 0.159386 Jul 20 19:25:18.700885 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 120/249] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:18 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:19.717915 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-d3defcaf-c997-488f-8467-565865180fba tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:19.718449 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-d3defcaf-c997-488f-8467-565865180fba tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:19.724509 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d3defcaf-c997-488f-8467-565865180fba tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:19.724948 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d3defcaf-c997-488f-8467-565865180fba tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:19.725723 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d3defcaf-c997-488f-8467-565865180fba tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:19.726155 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d3defcaf-c997-488f-8467-565865180fba tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:19.861302 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-d3defcaf-c997-488f-8467-565865180fba tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:19.868710 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-d3defcaf-c997-488f-8467-565865180fba tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1520 microversion: 2.1 time: 0.154973 Jul 20 19:25:19.869275 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 130/250] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:19 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:20.424036 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-3d91f033-14d2-4edd-a057-ab66cc2cb069 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:20.424529 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-3d91f033-14d2-4edd-a057-ab66cc2cb069 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: af2baaf9-da80-407f-b960-d6b31aa82e24] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:20.432340 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3d91f033-14d2-4edd-a057-ab66cc2cb069 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:20.432790 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3d91f033-14d2-4edd-a057-ab66cc2cb069 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:20.433583 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3d91f033-14d2-4edd-a057-ab66cc2cb069 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:20.434020 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3d91f033-14d2-4edd-a057-ab66cc2cb069 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:20.462384 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-3d91f033-14d2-4edd-a057-ab66cc2cb069 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: af2baaf9-da80-407f-b960-d6b31aa82e24] Going to try to terminate instance {{(pid=117761) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 19:25:20.537364 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-3d91f033-14d2-4edd-a057-ab66cc2cb069 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "DELETE /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24" status: 204 len: 0 microversion: 2.1 time: 0.116527 Jul 20 19:25:20.540154 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 121/251] 10.222.0.69 () {58 vars in 1238 bytes} [Wed Jul 20 19:25:20 2022] DELETE /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 19:25:20.546599 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-c3a955a9-87e9-4ea7-a89c-5416c322c52b tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:20.547199 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-c3a955a9-87e9-4ea7-a89c-5416c322c52b tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: af2baaf9-da80-407f-b960-d6b31aa82e24] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:20.554036 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c3a955a9-87e9-4ea7-a89c-5416c322c52b tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:20.554479 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c3a955a9-87e9-4ea7-a89c-5416c322c52b tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:20.555383 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c3a955a9-87e9-4ea7-a89c-5416c322c52b tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:20.555812 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c3a955a9-87e9-4ea7-a89c-5416c322c52b tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:20.687259 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-c3a955a9-87e9-4ea7-a89c-5416c322c52b tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:20.695474 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-c3a955a9-87e9-4ea7-a89c-5416c322c52b tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24" status: 200 len: 1503 microversion: 2.1 time: 0.153149 Jul 20 19:25:20.696039 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 131/252] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:20 2022] GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24 => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:20.886674 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-cee28843-105b-4198-a3ca-bd4c28b52911 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:20.887570 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-cee28843-105b-4198-a3ca-bd4c28b52911 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:20.894108 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cee28843-105b-4198-a3ca-bd4c28b52911 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:20.894546 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cee28843-105b-4198-a3ca-bd4c28b52911 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:20.895293 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cee28843-105b-4198-a3ca-bd4c28b52911 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:20.895717 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cee28843-105b-4198-a3ca-bd4c28b52911 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:20.914170 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:21.037781 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-cee28843-105b-4198-a3ca-bd4c28b52911 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:21.045218 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-cee28843-105b-4198-a3ca-bd4c28b52911 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1520 microversion: 2.1 time: 0.163541 Jul 20 19:25:21.045814 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 122/253] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:20 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:25:21.713019 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-5d965986-8727-4925-bf87-291b3df2b6f8 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:21.713717 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-5d965986-8727-4925-bf87-291b3df2b6f8 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: af2baaf9-da80-407f-b960-d6b31aa82e24] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:21.719919 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-5d965986-8727-4925-bf87-291b3df2b6f8 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:21.720376 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-5d965986-8727-4925-bf87-291b3df2b6f8 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:21.721127 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-5d965986-8727-4925-bf87-291b3df2b6f8 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:21.721589 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-5d965986-8727-4925-bf87-291b3df2b6f8 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:21.852809 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-5d965986-8727-4925-bf87-291b3df2b6f8 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:21.860694 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-5d965986-8727-4925-bf87-291b3df2b6f8 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24" status: 200 len: 1503 microversion: 2.1 time: 0.152018 Jul 20 19:25:21.861258 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 132/254] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:21 2022] GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24 => generated 1503 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:22.063543 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-67ce3f63-d318-4c22-8a96-a859d69a0fca tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:22.064149 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-67ce3f63-d318-4c22-8a96-a859d69a0fca tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:22.071234 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-67ce3f63-d318-4c22-8a96-a859d69a0fca tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:22.071684 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-67ce3f63-d318-4c22-8a96-a859d69a0fca tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:22.072450 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-67ce3f63-d318-4c22-8a96-a859d69a0fca tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:22.072885 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-67ce3f63-d318-4c22-8a96-a859d69a0fca tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:22.201023 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-67ce3f63-d318-4c22-8a96-a859d69a0fca tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:22.208482 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-67ce3f63-d318-4c22-8a96-a859d69a0fca tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1520 microversion: 2.1 time: 0.148839 Jul 20 19:25:22.209057 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 123/255] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:22 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:22.401129 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-f41317f5-5f11-4d9a-b049-cfe93719658c tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2051792506", "imageRef": "59575804-e013-4dec-af24-b6c2dbbce73a", "flavorRef": "452"}} {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:25:22.452733 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.network.neutron [None req-f41317f5-5f11-4d9a-b049-cfe93719658c tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] validate_networks() for None {{(pid=117762) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 19:25:22.735398 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.virt.hardware [None req-f41317f5-5f11-4d9a-b049-cfe93719658c tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Flavor limits 0:0:0 {{(pid=117762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 19:25:22.735977 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.virt.hardware [None req-f41317f5-5f11-4d9a-b049-cfe93719658c tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Image limits 0:0:0 {{(pid=117762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 19:25:22.736303 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.virt.hardware [None req-f41317f5-5f11-4d9a-b049-cfe93719658c tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Flavor pref 0:0:0 {{(pid=117762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 19:25:22.736682 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.virt.hardware [None req-f41317f5-5f11-4d9a-b049-cfe93719658c tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Image pref 0:0:0 {{(pid=117762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 19:25:22.737080 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.virt.hardware [None req-f41317f5-5f11-4d9a-b049-cfe93719658c tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 19:25:22.750681 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f41317f5-5f11-4d9a-b049-cfe93719658c tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:22.751122 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f41317f5-5f11-4d9a-b049-cfe93719658c tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:22.751940 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f41317f5-5f11-4d9a-b049-cfe93719658c tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:22.752338 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f41317f5-5f11-4d9a-b049-cfe93719658c tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:22.769577 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.quota [None req-f41317f5-5f11-4d9a-b049-cfe93719658c tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Getting quotas for project d66a7bac21e44b72a59bb74c917daae1. Resources: {'cores', 'ram', 'instances'} {{(pid=117762) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:25:22.773566 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.quota [None req-f41317f5-5f11-4d9a-b049-cfe93719658c tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Getting quotas for user 67416d4eea6946fdb77a09242e58a12f and project d66a7bac21e44b72a59bb74c917daae1. Resources: {'cores', 'ram', 'instances'} {{(pid=117762) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:25:22.784419 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-f41317f5-5f11-4d9a-b049-cfe93719658c tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Going to run 1 instances... {{(pid=117762) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 19:25:22.786869 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-f41317f5-5f11-4d9a-b049-cfe93719658c tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] [instance: 062837f7-369c-477b-893d-36d1a9696004] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='59575804-e013-4dec-af24-b6c2dbbce73a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117762) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 19:25:22.831659 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-f41317f5-5f11-4d9a-b049-cfe93719658c tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.434350 Jul 20 19:25:22.832488 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 133/256] 10.222.0.69 () {60 vars in 1146 bytes} [Wed Jul 20 19:25:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 436 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 19:25:22.842779 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-1aa121c4-6648-4331-8efe-33ea0af1bbea tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:22.843387 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-1aa121c4-6648-4331-8efe-33ea0af1bbea tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] [instance: 062837f7-369c-477b-893d-36d1a9696004] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:22.883132 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-3cbf6573-3afe-43d5-ad5e-1c0c4850d996 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:22.883733 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-3cbf6573-3afe-43d5-ad5e-1c0c4850d996 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: af2baaf9-da80-407f-b960-d6b31aa82e24] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:22.890737 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3cbf6573-3afe-43d5-ad5e-1c0c4850d996 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:22.891229 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3cbf6573-3afe-43d5-ad5e-1c0c4850d996 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:22.891995 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3cbf6573-3afe-43d5-ad5e-1c0c4850d996 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:22.892430 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3cbf6573-3afe-43d5-ad5e-1c0c4850d996 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:22.906391 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1aa121c4-6648-4331-8efe-33ea0af1bbea tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67416d4eea6946fdb77a09242e58a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66a7bac21e44b72a59bb74c917daae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:22.913915 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-1aa121c4-6648-4331-8efe-33ea0af1bbea tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] 10.222.0.69 "GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004" status: 200 len: 1215 microversion: 2.1 time: 0.074597 Jul 20 19:25:22.923535 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 124/257] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:22 2022] GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004 => generated 1215 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:23.053479 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-3cbf6573-3afe-43d5-ad5e-1c0c4850d996 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:23.065501 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-3cbf6573-3afe-43d5-ad5e-1c0c4850d996 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24" status: 200 len: 1503 microversion: 2.1 time: 0.186213 Jul 20 19:25:23.066578 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 134/258] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:22 2022] GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24 => generated 1503 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:23.227348 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-b24956df-7d44-44c5-a17e-03487e1841f8 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:23.227964 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-b24956df-7d44-44c5-a17e-03487e1841f8 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:23.235017 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b24956df-7d44-44c5-a17e-03487e1841f8 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:23.235464 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b24956df-7d44-44c5-a17e-03487e1841f8 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:23.236873 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b24956df-7d44-44c5-a17e-03487e1841f8 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:23.237312 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b24956df-7d44-44c5-a17e-03487e1841f8 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:23.385784 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-b24956df-7d44-44c5-a17e-03487e1841f8 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:23.393391 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-b24956df-7d44-44c5-a17e-03487e1841f8 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1520 microversion: 2.1 time: 0.170913 Jul 20 19:25:23.394117 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 125/259] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:23 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:23.413716 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-d4247490-1202-45df-a699-a32b919e4401 tempest-VolumesTestJSON-469348597 tempest-VolumesTestJSON-469348597-project] Calling method '.version_select at 0x7ff60a2aa430>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:23.462721 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-d4247490-1202-45df-a699-a32b919e4401 tempest-VolumesTestJSON-469348597 tempest-VolumesTestJSON-469348597-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/e11f9616-7e4a-48cc-9eb6-3cf5692b603b" status: 200 len: 350 microversion: 2.1 time: 0.052696 Jul 20 19:25:23.463291 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 135/260] 10.222.0.69 () {58 vars in 1244 bytes} [Wed Jul 20 19:25:23 2022] GET /compute/v2.1/os-volumes/e11f9616-7e4a-48cc-9eb6-3cf5692b603b => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:25:23.931192 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-90cbc99e-7f30-4c72-be03-2c290d1ea1be tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:23.931821 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-90cbc99e-7f30-4c72-be03-2c290d1ea1be tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] [instance: 062837f7-369c-477b-893d-36d1a9696004] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:23.937926 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-90cbc99e-7f30-4c72-be03-2c290d1ea1be tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:23.938371 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-90cbc99e-7f30-4c72-be03-2c290d1ea1be tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:23.939123 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-90cbc99e-7f30-4c72-be03-2c290d1ea1be tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:23.939551 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-90cbc99e-7f30-4c72-be03-2c290d1ea1be tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:24.000301 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-90cbc99e-7f30-4c72-be03-2c290d1ea1be tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67416d4eea6946fdb77a09242e58a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66a7bac21e44b72a59bb74c917daae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:24.008737 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-90cbc99e-7f30-4c72-be03-2c290d1ea1be tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] 10.222.0.69 "GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004" status: 200 len: 1267 microversion: 2.1 time: 0.081672 Jul 20 19:25:24.009304 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 126/261] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:23 2022] GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004 => generated 1267 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:25:24.084034 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-4dff2eaa-2f69-426e-bc74-c5a641e7a411 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:24.084787 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-4dff2eaa-2f69-426e-bc74-c5a641e7a411 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: af2baaf9-da80-407f-b960-d6b31aa82e24] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:24.091532 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4dff2eaa-2f69-426e-bc74-c5a641e7a411 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:24.091987 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4dff2eaa-2f69-426e-bc74-c5a641e7a411 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:24.092768 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4dff2eaa-2f69-426e-bc74-c5a641e7a411 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:24.093192 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4dff2eaa-2f69-426e-bc74-c5a641e7a411 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:24.227810 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-4dff2eaa-2f69-426e-bc74-c5a641e7a411 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:24.237867 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-4dff2eaa-2f69-426e-bc74-c5a641e7a411 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24" status: 200 len: 1503 microversion: 2.1 time: 0.157568 Jul 20 19:25:24.238842 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 136/262] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:24 2022] GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24 => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:24.411696 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-85f91227-fe65-4872-9443-eabe4993adfa tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:24.413050 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-85f91227-fe65-4872-9443-eabe4993adfa tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:24.420786 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-85f91227-fe65-4872-9443-eabe4993adfa tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:24.421274 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-85f91227-fe65-4872-9443-eabe4993adfa tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:24.422082 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-85f91227-fe65-4872-9443-eabe4993adfa tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:24.422530 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-85f91227-fe65-4872-9443-eabe4993adfa tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:24.564146 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-85f91227-fe65-4872-9443-eabe4993adfa tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:24.571935 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-85f91227-fe65-4872-9443-eabe4993adfa tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1520 microversion: 2.1 time: 0.164318 Jul 20 19:25:24.572506 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 127/263] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:24 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:25.029255 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-adea6ad0-8364-42e8-89ea-ca36b3342556 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:25.029957 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-adea6ad0-8364-42e8-89ea-ca36b3342556 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] [instance: 062837f7-369c-477b-893d-36d1a9696004] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:25.036056 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-adea6ad0-8364-42e8-89ea-ca36b3342556 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:25.036498 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-adea6ad0-8364-42e8-89ea-ca36b3342556 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:25.037411 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-adea6ad0-8364-42e8-89ea-ca36b3342556 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:25.037903 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-adea6ad0-8364-42e8-89ea-ca36b3342556 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:25.114325 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-adea6ad0-8364-42e8-89ea-ca36b3342556 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67416d4eea6946fdb77a09242e58a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66a7bac21e44b72a59bb74c917daae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:25.121994 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-adea6ad0-8364-42e8-89ea-ca36b3342556 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] 10.222.0.69 "GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004" status: 200 len: 1273 microversion: 2.1 time: 0.100058 Jul 20 19:25:25.122550 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 137/264] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:25 2022] GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004 => generated 1273 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:25.256464 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-3bc36eb6-9555-44ba-a664-b88680b113b9 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:25.257963 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-3bc36eb6-9555-44ba-a664-b88680b113b9 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: af2baaf9-da80-407f-b960-d6b31aa82e24] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:25.264494 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3bc36eb6-9555-44ba-a664-b88680b113b9 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:25.264946 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3bc36eb6-9555-44ba-a664-b88680b113b9 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:25.265760 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3bc36eb6-9555-44ba-a664-b88680b113b9 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:25.266192 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3bc36eb6-9555-44ba-a664-b88680b113b9 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:25.589111 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-5fb4355a-a0a4-4ce3-8723-fc64c2cdbf96 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:25.589967 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-5fb4355a-a0a4-4ce3-8723-fc64c2cdbf96 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:25.597050 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-5fb4355a-a0a4-4ce3-8723-fc64c2cdbf96 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:25.598944 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-5fb4355a-a0a4-4ce3-8723-fc64c2cdbf96 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:25.598944 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-5fb4355a-a0a4-4ce3-8723-fc64c2cdbf96 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:25.598944 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-5fb4355a-a0a4-4ce3-8723-fc64c2cdbf96 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:25.690650 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3bc36eb6-9555-44ba-a664-b88680b113b9 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:25.703503 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-3bc36eb6-9555-44ba-a664-b88680b113b9 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24" status: 200 len: 1503 microversion: 2.1 time: 0.450406 Jul 20 19:25:25.704200 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 128/265] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:25 2022] GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24 => generated 1503 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:25.740856 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-5fb4355a-a0a4-4ce3-8723-fc64c2cdbf96 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:25.749209 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-5fb4355a-a0a4-4ce3-8723-fc64c2cdbf96 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1520 microversion: 2.1 time: 0.164673 Jul 20 19:25:25.749819 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 138/266] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:25 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:25:25.848939 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-7f63604f-7894-481e-a446-bc0879004f2d tempest-VolumesTestJSON-469348597 tempest-VolumesTestJSON-469348597-project] Calling method '.version_select at 0x7ff60a2b8430>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:25.906385 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-7f63604f-7894-481e-a446-bc0879004f2d tempest-VolumesTestJSON-469348597 tempest-VolumesTestJSON-469348597-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/2d098f64-d058-4432-bc05-a3d82c70e10d" status: 200 len: 350 microversion: 2.1 time: 0.061485 Jul 20 19:25:25.906959 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 129/267] 10.222.0.69 () {58 vars in 1244 bytes} [Wed Jul 20 19:25:25 2022] GET /compute/v2.1/os-volumes/2d098f64-d058-4432-bc05-a3d82c70e10d => generated 350 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:25:25.950643 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [req-54cfb5be-d9a7-4bfc-9f97-72c9d1a5aa90 req-ac3dfb83-68b6-4336-9fbd-c172caa2fda2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af2baaf9-da80-407f-b960-d6b31aa82e24", "name": "network-vif-deleted", "tag": "e13796a3-31bf-4f68-b72e-d9d7c014953b"}]} {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:25:25.958959 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [req-54cfb5be-d9a7-4bfc-9f97-72c9d1a5aa90 req-ac3dfb83-68b6-4336-9fbd-c172caa2fda2 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:25.959390 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [req-54cfb5be-d9a7-4bfc-9f97-72c9d1a5aa90 req-ac3dfb83-68b6-4336-9fbd-c172caa2fda2 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:25.971225 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.compute.server_external_events [req-54cfb5be-d9a7-4bfc-9f97-72c9d1a5aa90 req-ac3dfb83-68b6-4336-9fbd-c172caa2fda2 service nova] Creating event network-vif-deleted:e13796a3-31bf-4f68-b72e-d9d7c014953b for instance af2baaf9-da80-407f-b960-d6b31aa82e24 on hv-cinder-83538 Jul 20 19:25:25.977248 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [req-54cfb5be-d9a7-4bfc-9f97-72c9d1a5aa90 req-ac3dfb83-68b6-4336-9fbd-c172caa2fda2 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030109 Jul 20 19:25:25.977781 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 139/268] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 19:25:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:25:26.139241 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-83723d71-a399-4317-ad95-598f81ef1799 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:26.139659 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-83723d71-a399-4317-ad95-598f81ef1799 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] [instance: 062837f7-369c-477b-893d-36d1a9696004] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:26.146831 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-83723d71-a399-4317-ad95-598f81ef1799 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:26.148089 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-83723d71-a399-4317-ad95-598f81ef1799 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:26.149021 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-83723d71-a399-4317-ad95-598f81ef1799 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:26.149650 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-83723d71-a399-4317-ad95-598f81ef1799 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:26.351990 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-83723d71-a399-4317-ad95-598f81ef1799 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67416d4eea6946fdb77a09242e58a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66a7bac21e44b72a59bb74c917daae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:26.359356 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-83723d71-a399-4317-ad95-598f81ef1799 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] 10.222.0.69 "GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004" status: 200 len: 1273 microversion: 2.1 time: 0.224460 Jul 20 19:25:26.359920 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 130/269] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:26 2022] GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004 => generated 1273 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:26.721253 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-63954434-2a1a-4331-8025-2fb059253bc8 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:26.721974 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-63954434-2a1a-4331-8025-2fb059253bc8 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: af2baaf9-da80-407f-b960-d6b31aa82e24] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:26.729283 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-63954434-2a1a-4331-8025-2fb059253bc8 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:26.729764 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-63954434-2a1a-4331-8025-2fb059253bc8 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:26.730512 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-63954434-2a1a-4331-8025-2fb059253bc8 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:26.730944 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-63954434-2a1a-4331-8025-2fb059253bc8 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:26.766178 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-3ce6aed5-d9fe-489d-bff0-0ce90d5beb6f tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:26.766952 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-3ce6aed5-d9fe-489d-bff0-0ce90d5beb6f tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:26.774461 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3ce6aed5-d9fe-489d-bff0-0ce90d5beb6f tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:26.774945 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3ce6aed5-d9fe-489d-bff0-0ce90d5beb6f tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:26.775716 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3ce6aed5-d9fe-489d-bff0-0ce90d5beb6f tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:26.776142 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3ce6aed5-d9fe-489d-bff0-0ce90d5beb6f tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:26.796020 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-63954434-2a1a-4331-8025-2fb059253bc8 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:26.803570 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-63954434-2a1a-4331-8025-2fb059253bc8 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24" status: 200 len: 1461 microversion: 2.1 time: 0.086491 Jul 20 19:25:26.804136 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 140/270] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:26 2022] GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24 => generated 1461 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:26.907824 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3ce6aed5-d9fe-489d-bff0-0ce90d5beb6f tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:26.916187 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-3ce6aed5-d9fe-489d-bff0-0ce90d5beb6f tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1520 microversion: 2.1 time: 0.154392 Jul 20 19:25:26.916737 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 131/271] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:26 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:25:27.376271 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-a7a89f99-0e8b-469d-a4ae-c0677a2ab879 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:27.376877 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-a7a89f99-0e8b-469d-a4ae-c0677a2ab879 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] [instance: 062837f7-369c-477b-893d-36d1a9696004] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:27.383510 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a7a89f99-0e8b-469d-a4ae-c0677a2ab879 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:27.383957 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a7a89f99-0e8b-469d-a4ae-c0677a2ab879 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:27.384808 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a7a89f99-0e8b-469d-a4ae-c0677a2ab879 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:27.385240 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a7a89f99-0e8b-469d-a4ae-c0677a2ab879 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:27.447161 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-a7a89f99-0e8b-469d-a4ae-c0677a2ab879 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67416d4eea6946fdb77a09242e58a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66a7bac21e44b72a59bb74c917daae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:27.449438 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_cell1:SELECT=100 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:27.455997 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-a7a89f99-0e8b-469d-a4ae-c0677a2ab879 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] 10.222.0.69 "GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004" status: 200 len: 1273 microversion: 2.1 time: 0.083606 Jul 20 19:25:27.456594 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 141/272] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:27 2022] GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004 => generated 1273 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:27.820370 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-345ef775-eb9c-4de5-8e6b-c442e5a21432 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:27.821030 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-345ef775-eb9c-4de5-8e6b-c442e5a21432 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: af2baaf9-da80-407f-b960-d6b31aa82e24] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:27.827423 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-345ef775-eb9c-4de5-8e6b-c442e5a21432 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:27.827879 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-345ef775-eb9c-4de5-8e6b-c442e5a21432 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:27.828642 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-345ef775-eb9c-4de5-8e6b-c442e5a21432 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:27.829082 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-345ef775-eb9c-4de5-8e6b-c442e5a21432 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:27.890947 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-345ef775-eb9c-4de5-8e6b-c442e5a21432 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:27.898514 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-345ef775-eb9c-4de5-8e6b-c442e5a21432 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24" status: 200 len: 1461 microversion: 2.1 time: 0.082068 Jul 20 19:25:27.899072 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 132/273] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:27 2022] GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24 => generated 1461 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:27.933136 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-534e76ef-4467-4023-b989-b4e19822062d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:27.933774 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-534e76ef-4467-4023-b989-b4e19822062d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:27.939863 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-534e76ef-4467-4023-b989-b4e19822062d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:27.940307 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-534e76ef-4467-4023-b989-b4e19822062d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:27.941063 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-534e76ef-4467-4023-b989-b4e19822062d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:27.941504 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-534e76ef-4467-4023-b989-b4e19822062d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:28.073849 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-534e76ef-4467-4023-b989-b4e19822062d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:28.081456 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-534e76ef-4467-4023-b989-b4e19822062d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1520 microversion: 2.1 time: 0.152773 Jul 20 19:25:28.082045 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 142/274] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:27 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:28.472539 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a57d2564-2994-4a5f-b75a-c51875c5c5fb tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:28.473150 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a57d2564-2994-4a5f-b75a-c51875c5c5fb tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] [instance: 062837f7-369c-477b-893d-36d1a9696004] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:28.480121 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a57d2564-2994-4a5f-b75a-c51875c5c5fb tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:28.480575 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a57d2564-2994-4a5f-b75a-c51875c5c5fb tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:28.481336 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a57d2564-2994-4a5f-b75a-c51875c5c5fb tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:28.481802 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a57d2564-2994-4a5f-b75a-c51875c5c5fb tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:28.550381 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a57d2564-2994-4a5f-b75a-c51875c5c5fb tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67416d4eea6946fdb77a09242e58a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66a7bac21e44b72a59bb74c917daae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:28.557837 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a57d2564-2994-4a5f-b75a-c51875c5c5fb tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] 10.222.0.69 "GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004" status: 200 len: 1273 microversion: 2.1 time: 0.089074 Jul 20 19:25:28.558403 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 133/275] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:28 2022] GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004 => generated 1273 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:28.915591 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-5a7791ad-72f5-496d-b119-fe4d8c1abe24 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:28.916191 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-5a7791ad-72f5-496d-b119-fe4d8c1abe24 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: af2baaf9-da80-407f-b960-d6b31aa82e24] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:28.923367 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-5a7791ad-72f5-496d-b119-fe4d8c1abe24 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:28.923822 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-5a7791ad-72f5-496d-b119-fe4d8c1abe24 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:28.924579 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-5a7791ad-72f5-496d-b119-fe4d8c1abe24 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:28.925011 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-5a7791ad-72f5-496d-b119-fe4d8c1abe24 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:28.985483 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-5a7791ad-72f5-496d-b119-fe4d8c1abe24 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:28.993334 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-5a7791ad-72f5-496d-b119-fe4d8c1abe24 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24" status: 200 len: 1461 microversion: 2.1 time: 0.081602 Jul 20 19:25:28.993944 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 143/276] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:28 2022] GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24 => generated 1461 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:29.098809 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4600f03d-a98f-4b80-9f67-4f8dbf1a66ec tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:29.099657 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-4600f03d-a98f-4b80-9f67-4f8dbf1a66ec tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:29.105849 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4600f03d-a98f-4b80-9f67-4f8dbf1a66ec tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:29.106301 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4600f03d-a98f-4b80-9f67-4f8dbf1a66ec tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:29.107060 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4600f03d-a98f-4b80-9f67-4f8dbf1a66ec tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:29.107493 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4600f03d-a98f-4b80-9f67-4f8dbf1a66ec tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:29.240238 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-4600f03d-a98f-4b80-9f67-4f8dbf1a66ec tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:29.248147 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-4600f03d-a98f-4b80-9f67-4f8dbf1a66ec tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1520 microversion: 2.1 time: 0.153538 Jul 20 19:25:29.248710 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 134/277] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:29 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:29.574907 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-3532aebd-4f89-4106-9b5a-75bb1ce39096 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:29.575515 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-3532aebd-4f89-4106-9b5a-75bb1ce39096 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] [instance: 062837f7-369c-477b-893d-36d1a9696004] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:29.581533 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3532aebd-4f89-4106-9b5a-75bb1ce39096 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:29.581991 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3532aebd-4f89-4106-9b5a-75bb1ce39096 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:29.582749 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3532aebd-4f89-4106-9b5a-75bb1ce39096 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:29.583181 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3532aebd-4f89-4106-9b5a-75bb1ce39096 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:29.643869 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-3532aebd-4f89-4106-9b5a-75bb1ce39096 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67416d4eea6946fdb77a09242e58a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66a7bac21e44b72a59bb74c917daae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:29.652284 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-3532aebd-4f89-4106-9b5a-75bb1ce39096 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] 10.222.0.69 "GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004" status: 200 len: 1273 microversion: 2.1 time: 0.081427 Jul 20 19:25:29.652848 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 144/278] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:29 2022] GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004 => generated 1273 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:30.011236 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-346117c5-1e45-4471-9bcb-e4c1519ed7f8 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:30.011841 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-346117c5-1e45-4471-9bcb-e4c1519ed7f8 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: af2baaf9-da80-407f-b960-d6b31aa82e24] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:30.017852 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-346117c5-1e45-4471-9bcb-e4c1519ed7f8 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:30.018308 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-346117c5-1e45-4471-9bcb-e4c1519ed7f8 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:30.019070 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-346117c5-1e45-4471-9bcb-e4c1519ed7f8 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:30.019508 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-346117c5-1e45-4471-9bcb-e4c1519ed7f8 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:30.082491 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-346117c5-1e45-4471-9bcb-e4c1519ed7f8 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:30.090904 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-346117c5-1e45-4471-9bcb-e4c1519ed7f8 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24" status: 200 len: 1461 microversion: 2.1 time: 0.084159 Jul 20 19:25:30.091705 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 135/279] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:30 2022] GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24 => generated 1461 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:30.264607 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-5660f4f3-f813-4c72-85be-685f1402ada2 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:30.265210 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-5660f4f3-f813-4c72-85be-685f1402ada2 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:30.271261 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-5660f4f3-f813-4c72-85be-685f1402ada2 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:30.271704 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-5660f4f3-f813-4c72-85be-685f1402ada2 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:30.272455 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-5660f4f3-f813-4c72-85be-685f1402ada2 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:30.272883 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-5660f4f3-f813-4c72-85be-685f1402ada2 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:30.405936 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-5660f4f3-f813-4c72-85be-685f1402ada2 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:30.413340 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-5660f4f3-f813-4c72-85be-685f1402ada2 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1520 microversion: 2.1 time: 0.152640 Jul 20 19:25:30.414356 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 145/280] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:30 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:30.669034 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ccf8378d-b252-4f62-acff-cabe3a9a7944 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:30.669723 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ccf8378d-b252-4f62-acff-cabe3a9a7944 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] [instance: 062837f7-369c-477b-893d-36d1a9696004] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:30.676158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ccf8378d-b252-4f62-acff-cabe3a9a7944 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:30.676607 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ccf8378d-b252-4f62-acff-cabe3a9a7944 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:30.677371 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ccf8378d-b252-4f62-acff-cabe3a9a7944 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:30.677837 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ccf8378d-b252-4f62-acff-cabe3a9a7944 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:30.739136 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ccf8378d-b252-4f62-acff-cabe3a9a7944 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67416d4eea6946fdb77a09242e58a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66a7bac21e44b72a59bb74c917daae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:30.747199 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ccf8378d-b252-4f62-acff-cabe3a9a7944 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] 10.222.0.69 "GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004" status: 200 len: 1273 microversion: 2.1 time: 0.082020 Jul 20 19:25:30.747758 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 136/281] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:30 2022] GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004 => generated 1273 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:25:31.108687 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-922e6374-fb5e-424d-873e-4bccf132d106 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:31.109288 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-922e6374-fb5e-424d-873e-4bccf132d106 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: af2baaf9-da80-407f-b960-d6b31aa82e24] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:31.115256 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-922e6374-fb5e-424d-873e-4bccf132d106 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:31.115908 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-922e6374-fb5e-424d-873e-4bccf132d106 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:31.116670 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-922e6374-fb5e-424d-873e-4bccf132d106 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:31.117696 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-922e6374-fb5e-424d-873e-4bccf132d106 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:31.147833 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-922e6374-fb5e-424d-873e-4bccf132d106 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:31.148828 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-922e6374-fb5e-424d-873e-4bccf132d106 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:31.149297 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.objects.instance [None req-922e6374-fb5e-424d-873e-4bccf132d106 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lazy-loading 'fault' on Instance uuid af2baaf9-da80-407f-b960-d6b31aa82e24 {{(pid=117762) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:25:31.193966 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-922e6374-fb5e-424d-873e-4bccf132d106 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:31.202284 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-922e6374-fb5e-424d-873e-4bccf132d106 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24" status: 200 len: 1304 microversion: 2.1 time: 0.097530 Jul 20 19:25:31.202850 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 146/282] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:31 2022] GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24 => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:31.431303 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-63363ee9-cf1e-4dbe-87c2-2f9283ccbe1c tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:31.432110 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-63363ee9-cf1e-4dbe-87c2-2f9283ccbe1c tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:31.442364 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-63363ee9-cf1e-4dbe-87c2-2f9283ccbe1c tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:31.442364 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-63363ee9-cf1e-4dbe-87c2-2f9283ccbe1c tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:31.442990 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-63363ee9-cf1e-4dbe-87c2-2f9283ccbe1c tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:31.443330 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-63363ee9-cf1e-4dbe-87c2-2f9283ccbe1c tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:31.633133 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-63363ee9-cf1e-4dbe-87c2-2f9283ccbe1c tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:31.643562 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-63363ee9-cf1e-4dbe-87c2-2f9283ccbe1c tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1520 microversion: 2.1 time: 0.217066 Jul 20 19:25:31.644995 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 137/283] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:31 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1520 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:31.764394 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-939433c3-788c-4b78-ac5c-91a170ab173d tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:31.765645 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-939433c3-788c-4b78-ac5c-91a170ab173d tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] [instance: 062837f7-369c-477b-893d-36d1a9696004] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:31.771961 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-939433c3-788c-4b78-ac5c-91a170ab173d tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:31.772440 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-939433c3-788c-4b78-ac5c-91a170ab173d tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:31.773904 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-939433c3-788c-4b78-ac5c-91a170ab173d tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:31.774517 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-939433c3-788c-4b78-ac5c-91a170ab173d tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:31.911332 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-939433c3-788c-4b78-ac5c-91a170ab173d tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67416d4eea6946fdb77a09242e58a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66a7bac21e44b72a59bb74c917daae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:31.918937 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-939433c3-788c-4b78-ac5c-91a170ab173d tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] 10.222.0.69 "GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004" status: 200 len: 1315 microversion: 2.1 time: 0.158381 Jul 20 19:25:31.919505 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 147/284] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:31 2022] GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:32.221357 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c31d00b6-0429-4b24-87c5-85a91d2454de tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:32.221955 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c31d00b6-0429-4b24-87c5-85a91d2454de tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: af2baaf9-da80-407f-b960-d6b31aa82e24] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:32.230574 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c31d00b6-0429-4b24-87c5-85a91d2454de tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:32.230979 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c31d00b6-0429-4b24-87c5-85a91d2454de tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:32.231757 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c31d00b6-0429-4b24-87c5-85a91d2454de tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:32.232328 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c31d00b6-0429-4b24-87c5-85a91d2454de tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:32.238084 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [req-0c756eb0-e93e-4ba6-a5d6-763b6d7bd27b req-68d3b3a3-763b-4015-8c2a-c3fca0367a39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "062837f7-369c-477b-893d-36d1a9696004", "tag": "80acceeb-fba4-45d0-b45a-c31c4c4199e5"}]} {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:25:32.249926 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [req-0c756eb0-e93e-4ba6-a5d6-763b6d7bd27b req-68d3b3a3-763b-4015-8c2a-c3fca0367a39 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:32.253867 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [req-0c756eb0-e93e-4ba6-a5d6-763b6d7bd27b req-68d3b3a3-763b-4015-8c2a-c3fca0367a39 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:32.269528 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.compute.server_external_events [req-0c756eb0-e93e-4ba6-a5d6-763b6d7bd27b req-68d3b3a3-763b-4015-8c2a-c3fca0367a39 service nova] Creating event network-changed:80acceeb-fba4-45d0-b45a-c31c4c4199e5 for instance 062837f7-369c-477b-893d-36d1a9696004 on hv-cinder-83538 Jul 20 19:25:32.275290 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [req-0c756eb0-e93e-4ba6-a5d6-763b6d7bd27b req-68d3b3a3-763b-4015-8c2a-c3fca0367a39 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041161 Jul 20 19:25:32.276408 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 148/285] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 19:25:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:25:32.281024 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c31d00b6-0429-4b24-87c5-85a91d2454de tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:32.281480 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c31d00b6-0429-4b24-87c5-85a91d2454de tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:32.281978 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.objects.instance [None req-c31d00b6-0429-4b24-87c5-85a91d2454de tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lazy-loading 'fault' on Instance uuid af2baaf9-da80-407f-b960-d6b31aa82e24 {{(pid=117761) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:25:32.330675 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c31d00b6-0429-4b24-87c5-85a91d2454de tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:32.338600 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c31d00b6-0429-4b24-87c5-85a91d2454de tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24" status: 200 len: 1304 microversion: 2.1 time: 0.122148 Jul 20 19:25:32.339227 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 138/286] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:32 2022] GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24 => generated 1304 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:32.662300 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-5875735d-0c6f-4ba5-9e9e-15a35c21e3ae tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:32.662993 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-5875735d-0c6f-4ba5-9e9e-15a35c21e3ae tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:32.670013 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-5875735d-0c6f-4ba5-9e9e-15a35c21e3ae tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:32.676428 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-5875735d-0c6f-4ba5-9e9e-15a35c21e3ae tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:32.676428 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-5875735d-0c6f-4ba5-9e9e-15a35c21e3ae tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:32.676428 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-5875735d-0c6f-4ba5-9e9e-15a35c21e3ae tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:32.760098 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_cell0:SELECT=2 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:32.779988 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_cell0:SELECT=6 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:32.815097 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-5875735d-0c6f-4ba5-9e9e-15a35c21e3ae tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:32.823791 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-5875735d-0c6f-4ba5-9e9e-15a35c21e3ae tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1520 microversion: 2.1 time: 0.165594 Jul 20 19:25:32.824359 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 149/287] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:32 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:32.937076 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-2215bace-a42e-4b7b-9f86-5c68e5dac762 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:32.937714 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-2215bace-a42e-4b7b-9f86-5c68e5dac762 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] [instance: 062837f7-369c-477b-893d-36d1a9696004] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:32.939629 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell0:SELECT=2 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:32.946348 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2215bace-a42e-4b7b-9f86-5c68e5dac762 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:32.946821 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2215bace-a42e-4b7b-9f86-5c68e5dac762 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:32.947586 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2215bace-a42e-4b7b-9f86-5c68e5dac762 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:32.948016 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2215bace-a42e-4b7b-9f86-5c68e5dac762 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:33.082418 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-2215bace-a42e-4b7b-9f86-5c68e5dac762 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67416d4eea6946fdb77a09242e58a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66a7bac21e44b72a59bb74c917daae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:33.089940 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-2215bace-a42e-4b7b-9f86-5c68e5dac762 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] 10.222.0.69 "GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004" status: 200 len: 1315 microversion: 2.1 time: 0.156785 Jul 20 19:25:33.090494 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 139/288] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:32 2022] GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:33.356440 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-bbc276c4-1b34-44de-b822-4ba45e254595 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:33.357043 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-bbc276c4-1b34-44de-b822-4ba45e254595 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: af2baaf9-da80-407f-b960-d6b31aa82e24] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:33.363235 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-bbc276c4-1b34-44de-b822-4ba45e254595 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:33.363681 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-bbc276c4-1b34-44de-b822-4ba45e254595 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:33.364438 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-bbc276c4-1b34-44de-b822-4ba45e254595 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:33.364871 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-bbc276c4-1b34-44de-b822-4ba45e254595 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:33.396418 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-bbc276c4-1b34-44de-b822-4ba45e254595 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:33.396857 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-bbc276c4-1b34-44de-b822-4ba45e254595 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:33.397295 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.objects.instance [None req-bbc276c4-1b34-44de-b822-4ba45e254595 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lazy-loading 'fault' on Instance uuid af2baaf9-da80-407f-b960-d6b31aa82e24 {{(pid=117762) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:25:33.438307 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-bbc276c4-1b34-44de-b822-4ba45e254595 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:33.446090 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-bbc276c4-1b34-44de-b822-4ba45e254595 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24" status: 200 len: 1304 microversion: 2.1 time: 0.093587 Jul 20 19:25:33.446610 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 150/289] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:33 2022] GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24 => generated 1304 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:33.536248 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c4e99999-8b40-4865-b2ce-61bfbf415fcc tempest-VolumesTestJSON-469348597 tempest-VolumesTestJSON-469348597-project] Calling method '.version_select at 0x7ff60a4319d0>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:33.582515 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c4e99999-8b40-4865-b2ce-61bfbf415fcc tempest-VolumesTestJSON-469348597 tempest-VolumesTestJSON-469348597-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/4552c032-0308-4b99-9242-d0b5d8ee9967" status: 200 len: 350 microversion: 2.1 time: 0.050100 Jul 20 19:25:33.583244 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 140/290] 10.222.0.69 () {58 vars in 1244 bytes} [Wed Jul 20 19:25:33 2022] GET /compute/v2.1/os-volumes/4552c032-0308-4b99-9242-d0b5d8ee9967 => generated 350 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:25:33.595331 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-3d56388c-fa27-4fd9-921f-41c147c7a380 tempest-VolumesTestJSON-469348597 tempest-VolumesTestJSON-469348597-project] Calling method '.version_select at 0x7ff60a28a8b0>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:33.677412 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-3d56388c-fa27-4fd9-921f-41c147c7a380 tempest-VolumesTestJSON-469348597 tempest-VolumesTestJSON-469348597-project] 10.222.0.69 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.086365 Jul 20 19:25:33.678081 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 151/291] 10.222.0.69 () {58 vars in 1133 bytes} [Wed Jul 20 19:25:33 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:33.689814 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-8c56f8d5-20f4-4db5-a679-6eb2f10dee8f tempest-VolumesTestJSON-469348597 tempest-VolumesTestJSON-469348597-project] Calling method '.version_select at 0x7ff60a3a4040>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:33.777930 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-8c56f8d5-20f4-4db5-a679-6eb2f10dee8f tempest-VolumesTestJSON-469348597 tempest-VolumesTestJSON-469348597-project] 10.222.0.69 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.091723 Jul 20 19:25:33.778501 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 141/292] 10.222.0.69 () {58 vars in 1148 bytes} [Wed Jul 20 19:25:33 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:25:33.790624 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-a594ef90-e188-454c-b439-111bbc82795c tempest-VolumesTestJSON-469348597 tempest-VolumesTestJSON-469348597-project] Calling method '.version_select at 0x7ff60a2b0ee0>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:33.842608 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-b4d3870c-a12d-4391-85e5-f8f1bba1ba04 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:33.843156 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-b4d3870c-a12d-4391-85e5-f8f1bba1ba04 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:33.849853 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b4d3870c-a12d-4391-85e5-f8f1bba1ba04 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:33.850301 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b4d3870c-a12d-4391-85e5-f8f1bba1ba04 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:33.851060 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b4d3870c-a12d-4391-85e5-f8f1bba1ba04 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:33.851491 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b4d3870c-a12d-4391-85e5-f8f1bba1ba04 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:33.873772 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-a594ef90-e188-454c-b439-111bbc82795c tempest-VolumesTestJSON-469348597 tempest-VolumesTestJSON-469348597-project] 10.222.0.69 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.086795 Jul 20 19:25:33.874346 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 152/293] 10.222.0.69 () {58 vars in 1133 bytes} [Wed Jul 20 19:25:33 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:33.886911 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-8c7b521a-4678-4103-96c1-d6bd90ab1b7e tempest-VolumesTestJSON-469348597 tempest-VolumesTestJSON-469348597-project] Calling method '.version_select at 0x7ff60a2aa5e0>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:33.969733 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-8c7b521a-4678-4103-96c1-d6bd90ab1b7e tempest-VolumesTestJSON-469348597 tempest-VolumesTestJSON-469348597-project] 10.222.0.69 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.087185 Jul 20 19:25:33.970338 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 153/294] 10.222.0.69 () {58 vars in 1166 bytes} [Wed Jul 20 19:25:33 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:25:33.981956 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-f8a7305f-5f27-41e0-acfb-e064536a9541 tempest-VolumesTestJSON-469348597 tempest-VolumesTestJSON-469348597-project] Calling method '.version_select at 0x7ff60a2aa1f0>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:33.987126 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-b4d3870c-a12d-4391-85e5-f8f1bba1ba04 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:33.989330 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:33.995717 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-b4d3870c-a12d-4391-85e5-f8f1bba1ba04 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1520 microversion: 2.1 time: 0.157257 Jul 20 19:25:33.996445 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 142/295] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:33 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:25:34.064813 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-f8a7305f-5f27-41e0-acfb-e064536a9541 tempest-VolumesTestJSON-469348597 tempest-VolumesTestJSON-469348597-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.086444 Jul 20 19:25:34.065387 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 154/296] 10.222.0.69 () {58 vars in 1169 bytes} [Wed Jul 20 19:25:33 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:25:34.077997 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-3e77a1f9-ecff-44e6-9fc1-cceef605a6f5 tempest-VolumesTestJSON-469348597 tempest-VolumesTestJSON-469348597-project] Calling method '.version_select at 0x7ff60a431a60>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:34.106941 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-4ee02055-1aed-4b79-9f3a-3727aed85eeb tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:34.107544 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-4ee02055-1aed-4b79-9f3a-3727aed85eeb tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] [instance: 062837f7-369c-477b-893d-36d1a9696004] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:34.113822 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4ee02055-1aed-4b79-9f3a-3727aed85eeb tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:34.114268 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4ee02055-1aed-4b79-9f3a-3727aed85eeb tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:34.115055 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4ee02055-1aed-4b79-9f3a-3727aed85eeb tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:34.115486 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4ee02055-1aed-4b79-9f3a-3727aed85eeb tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:34.161959 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-3e77a1f9-ecff-44e6-9fc1-cceef605a6f5 tempest-VolumesTestJSON-469348597 tempest-VolumesTestJSON-469348597-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.087529 Jul 20 19:25:34.162546 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 143/297] 10.222.0.69 () {58 vars in 1154 bytes} [Wed Jul 20 19:25:34 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:34.173290 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a75eeb27-58b2-4f6b-a6d5-b595a4a82fe2 tempest-VolumesTestJSON-469348597 tempest-VolumesTestJSON-469348597-project] Calling method '.version_select at 0x7ff60a297790>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:34.247352 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-4ee02055-1aed-4b79-9f3a-3727aed85eeb tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67416d4eea6946fdb77a09242e58a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66a7bac21e44b72a59bb74c917daae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:34.255792 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-4ee02055-1aed-4b79-9f3a-3727aed85eeb tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] 10.222.0.69 "GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004" status: 200 len: 1315 microversion: 2.1 time: 0.152640 Jul 20 19:25:34.256723 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 155/298] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:34 2022] GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:25:34.265695 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a75eeb27-58b2-4f6b-a6d5-b595a4a82fe2 tempest-VolumesTestJSON-469348597 tempest-VolumesTestJSON-469348597-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.095573 Jul 20 19:25:34.266855 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 144/299] 10.222.0.69 () {58 vars in 1187 bytes} [Wed Jul 20 19:25:34 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:25:34.281270 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-94f401f2-75f7-4ba0-bad1-09e0501d228d tempest-VolumesTestJSON-469348597 tempest-VolumesTestJSON-469348597-project] Calling method '.version_select at 0x7ff60bed5f70>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:34.361210 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-94f401f2-75f7-4ba0-bad1-09e0501d228d tempest-VolumesTestJSON-469348597 tempest-VolumesTestJSON-469348597-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.084126 Jul 20 19:25:34.361818 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 156/300] 10.222.0.69 () {58 vars in 1154 bytes} [Wed Jul 20 19:25:34 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:34.463338 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a8fa10ed-5ba5-41ef-84e2-d09a973ee67f tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:34.463968 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a8fa10ed-5ba5-41ef-84e2-d09a973ee67f tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: af2baaf9-da80-407f-b960-d6b31aa82e24] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:34.477717 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a8fa10ed-5ba5-41ef-84e2-d09a973ee67f tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:34.478492 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a8fa10ed-5ba5-41ef-84e2-d09a973ee67f tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:34.479519 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a8fa10ed-5ba5-41ef-84e2-d09a973ee67f tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:34.480705 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a8fa10ed-5ba5-41ef-84e2-d09a973ee67f tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:34.523693 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.wsgi [None req-a8fa10ed-5ba5-41ef-84e2-d09a973ee67f tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] HTTP exception thrown: Instance af2baaf9-da80-407f-b960-d6b31aa82e24 could not be found. Jul 20 19:25:34.525657 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a8fa10ed-5ba5-41ef-84e2-d09a973ee67f tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Request method failure captured: Jul 20 19:25:34.525657 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24 HTTP/1.1 Jul 20 19:25:34.525657 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 19:25:34.525657 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 19:25:34.525657 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 19:25:34.525657 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 0 Jul 20 19:25:34.525657 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 19:25:34.525657 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 19:25:34.525657 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 19:25:34.525657 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 19:25:34.525657 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2FZsn7685DM9SLvtQV_LDBZDykfdEYx6SNSStXL5oaRkCrrKqGHsgQWEyXvKrCQMLaoSl3PTSvWE3zx8PB7Lpjs6Kjh0TRXL_K-G7m-RCQ8GUQpsMQ-rbAbgF2bGpFmqtgIC5uqbam_lnhV7mop476Sk3e_ThGJUHsElxBP8yFq_osY Jul 20 19:25:34.525657 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 19:25:34.525657 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 19:25:34.525657 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 19:25:34.525657 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 19:25:34.525657 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 19:25:34.525657 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 19:25:34.525657 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: a51cf9bd2ea44ebe8edd25559baafc4e Jul 20 19:25:34.525657 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-VolumesActionsTest-2131679193 Jul 20 19:25:34.525657 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 19:25:34.525657 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 19:25:34.526893 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a51cf9bd2ea44ebe8edd25559baafc4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a51cf9bd2ea44ebe8edd25559baafc4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_a51cf9bd2ea44ebe8edd25559baafc4e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/a51cf9bd2ea44ebe8edd25559baafc4e"}]}] Jul 20 19:25:34.526893 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-VolumesActionsTest-2131679193 Jul 20 19:25:34.526893 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: a51cf9bd2ea44ebe8edd25559baafc4e Jul 20 19:25:34.526893 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-VolumesActionsTest-2131679193 Jul 20 19:25:34.526893 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-VolumesActionsTest-2131679193-project Jul 20 19:25:34.526893 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 19:25:34.526893 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 19:25:34.526893 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: afa79c7408524e979cf0e9a595fe731a Jul 20 19:25:34.526893 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-VolumesActionsTest-2131679193-project Jul 20 19:25:34.526893 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: > Jul 20 19:25:34.526893 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Instance af2baaf9-da80-407f-b960-d6b31aa82e24 could not be found. Jul 20 19:25:34.526893 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'id': 'af2baaf9-da80-407f-b960-d6b31aa82e24'} Jul 20 19:25:34.527596 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:25:34.527596 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:25:34.527596 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:25:34.527596 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:25:34.527596 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:25:34.527596 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:25:34.527596 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:25:34.527596 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:25:34.527596 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:25:34.527596 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:25:34.527596 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af2baaf9-da80-407f-b960-d6b31aa82e24 could not be found. Jul 20 19:25:34.527596 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:25:34.527596 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:25:34.527596 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:25:34.527596 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:25:34.527596 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:25:34.527596 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:25:34.527596 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:25:34.527596 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:25:34.527596 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:25:34.528719 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:25:34.528719 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:25:34.528719 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:25:34.528719 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:25:34.528719 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:25:34.528719 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:25:34.528719 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:25:34.528719 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af2baaf9-da80-407f-b960-d6b31aa82e24 could not be found. Jul 20 19:25:34.528719 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:25:34.528719 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:25:34.528719 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:25:34.528719 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:25:34.528719 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:25:34.528719 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:25:34.528719 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:25:34.528719 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:25:34.528719 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af2baaf9-da80-407f-b960-d6b31aa82e24 could not be found. Jul 20 19:25:34.528719 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:25:34.531051 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a8fa10ed-5ba5-41ef-84e2-d09a973ee67f tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Returning 404 to user: Instance af2baaf9-da80-407f-b960-d6b31aa82e24 could not be found. {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:25:34.532222 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a8fa10ed-5ba5-41ef-84e2-d09a973ee67f tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24" status: 404 len: 111 microversion: 2.1 time: 0.073115 Jul 20 19:25:34.532820 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 145/301] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:34 2022] GET /compute/v2.1/servers/af2baaf9-da80-407f-b960-d6b31aa82e24 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 19:25:34.652176 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-c2eb1dd4-79a8-49e5-96e0-5d09acfbd41d tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-58261950", "imageRef": "59575804-e013-4dec-af24-b6c2dbbce73a", "flavorRef": "452", "networks": [{"uuid": "100f0542-9a02-4a7d-9b70-eb4cf3a832ac"}]}} {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:25:34.710769 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.network.neutron [None req-c2eb1dd4-79a8-49e5-96e0-5d09acfbd41d tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] validate_networks() for [('100f0542-9a02-4a7d-9b70-eb4cf3a832ac', None, None, None, None, None)] {{(pid=117762) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 19:25:35.013269 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c27fc76c-02e9-4a50-8b4a-a86d9296ef85 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:35.014729 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c27fc76c-02e9-4a50-8b4a-a86d9296ef85 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:35.021840 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c27fc76c-02e9-4a50-8b4a-a86d9296ef85 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:35.022581 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c27fc76c-02e9-4a50-8b4a-a86d9296ef85 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:35.024179 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c27fc76c-02e9-4a50-8b4a-a86d9296ef85 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:35.024841 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c27fc76c-02e9-4a50-8b4a-a86d9296ef85 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:35.083398 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.virt.hardware [None req-c2eb1dd4-79a8-49e5-96e0-5d09acfbd41d tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Flavor limits 0:0:0 {{(pid=117762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 19:25:35.083895 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.virt.hardware [None req-c2eb1dd4-79a8-49e5-96e0-5d09acfbd41d tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Image limits 0:0:0 {{(pid=117762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 19:25:35.084337 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.virt.hardware [None req-c2eb1dd4-79a8-49e5-96e0-5d09acfbd41d tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Flavor pref 0:0:0 {{(pid=117762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 19:25:35.084744 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.virt.hardware [None req-c2eb1dd4-79a8-49e5-96e0-5d09acfbd41d tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Image pref 0:0:0 {{(pid=117762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 19:25:35.085162 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.virt.hardware [None req-c2eb1dd4-79a8-49e5-96e0-5d09acfbd41d tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 19:25:35.094954 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c2eb1dd4-79a8-49e5-96e0-5d09acfbd41d tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:35.095401 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c2eb1dd4-79a8-49e5-96e0-5d09acfbd41d tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:35.096203 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c2eb1dd4-79a8-49e5-96e0-5d09acfbd41d tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:35.096638 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c2eb1dd4-79a8-49e5-96e0-5d09acfbd41d tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:35.114180 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.quota [None req-c2eb1dd4-79a8-49e5-96e0-5d09acfbd41d tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Getting quotas for project a51cf9bd2ea44ebe8edd25559baafc4e. Resources: {'cores', 'ram', 'instances'} {{(pid=117762) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:25:35.118238 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.quota [None req-c2eb1dd4-79a8-49e5-96e0-5d09acfbd41d tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Getting quotas for user afa79c7408524e979cf0e9a595fe731a and project a51cf9bd2ea44ebe8edd25559baafc4e. Resources: {'cores', 'ram', 'instances'} {{(pid=117762) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:25:35.129287 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-c2eb1dd4-79a8-49e5-96e0-5d09acfbd41d tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Going to run 1 instances... {{(pid=117762) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 19:25:35.131581 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-c2eb1dd4-79a8-49e5-96e0-5d09acfbd41d tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: 230833df-72df-406e-8051-75b5032d5018] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='59575804-e013-4dec-af24-b6c2dbbce73a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117762) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 19:25:35.178015 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-c2eb1dd4-79a8-49e5-96e0-5d09acfbd41d tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.529809 Jul 20 19:25:35.179061 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 157/302] 10.222.0.69 () {60 vars in 1146 bytes} [Wed Jul 20 19:25:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 19:25:35.188688 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-59752344-ccfe-4caf-bdbb-ab609af9dc92 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:35.189296 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-59752344-ccfe-4caf-bdbb-ab609af9dc92 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: 230833df-72df-406e-8051-75b5032d5018] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:35.222492 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c27fc76c-02e9-4a50-8b4a-a86d9296ef85 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:35.231236 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c27fc76c-02e9-4a50-8b4a-a86d9296ef85 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1520 microversion: 2.1 time: 0.222768 Jul 20 19:25:35.232715 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 146/303] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:35 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1520 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:25:35.256429 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-59752344-ccfe-4caf-bdbb-ab609af9dc92 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:35.264690 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-59752344-ccfe-4caf-bdbb-ab609af9dc92 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018" status: 200 len: 1212 microversion: 2.1 time: 0.079733 Jul 20 19:25:35.265462 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 158/304] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:35 2022] GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018 => generated 1212 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:25:35.274623 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-296b742f-b6b0-46c0-a223-2b68886dd7c9 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:35.275297 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-296b742f-b6b0-46c0-a223-2b68886dd7c9 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] [instance: 062837f7-369c-477b-893d-36d1a9696004] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:35.281442 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-296b742f-b6b0-46c0-a223-2b68886dd7c9 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:35.282015 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-296b742f-b6b0-46c0-a223-2b68886dd7c9 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:35.282930 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-296b742f-b6b0-46c0-a223-2b68886dd7c9 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:35.283418 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-296b742f-b6b0-46c0-a223-2b68886dd7c9 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:35.489062 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-296b742f-b6b0-46c0-a223-2b68886dd7c9 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67416d4eea6946fdb77a09242e58a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66a7bac21e44b72a59bb74c917daae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:35.497266 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-296b742f-b6b0-46c0-a223-2b68886dd7c9 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] 10.222.0.69 "GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004" status: 200 len: 1315 microversion: 2.1 time: 0.227890 Jul 20 19:25:35.498178 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 147/305] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:35 2022] GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004 => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:25:36.249045 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-de89c1a7-3102-4272-85b5-6375213fd21d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:36.249675 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-de89c1a7-3102-4272-85b5-6375213fd21d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:36.255873 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-de89c1a7-3102-4272-85b5-6375213fd21d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:36.256350 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-de89c1a7-3102-4272-85b5-6375213fd21d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:36.257562 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-de89c1a7-3102-4272-85b5-6375213fd21d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:36.258123 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-de89c1a7-3102-4272-85b5-6375213fd21d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:36.282448 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a5495a7e-452b-4a35-b4c9-4a0470095b72 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:36.283192 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a5495a7e-452b-4a35-b4c9-4a0470095b72 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: 230833df-72df-406e-8051-75b5032d5018] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:36.290359 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a5495a7e-452b-4a35-b4c9-4a0470095b72 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:36.290803 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a5495a7e-452b-4a35-b4c9-4a0470095b72 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:36.291577 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a5495a7e-452b-4a35-b4c9-4a0470095b72 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:36.292011 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a5495a7e-452b-4a35-b4c9-4a0470095b72 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:36.355739 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a5495a7e-452b-4a35-b4c9-4a0470095b72 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:36.363279 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a5495a7e-452b-4a35-b4c9-4a0470095b72 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018" status: 200 len: 1216 microversion: 2.1 time: 0.084646 Jul 20 19:25:36.363839 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 148/306] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:36 2022] GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018 => generated 1216 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:25:36.390326 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-de89c1a7-3102-4272-85b5-6375213fd21d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:36.397697 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-de89c1a7-3102-4272-85b5-6375213fd21d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1520 microversion: 2.1 time: 0.152542 Jul 20 19:25:36.398870 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 159/307] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:36 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:36.514169 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-48c07576-bc44-4ed0-9e50-24908b6dc2da tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:36.514697 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-48c07576-bc44-4ed0-9e50-24908b6dc2da tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] [instance: 062837f7-369c-477b-893d-36d1a9696004] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:36.520669 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-48c07576-bc44-4ed0-9e50-24908b6dc2da tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:36.521100 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-48c07576-bc44-4ed0-9e50-24908b6dc2da tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:36.521889 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-48c07576-bc44-4ed0-9e50-24908b6dc2da tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:36.522371 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-48c07576-bc44-4ed0-9e50-24908b6dc2da tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:36.663242 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-48c07576-bc44-4ed0-9e50-24908b6dc2da tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67416d4eea6946fdb77a09242e58a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66a7bac21e44b72a59bb74c917daae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:36.671720 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-48c07576-bc44-4ed0-9e50-24908b6dc2da tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] 10.222.0.69 "GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004" status: 200 len: 1315 microversion: 2.1 time: 0.161390 Jul 20 19:25:36.672284 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 149/308] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:36 2022] GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:37.380747 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-baa6c884-c03b-423f-a93f-b94bb4f711e9 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:37.381276 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-baa6c884-c03b-423f-a93f-b94bb4f711e9 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: 230833df-72df-406e-8051-75b5032d5018] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:37.388084 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-baa6c884-c03b-423f-a93f-b94bb4f711e9 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:37.388537 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-baa6c884-c03b-423f-a93f-b94bb4f711e9 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:37.389294 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-baa6c884-c03b-423f-a93f-b94bb4f711e9 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:37.389757 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-baa6c884-c03b-423f-a93f-b94bb4f711e9 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:37.415288 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d78c275a-5446-48b7-b29e-d006defe13bd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:37.415884 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d78c275a-5446-48b7-b29e-d006defe13bd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:37.422613 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d78c275a-5446-48b7-b29e-d006defe13bd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:37.423061 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d78c275a-5446-48b7-b29e-d006defe13bd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:37.423829 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d78c275a-5446-48b7-b29e-d006defe13bd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:37.424261 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d78c275a-5446-48b7-b29e-d006defe13bd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:37.450207 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-baa6c884-c03b-423f-a93f-b94bb4f711e9 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:37.457458 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-baa6c884-c03b-423f-a93f-b94bb4f711e9 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018" status: 200 len: 1216 microversion: 2.1 time: 0.080672 Jul 20 19:25:37.458047 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 160/309] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:37 2022] GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018 => generated 1216 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:37.555967 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d78c275a-5446-48b7-b29e-d006defe13bd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:37.563290 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d78c275a-5446-48b7-b29e-d006defe13bd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1520 microversion: 2.1 time: 0.151964 Jul 20 19:25:37.563835 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 150/310] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:37 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:25:37.688339 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-32ab3cc1-5830-4859-b528-ac7c4e5742d8 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:37.688997 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-32ab3cc1-5830-4859-b528-ac7c4e5742d8 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] [instance: 062837f7-369c-477b-893d-36d1a9696004] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:37.694905 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-32ab3cc1-5830-4859-b528-ac7c4e5742d8 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:37.695729 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-32ab3cc1-5830-4859-b528-ac7c4e5742d8 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:37.696210 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-32ab3cc1-5830-4859-b528-ac7c4e5742d8 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:37.696619 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-32ab3cc1-5830-4859-b528-ac7c4e5742d8 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:37.829014 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-32ab3cc1-5830-4859-b528-ac7c4e5742d8 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67416d4eea6946fdb77a09242e58a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66a7bac21e44b72a59bb74c917daae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:37.836548 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-32ab3cc1-5830-4859-b528-ac7c4e5742d8 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] 10.222.0.69 "GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004" status: 200 len: 1315 microversion: 2.1 time: 0.152187 Jul 20 19:25:37.837099 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 161/311] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:37 2022] GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:38.474298 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-6ce8eea7-20ed-45e1-965d-24bbbdda20ac tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:38.474900 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-6ce8eea7-20ed-45e1-965d-24bbbdda20ac tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: 230833df-72df-406e-8051-75b5032d5018] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:38.481273 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6ce8eea7-20ed-45e1-965d-24bbbdda20ac tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:38.481754 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6ce8eea7-20ed-45e1-965d-24bbbdda20ac tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:38.482506 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6ce8eea7-20ed-45e1-965d-24bbbdda20ac tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:38.482935 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6ce8eea7-20ed-45e1-965d-24bbbdda20ac tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:38.542639 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6ce8eea7-20ed-45e1-965d-24bbbdda20ac tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:38.549940 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-6ce8eea7-20ed-45e1-965d-24bbbdda20ac tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018" status: 200 len: 1216 microversion: 2.1 time: 0.079381 Jul 20 19:25:38.550496 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 151/312] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:38 2022] GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018 => generated 1216 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:38.580559 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-c463dcaa-7e80-4ece-b04e-5dc2e5ce1747 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:38.581175 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-c463dcaa-7e80-4ece-b04e-5dc2e5ce1747 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:38.588105 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c463dcaa-7e80-4ece-b04e-5dc2e5ce1747 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:38.588553 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c463dcaa-7e80-4ece-b04e-5dc2e5ce1747 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:38.589312 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c463dcaa-7e80-4ece-b04e-5dc2e5ce1747 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:38.589783 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c463dcaa-7e80-4ece-b04e-5dc2e5ce1747 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:38.724095 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-c463dcaa-7e80-4ece-b04e-5dc2e5ce1747 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:38.731798 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-c463dcaa-7e80-4ece-b04e-5dc2e5ce1747 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1520 microversion: 2.1 time: 0.155108 Jul 20 19:25:38.732567 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 162/313] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:38 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:38.853869 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-2a1b640e-4824-4b29-a584-8be9a3cb60dd tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:38.854501 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-2a1b640e-4824-4b29-a584-8be9a3cb60dd tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] [instance: 062837f7-369c-477b-893d-36d1a9696004] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:38.860387 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2a1b640e-4824-4b29-a584-8be9a3cb60dd tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:38.860832 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2a1b640e-4824-4b29-a584-8be9a3cb60dd tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:38.861610 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2a1b640e-4824-4b29-a584-8be9a3cb60dd tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:38.862039 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2a1b640e-4824-4b29-a584-8be9a3cb60dd tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:38.993819 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-2a1b640e-4824-4b29-a584-8be9a3cb60dd tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67416d4eea6946fdb77a09242e58a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66a7bac21e44b72a59bb74c917daae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:39.001327 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-2a1b640e-4824-4b29-a584-8be9a3cb60dd tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] 10.222.0.69 "GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004" status: 200 len: 1315 microversion: 2.1 time: 0.151726 Jul 20 19:25:39.001910 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 152/314] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:38 2022] GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:39.567040 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-ad359867-b471-4c8b-80b5-f3ad030ffc50 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:39.567650 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-ad359867-b471-4c8b-80b5-f3ad030ffc50 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: 230833df-72df-406e-8051-75b5032d5018] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:39.569525 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:39.574798 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-ad359867-b471-4c8b-80b5-f3ad030ffc50 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:39.575275 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-ad359867-b471-4c8b-80b5-f3ad030ffc50 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:39.576034 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-ad359867-b471-4c8b-80b5-f3ad030ffc50 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:39.576471 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-ad359867-b471-4c8b-80b5-f3ad030ffc50 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:39.637307 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-ad359867-b471-4c8b-80b5-f3ad030ffc50 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:39.644621 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-ad359867-b471-4c8b-80b5-f3ad030ffc50 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018" status: 200 len: 1216 microversion: 2.1 time: 0.081481 Jul 20 19:25:39.645188 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 163/315] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:39 2022] GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018 => generated 1216 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:39.748789 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-53ebdd61-5e48-4db4-93f5-9dc406014c6d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:39.749539 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-53ebdd61-5e48-4db4-93f5-9dc406014c6d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:39.756233 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-53ebdd61-5e48-4db4-93f5-9dc406014c6d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:39.756686 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-53ebdd61-5e48-4db4-93f5-9dc406014c6d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:39.757979 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-53ebdd61-5e48-4db4-93f5-9dc406014c6d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:39.758937 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-53ebdd61-5e48-4db4-93f5-9dc406014c6d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:39.889338 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-53ebdd61-5e48-4db4-93f5-9dc406014c6d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:39.896709 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-53ebdd61-5e48-4db4-93f5-9dc406014c6d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1520 microversion: 2.1 time: 0.151814 Jul 20 19:25:39.897265 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 153/316] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:39 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:40.018790 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-6f09f100-4086-4f48-9b2b-36a758021dee tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:40.019533 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-6f09f100-4086-4f48-9b2b-36a758021dee tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] [instance: 062837f7-369c-477b-893d-36d1a9696004] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:40.026697 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-6f09f100-4086-4f48-9b2b-36a758021dee tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:40.027143 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-6f09f100-4086-4f48-9b2b-36a758021dee tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:40.027896 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-6f09f100-4086-4f48-9b2b-36a758021dee tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:40.028323 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-6f09f100-4086-4f48-9b2b-36a758021dee tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:40.156933 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-6f09f100-4086-4f48-9b2b-36a758021dee tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67416d4eea6946fdb77a09242e58a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66a7bac21e44b72a59bb74c917daae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:40.164333 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-6f09f100-4086-4f48-9b2b-36a758021dee tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] 10.222.0.69 "GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004" status: 200 len: 1315 microversion: 2.1 time: 0.149361 Jul 20 19:25:40.164900 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 164/317] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:40 2022] GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:40.661992 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-87983d30-08d3-424b-ab29-6ba0a271ac83 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:40.662593 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-87983d30-08d3-424b-ab29-6ba0a271ac83 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: 230833df-72df-406e-8051-75b5032d5018] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:40.669689 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-87983d30-08d3-424b-ab29-6ba0a271ac83 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:40.670124 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-87983d30-08d3-424b-ab29-6ba0a271ac83 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:40.670901 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-87983d30-08d3-424b-ab29-6ba0a271ac83 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:40.671363 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-87983d30-08d3-424b-ab29-6ba0a271ac83 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:40.735943 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-87983d30-08d3-424b-ab29-6ba0a271ac83 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:40.743917 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-87983d30-08d3-424b-ab29-6ba0a271ac83 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018" status: 200 len: 1216 microversion: 2.1 time: 0.085814 Jul 20 19:25:40.744488 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 154/318] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:40 2022] GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018 => generated 1216 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:40.914526 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-965173aa-0bff-481c-b6a6-969e2efbaf2a tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:40.915133 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-965173aa-0bff-481c-b6a6-969e2efbaf2a tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:40.921143 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-965173aa-0bff-481c-b6a6-969e2efbaf2a tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:40.921618 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-965173aa-0bff-481c-b6a6-969e2efbaf2a tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:40.922367 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-965173aa-0bff-481c-b6a6-969e2efbaf2a tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:40.922823 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-965173aa-0bff-481c-b6a6-969e2efbaf2a tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:40.926657 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_cell1:SELECT=100 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:41.052038 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-965173aa-0bff-481c-b6a6-969e2efbaf2a tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:41.060791 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-965173aa-0bff-481c-b6a6-969e2efbaf2a tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1520 microversion: 2.1 time: 0.150269 Jul 20 19:25:41.061350 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 165/319] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:40 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:41.181437 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-14571c99-5712-4476-b14a-32a9e872161b tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:41.181993 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-14571c99-5712-4476-b14a-32a9e872161b tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] [instance: 062837f7-369c-477b-893d-36d1a9696004] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:41.188400 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-14571c99-5712-4476-b14a-32a9e872161b tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:41.188847 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-14571c99-5712-4476-b14a-32a9e872161b tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:41.189638 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-14571c99-5712-4476-b14a-32a9e872161b tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:41.190075 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-14571c99-5712-4476-b14a-32a9e872161b tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:41.324279 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-14571c99-5712-4476-b14a-32a9e872161b tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67416d4eea6946fdb77a09242e58a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66a7bac21e44b72a59bb74c917daae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:41.331747 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-14571c99-5712-4476-b14a-32a9e872161b tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] 10.222.0.69 "GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004" status: 200 len: 1315 microversion: 2.1 time: 0.154850 Jul 20 19:25:41.332305 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 155/320] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:41 2022] GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:41.760935 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-530f7b84-4fd2-423d-a860-562bad5eaf51 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:41.761564 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-530f7b84-4fd2-423d-a860-562bad5eaf51 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: 230833df-72df-406e-8051-75b5032d5018] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:41.767751 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-530f7b84-4fd2-423d-a860-562bad5eaf51 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:41.768190 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-530f7b84-4fd2-423d-a860-562bad5eaf51 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:41.768967 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-530f7b84-4fd2-423d-a860-562bad5eaf51 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:41.769395 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-530f7b84-4fd2-423d-a860-562bad5eaf51 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:41.831004 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-530f7b84-4fd2-423d-a860-562bad5eaf51 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:41.838709 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-530f7b84-4fd2-423d-a860-562bad5eaf51 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018" status: 200 len: 1216 microversion: 2.1 time: 0.082036 Jul 20 19:25:41.839269 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 166/321] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:41 2022] GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018 => generated 1216 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:42.078718 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-fdb09aa0-0b39-45d4-8562-2c16e0dfbd16 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:42.079257 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-fdb09aa0-0b39-45d4-8562-2c16e0dfbd16 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:42.085217 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fdb09aa0-0b39-45d4-8562-2c16e0dfbd16 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:42.085709 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fdb09aa0-0b39-45d4-8562-2c16e0dfbd16 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:42.086485 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fdb09aa0-0b39-45d4-8562-2c16e0dfbd16 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:42.087041 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fdb09aa0-0b39-45d4-8562-2c16e0dfbd16 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:42.215084 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-fdb09aa0-0b39-45d4-8562-2c16e0dfbd16 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:42.222733 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-fdb09aa0-0b39-45d4-8562-2c16e0dfbd16 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1520 microversion: 2.1 time: 0.148102 Jul 20 19:25:42.223286 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 156/322] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:42 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:42.349302 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-fb005788-4e88-48aa-a1fd-fb5992b988d3 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:42.349919 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-fb005788-4e88-48aa-a1fd-fb5992b988d3 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] [instance: 062837f7-369c-477b-893d-36d1a9696004] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:42.356678 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-fb005788-4e88-48aa-a1fd-fb5992b988d3 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:42.357130 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-fb005788-4e88-48aa-a1fd-fb5992b988d3 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:42.357922 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-fb005788-4e88-48aa-a1fd-fb5992b988d3 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:42.358372 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-fb005788-4e88-48aa-a1fd-fb5992b988d3 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:42.490104 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-fb005788-4e88-48aa-a1fd-fb5992b988d3 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67416d4eea6946fdb77a09242e58a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66a7bac21e44b72a59bb74c917daae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:42.498323 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-fb005788-4e88-48aa-a1fd-fb5992b988d3 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] 10.222.0.69 "GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004" status: 200 len: 1315 microversion: 2.1 time: 0.152925 Jul 20 19:25:42.498887 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 167/323] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:42 2022] GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:42.856117 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-35943fd1-5fed-41e0-b878-79248cf4bb4d tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:42.856715 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-35943fd1-5fed-41e0-b878-79248cf4bb4d tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: 230833df-72df-406e-8051-75b5032d5018] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:42.858578 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:42.864011 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-35943fd1-5fed-41e0-b878-79248cf4bb4d tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:42.864455 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-35943fd1-5fed-41e0-b878-79248cf4bb4d tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:42.865225 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-35943fd1-5fed-41e0-b878-79248cf4bb4d tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:42.865692 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-35943fd1-5fed-41e0-b878-79248cf4bb4d tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:42.933807 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-35943fd1-5fed-41e0-b878-79248cf4bb4d tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:42.941071 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-35943fd1-5fed-41e0-b878-79248cf4bb4d tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018" status: 200 len: 1216 microversion: 2.1 time: 0.089306 Jul 20 19:25:42.941939 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 157/324] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:42 2022] GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018 => generated 1216 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:43.240743 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-b2e5a1d9-3128-4902-a76f-7e837ad8da46 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:43.241687 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-b2e5a1d9-3128-4902-a76f-7e837ad8da46 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:43.251246 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b2e5a1d9-3128-4902-a76f-7e837ad8da46 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:43.251896 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b2e5a1d9-3128-4902-a76f-7e837ad8da46 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:43.252912 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b2e5a1d9-3128-4902-a76f-7e837ad8da46 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:43.253496 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b2e5a1d9-3128-4902-a76f-7e837ad8da46 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:43.393275 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-b2e5a1d9-3128-4902-a76f-7e837ad8da46 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:43.401465 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-b2e5a1d9-3128-4902-a76f-7e837ad8da46 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1520 microversion: 2.1 time: 0.165418 Jul 20 19:25:43.402060 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 168/325] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:43 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:43.514960 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-bf38d510-1041-48d8-81c8-b2e949347f3e tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:43.515472 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-bf38d510-1041-48d8-81c8-b2e949347f3e tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] [instance: 062837f7-369c-477b-893d-36d1a9696004] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:43.521958 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bf38d510-1041-48d8-81c8-b2e949347f3e tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:43.522397 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bf38d510-1041-48d8-81c8-b2e949347f3e tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:43.523144 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bf38d510-1041-48d8-81c8-b2e949347f3e tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:43.523570 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bf38d510-1041-48d8-81c8-b2e949347f3e tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:43.656139 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-bf38d510-1041-48d8-81c8-b2e949347f3e tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67416d4eea6946fdb77a09242e58a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66a7bac21e44b72a59bb74c917daae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:43.663415 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-bf38d510-1041-48d8-81c8-b2e949347f3e tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] 10.222.0.69 "GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004" status: 200 len: 1315 microversion: 2.1 time: 0.152383 Jul 20 19:25:43.664000 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 158/326] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:43 2022] GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:43.958629 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-2ea49064-b9b4-4660-bf6f-a7328e9fe80d tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:43.959352 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-2ea49064-b9b4-4660-bf6f-a7328e9fe80d tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: 230833df-72df-406e-8051-75b5032d5018] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:43.965691 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2ea49064-b9b4-4660-bf6f-a7328e9fe80d tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:43.966404 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2ea49064-b9b4-4660-bf6f-a7328e9fe80d tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:43.967156 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2ea49064-b9b4-4660-bf6f-a7328e9fe80d tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:43.967581 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2ea49064-b9b4-4660-bf6f-a7328e9fe80d tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:44.029685 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-2ea49064-b9b4-4660-bf6f-a7328e9fe80d tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:44.037035 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-2ea49064-b9b4-4660-bf6f-a7328e9fe80d tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018" status: 200 len: 1264 microversion: 2.1 time: 0.082217 Jul 20 19:25:44.037603 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 169/327] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:43 2022] GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018 => generated 1264 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:44.418831 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-7672a6b4-285d-4ad0-8f02-452edfee96bf tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:44.419460 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-7672a6b4-285d-4ad0-8f02-452edfee96bf tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:44.425540 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7672a6b4-285d-4ad0-8f02-452edfee96bf tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:44.425995 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7672a6b4-285d-4ad0-8f02-452edfee96bf tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:44.426753 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7672a6b4-285d-4ad0-8f02-452edfee96bf tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:44.427185 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7672a6b4-285d-4ad0-8f02-452edfee96bf tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:44.556790 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-7672a6b4-285d-4ad0-8f02-452edfee96bf tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:44.564585 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-7672a6b4-285d-4ad0-8f02-452edfee96bf tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1520 microversion: 2.1 time: 0.150296 Jul 20 19:25:44.565144 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 159/328] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:44 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:44.680105 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-3913ee6a-193a-45c4-b053-13e0beef0b16 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:44.680707 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-3913ee6a-193a-45c4-b053-13e0beef0b16 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] [instance: 062837f7-369c-477b-893d-36d1a9696004] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:44.686770 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3913ee6a-193a-45c4-b053-13e0beef0b16 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:44.687231 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3913ee6a-193a-45c4-b053-13e0beef0b16 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:44.688028 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3913ee6a-193a-45c4-b053-13e0beef0b16 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:44.688452 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3913ee6a-193a-45c4-b053-13e0beef0b16 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:44.827903 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-3913ee6a-193a-45c4-b053-13e0beef0b16 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67416d4eea6946fdb77a09242e58a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66a7bac21e44b72a59bb74c917daae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:44.835337 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-3913ee6a-193a-45c4-b053-13e0beef0b16 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] 10.222.0.69 "GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004" status: 200 len: 1315 microversion: 2.1 time: 0.159110 Jul 20 19:25:44.835893 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 170/329] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:44 2022] GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:45.057340 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-36cbe626-f30f-4592-84ba-6d1bee2fe25c tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:45.058023 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-36cbe626-f30f-4592-84ba-6d1bee2fe25c tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: 230833df-72df-406e-8051-75b5032d5018] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:45.064060 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-36cbe626-f30f-4592-84ba-6d1bee2fe25c tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:45.064510 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-36cbe626-f30f-4592-84ba-6d1bee2fe25c tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:45.065320 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-36cbe626-f30f-4592-84ba-6d1bee2fe25c tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:45.065809 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-36cbe626-f30f-4592-84ba-6d1bee2fe25c tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:45.131154 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-36cbe626-f30f-4592-84ba-6d1bee2fe25c tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:45.139724 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-36cbe626-f30f-4592-84ba-6d1bee2fe25c tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018" status: 200 len: 1264 microversion: 2.1 time: 0.089038 Jul 20 19:25:45.140296 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 160/330] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:45 2022] GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018 => generated 1264 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:45.581906 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-7e22658c-9534-4416-8172-32a26a3ac2f3 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:45.582555 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-7e22658c-9534-4416-8172-32a26a3ac2f3 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:45.584348 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_cell0:SELECT=2 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:45.585007 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_cell0:SELECT=8 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:45.591621 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-7e22658c-9534-4416-8172-32a26a3ac2f3 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:45.592059 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-7e22658c-9534-4416-8172-32a26a3ac2f3 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:45.592808 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-7e22658c-9534-4416-8172-32a26a3ac2f3 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:45.593250 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-7e22658c-9534-4416-8172-32a26a3ac2f3 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:45.723528 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-7e22658c-9534-4416-8172-32a26a3ac2f3 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:45.731019 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-7e22658c-9534-4416-8172-32a26a3ac2f3 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1520 microversion: 2.1 time: 0.152930 Jul 20 19:25:45.731581 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 171/331] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:45 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:45.852633 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ae6e5574-197a-4b59-8343-877e81e98fec tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:45.853152 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ae6e5574-197a-4b59-8343-877e81e98fec tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] [instance: 062837f7-369c-477b-893d-36d1a9696004] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:45.860225 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ae6e5574-197a-4b59-8343-877e81e98fec tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:45.860665 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ae6e5574-197a-4b59-8343-877e81e98fec tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:45.861422 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ae6e5574-197a-4b59-8343-877e81e98fec tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:45.861876 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ae6e5574-197a-4b59-8343-877e81e98fec tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:45.992865 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ae6e5574-197a-4b59-8343-877e81e98fec tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67416d4eea6946fdb77a09242e58a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66a7bac21e44b72a59bb74c917daae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:46.001069 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ae6e5574-197a-4b59-8343-877e81e98fec tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] 10.222.0.69 "GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004" status: 200 len: 1315 microversion: 2.1 time: 0.152272 Jul 20 19:25:46.001650 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 161/332] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:45 2022] GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:46.156978 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-4c7d661e-30aa-4e24-b37f-46ced884b1d6 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:46.157706 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-4c7d661e-30aa-4e24-b37f-46ced884b1d6 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: 230833df-72df-406e-8051-75b5032d5018] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:46.163653 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4c7d661e-30aa-4e24-b37f-46ced884b1d6 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:46.164091 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4c7d661e-30aa-4e24-b37f-46ced884b1d6 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:46.164834 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4c7d661e-30aa-4e24-b37f-46ced884b1d6 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:46.165254 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4c7d661e-30aa-4e24-b37f-46ced884b1d6 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:46.231591 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-4c7d661e-30aa-4e24-b37f-46ced884b1d6 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:46.238442 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-4c7d661e-30aa-4e24-b37f-46ced884b1d6 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018" status: 200 len: 1264 microversion: 2.1 time: 0.085298 Jul 20 19:25:46.238997 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 172/333] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:46 2022] GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018 => generated 1264 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:46.747841 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-72c95ab4-94d9-419f-a876-7d7ae897e922 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:46.748398 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-72c95ab4-94d9-419f-a876-7d7ae897e922 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:46.754924 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-72c95ab4-94d9-419f-a876-7d7ae897e922 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:46.755376 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-72c95ab4-94d9-419f-a876-7d7ae897e922 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:46.756169 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-72c95ab4-94d9-419f-a876-7d7ae897e922 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:46.756590 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-72c95ab4-94d9-419f-a876-7d7ae897e922 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:46.761005 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:46.914341 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-72c95ab4-94d9-419f-a876-7d7ae897e922 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:46.924529 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-72c95ab4-94d9-419f-a876-7d7ae897e922 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1520 microversion: 2.1 time: 0.181144 Jul 20 19:25:46.925137 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 162/334] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:46 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:47.017712 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-bad733f1-8f97-43d8-871c-12083348097b tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:47.018330 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-bad733f1-8f97-43d8-871c-12083348097b tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] [instance: 062837f7-369c-477b-893d-36d1a9696004] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:47.024317 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-bad733f1-8f97-43d8-871c-12083348097b tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:47.024761 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-bad733f1-8f97-43d8-871c-12083348097b tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:47.025543 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-bad733f1-8f97-43d8-871c-12083348097b tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:47.026319 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-bad733f1-8f97-43d8-871c-12083348097b tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:47.207660 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-bad733f1-8f97-43d8-871c-12083348097b tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67416d4eea6946fdb77a09242e58a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66a7bac21e44b72a59bb74c917daae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:47.216276 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-bad733f1-8f97-43d8-871c-12083348097b tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] 10.222.0.69 "GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004" status: 200 len: 1315 microversion: 2.1 time: 0.202112 Jul 20 19:25:47.216776 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 173/335] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:47 2022] GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004 => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:47.255559 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a224300e-74ce-470f-b460-60307387b617 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:47.258267 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a224300e-74ce-470f-b460-60307387b617 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: 230833df-72df-406e-8051-75b5032d5018] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:47.265288 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a224300e-74ce-470f-b460-60307387b617 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:47.266536 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a224300e-74ce-470f-b460-60307387b617 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:47.266821 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a224300e-74ce-470f-b460-60307387b617 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:47.267253 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a224300e-74ce-470f-b460-60307387b617 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:47.343272 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a224300e-74ce-470f-b460-60307387b617 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:47.350743 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a224300e-74ce-470f-b460-60307387b617 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018" status: 200 len: 1264 microversion: 2.1 time: 0.099157 Jul 20 19:25:47.351304 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 163/336] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:47 2022] GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018 => generated 1264 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:47.942310 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-acad4b5c-74fc-4e27-a118-55d9774434fb tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:47.942960 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-acad4b5c-74fc-4e27-a118-55d9774434fb tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:47.950224 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-acad4b5c-74fc-4e27-a118-55d9774434fb tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:47.950662 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-acad4b5c-74fc-4e27-a118-55d9774434fb tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:47.951583 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-acad4b5c-74fc-4e27-a118-55d9774434fb tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:47.952011 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-acad4b5c-74fc-4e27-a118-55d9774434fb tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:48.094330 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-acad4b5c-74fc-4e27-a118-55d9774434fb tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:48.102459 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-acad4b5c-74fc-4e27-a118-55d9774434fb tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1520 microversion: 2.1 time: 0.164183 Jul 20 19:25:48.103239 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 174/337] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:47 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:48.233298 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a3932b54-013e-46d9-a6bb-c91f58d0fa90 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:48.233965 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a3932b54-013e-46d9-a6bb-c91f58d0fa90 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] [instance: 062837f7-369c-477b-893d-36d1a9696004] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:48.240866 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a3932b54-013e-46d9-a6bb-c91f58d0fa90 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:48.241433 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a3932b54-013e-46d9-a6bb-c91f58d0fa90 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:48.242238 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a3932b54-013e-46d9-a6bb-c91f58d0fa90 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:48.242700 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a3932b54-013e-46d9-a6bb-c91f58d0fa90 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:48.370279 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-1cd99344-379f-4e85-8e2d-513667a88984 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:48.371953 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-1cd99344-379f-4e85-8e2d-513667a88984 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: 230833df-72df-406e-8051-75b5032d5018] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:48.381337 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a3932b54-013e-46d9-a6bb-c91f58d0fa90 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67416d4eea6946fdb77a09242e58a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66a7bac21e44b72a59bb74c917daae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:48.384941 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1cd99344-379f-4e85-8e2d-513667a88984 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:48.385630 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1cd99344-379f-4e85-8e2d-513667a88984 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:48.386461 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1cd99344-379f-4e85-8e2d-513667a88984 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:48.386957 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1cd99344-379f-4e85-8e2d-513667a88984 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:48.397542 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a3932b54-013e-46d9-a6bb-c91f58d0fa90 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] 10.222.0.69 "GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004" status: 200 len: 1315 microversion: 2.1 time: 0.167895 Jul 20 19:25:48.397844 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 164/338] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:48 2022] GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:48.454895 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-1cd99344-379f-4e85-8e2d-513667a88984 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:48.462341 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-1cd99344-379f-4e85-8e2d-513667a88984 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018" status: 200 len: 1264 microversion: 2.1 time: 0.097591 Jul 20 19:25:48.462893 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 175/339] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:48 2022] GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018 => generated 1264 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:25:49.121338 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-7110b74e-d77f-4238-9999-f3860ebca742 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:49.121964 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-7110b74e-d77f-4238-9999-f3860ebca742 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:49.127994 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7110b74e-d77f-4238-9999-f3860ebca742 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:49.128455 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7110b74e-d77f-4238-9999-f3860ebca742 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:49.129240 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7110b74e-d77f-4238-9999-f3860ebca742 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:49.129697 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7110b74e-d77f-4238-9999-f3860ebca742 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:49.271996 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-7110b74e-d77f-4238-9999-f3860ebca742 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:49.280970 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-7110b74e-d77f-4238-9999-f3860ebca742 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1520 microversion: 2.1 time: 0.163608 Jul 20 19:25:49.281603 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 165/340] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:49 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:49.414540 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-322d53ec-a99b-494a-adf6-2ad688436478 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:49.415137 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-322d53ec-a99b-494a-adf6-2ad688436478 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] [instance: 062837f7-369c-477b-893d-36d1a9696004] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:49.421307 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-322d53ec-a99b-494a-adf6-2ad688436478 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:49.421759 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-322d53ec-a99b-494a-adf6-2ad688436478 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:49.422517 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-322d53ec-a99b-494a-adf6-2ad688436478 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:49.422949 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-322d53ec-a99b-494a-adf6-2ad688436478 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:49.480954 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-2e7d535e-a017-42c6-b216-b2af612bc3b6 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:49.481666 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-2e7d535e-a017-42c6-b216-b2af612bc3b6 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: 230833df-72df-406e-8051-75b5032d5018] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:49.489280 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2e7d535e-a017-42c6-b216-b2af612bc3b6 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:49.489989 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2e7d535e-a017-42c6-b216-b2af612bc3b6 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:49.490787 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2e7d535e-a017-42c6-b216-b2af612bc3b6 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:49.491295 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2e7d535e-a017-42c6-b216-b2af612bc3b6 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:49.556640 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-2e7d535e-a017-42c6-b216-b2af612bc3b6 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:49.564651 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-2e7d535e-a017-42c6-b216-b2af612bc3b6 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018" status: 200 len: 1264 microversion: 2.1 time: 0.088391 Jul 20 19:25:49.565230 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 166/341] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:49 2022] GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018 => generated 1264 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:49.590612 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-322d53ec-a99b-494a-adf6-2ad688436478 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67416d4eea6946fdb77a09242e58a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66a7bac21e44b72a59bb74c917daae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:49.598604 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-322d53ec-a99b-494a-adf6-2ad688436478 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] 10.222.0.69 "GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004" status: 200 len: 1315 microversion: 2.1 time: 0.187875 Jul 20 19:25:49.599696 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 176/342] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:49 2022] GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004 => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:50.299050 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-da8caf4a-654b-4ee8-a769-1d37c7961470 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:50.299768 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-da8caf4a-654b-4ee8-a769-1d37c7961470 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:50.307639 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-da8caf4a-654b-4ee8-a769-1d37c7961470 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:50.308506 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-da8caf4a-654b-4ee8-a769-1d37c7961470 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:50.309771 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-da8caf4a-654b-4ee8-a769-1d37c7961470 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:50.310652 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-da8caf4a-654b-4ee8-a769-1d37c7961470 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:50.468544 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-da8caf4a-654b-4ee8-a769-1d37c7961470 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:50.482818 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-da8caf4a-654b-4ee8-a769-1d37c7961470 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1520 microversion: 2.1 time: 0.188052 Jul 20 19:25:50.483816 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 167/343] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:50 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1520 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:50.581139 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-5fc7c96f-d99d-4635-a201-12afa8276f85 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:50.581847 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-5fc7c96f-d99d-4635-a201-12afa8276f85 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: 230833df-72df-406e-8051-75b5032d5018] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:50.587729 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-5fc7c96f-d99d-4635-a201-12afa8276f85 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:50.588165 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-5fc7c96f-d99d-4635-a201-12afa8276f85 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:50.588918 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-5fc7c96f-d99d-4635-a201-12afa8276f85 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:50.589331 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-5fc7c96f-d99d-4635-a201-12afa8276f85 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:50.616313 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-3d709915-eb42-4191-b5bc-43a69029ea14 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:50.617026 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-3d709915-eb42-4191-b5bc-43a69029ea14 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] [instance: 062837f7-369c-477b-893d-36d1a9696004] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:50.627020 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3d709915-eb42-4191-b5bc-43a69029ea14 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:50.627642 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3d709915-eb42-4191-b5bc-43a69029ea14 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:50.628540 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3d709915-eb42-4191-b5bc-43a69029ea14 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:50.629042 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3d709915-eb42-4191-b5bc-43a69029ea14 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:50.654772 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-5fc7c96f-d99d-4635-a201-12afa8276f85 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:50.663245 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-5fc7c96f-d99d-4635-a201-12afa8276f85 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018" status: 200 len: 1264 microversion: 2.1 time: 0.085744 Jul 20 19:25:50.663800 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 177/344] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:50 2022] GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018 => generated 1264 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:50.765816 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3d709915-eb42-4191-b5bc-43a69029ea14 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67416d4eea6946fdb77a09242e58a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66a7bac21e44b72a59bb74c917daae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:50.774970 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-3d709915-eb42-4191-b5bc-43a69029ea14 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] 10.222.0.69 "GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004" status: 200 len: 1315 microversion: 2.1 time: 0.162125 Jul 20 19:25:50.775777 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 168/345] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:50 2022] GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:25:51.501829 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-d4610614-df2d-4d80-9ba4-8f287c081101 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:51.502412 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-d4610614-df2d-4d80-9ba4-8f287c081101 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:51.517895 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d4610614-df2d-4d80-9ba4-8f287c081101 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:51.519317 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d4610614-df2d-4d80-9ba4-8f287c081101 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:51.520317 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d4610614-df2d-4d80-9ba4-8f287c081101 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:51.524135 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d4610614-df2d-4d80-9ba4-8f287c081101 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:51.680451 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-9b9f32b2-c38c-4747-b952-48fa916ee56b tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:51.681674 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-9b9f32b2-c38c-4747-b952-48fa916ee56b tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: 230833df-72df-406e-8051-75b5032d5018] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:51.686754 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-d4610614-df2d-4d80-9ba4-8f287c081101 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:51.690346 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9b9f32b2-c38c-4747-b952-48fa916ee56b tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:51.691070 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9b9f32b2-c38c-4747-b952-48fa916ee56b tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:51.692294 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9b9f32b2-c38c-4747-b952-48fa916ee56b tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:51.693198 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9b9f32b2-c38c-4747-b952-48fa916ee56b tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:51.697460 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-d4610614-df2d-4d80-9ba4-8f287c081101 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1500 microversion: 2.1 time: 0.199821 Jul 20 19:25:51.702071 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 178/346] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:51 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1500 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:51.716536 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-402628d9-a257-44ac-a914-89e43fd37a4b tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:51.717331 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-402628d9-a257-44ac-a914-89e43fd37a4b tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 053acc99-052e-4247-a54a-2799958f10e6] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:51.726220 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-402628d9-a257-44ac-a914-89e43fd37a4b tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:51.726836 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-402628d9-a257-44ac-a914-89e43fd37a4b tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:51.727684 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-402628d9-a257-44ac-a914-89e43fd37a4b tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:51.728251 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-402628d9-a257-44ac-a914-89e43fd37a4b tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:51.813031 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-9b9f32b2-c38c-4747-b952-48fa916ee56b tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:51.841389 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-9b9f32b2-c38c-4747-b952-48fa916ee56b tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018" status: 200 len: 1264 microversion: 2.1 time: 0.162682 Jul 20 19:25:51.852071 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 169/347] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:51 2022] GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018 => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:25:51.856615 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-884f471d-f156-4ff9-85ea-50ca5834d133 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:51.859605 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-884f471d-f156-4ff9-85ea-50ca5834d133 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] [instance: 062837f7-369c-477b-893d-36d1a9696004] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:51.873917 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-884f471d-f156-4ff9-85ea-50ca5834d133 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:51.875979 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-884f471d-f156-4ff9-85ea-50ca5834d133 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:51.877609 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-884f471d-f156-4ff9-85ea-50ca5834d133 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:51.880282 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-884f471d-f156-4ff9-85ea-50ca5834d133 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:51.911527 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-402628d9-a257-44ac-a914-89e43fd37a4b tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:51.920317 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-402628d9-a257-44ac-a914-89e43fd37a4b tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6" status: 200 len: 1516 microversion: 2.1 time: 0.208773 Jul 20 19:25:51.923086 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 179/348] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:51 2022] GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6 => generated 1516 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:52.284092 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-884f471d-f156-4ff9-85ea-50ca5834d133 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67416d4eea6946fdb77a09242e58a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66a7bac21e44b72a59bb74c917daae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:52.291524 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-884f471d-f156-4ff9-85ea-50ca5834d133 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] 10.222.0.69 "GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004" status: 200 len: 1315 microversion: 2.1 time: 0.446575 Jul 20 19:25:52.296537 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 170/349] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:51 2022] GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004 => generated 1315 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:52.860690 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-0321ce63-4262-40e0-b6e3-e1aa1ba020c7 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:52.861986 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-0321ce63-4262-40e0-b6e3-e1aa1ba020c7 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: 230833df-72df-406e-8051-75b5032d5018] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:52.868539 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-0321ce63-4262-40e0-b6e3-e1aa1ba020c7 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:52.869289 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-0321ce63-4262-40e0-b6e3-e1aa1ba020c7 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:52.870291 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-0321ce63-4262-40e0-b6e3-e1aa1ba020c7 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:52.871694 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-0321ce63-4262-40e0-b6e3-e1aa1ba020c7 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:52.957707 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-0321ce63-4262-40e0-b6e3-e1aa1ba020c7 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:52.987570 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-0321ce63-4262-40e0-b6e3-e1aa1ba020c7 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018" status: 200 len: 1270 microversion: 2.1 time: 0.130607 Jul 20 19:25:52.991160 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 180/350] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:52 2022] GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018 => generated 1270 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:53.329462 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c2e4e4c9-135b-4fdf-803c-404f00e6ec64 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:53.330268 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c2e4e4c9-135b-4fdf-803c-404f00e6ec64 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] [instance: 062837f7-369c-477b-893d-36d1a9696004] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:53.348296 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c2e4e4c9-135b-4fdf-803c-404f00e6ec64 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:53.350768 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c2e4e4c9-135b-4fdf-803c-404f00e6ec64 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:53.353552 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c2e4e4c9-135b-4fdf-803c-404f00e6ec64 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:53.355716 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c2e4e4c9-135b-4fdf-803c-404f00e6ec64 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:53.589561 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [req-5a852f1a-dcba-494d-ae43-f9314adf06a2 req-8d29b20d-4e63-450b-b71e-11f8b1ff956f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "062837f7-369c-477b-893d-36d1a9696004", "name": "network-vif-plugged", "status": "completed", "tag": "80acceeb-fba4-45d0-b45a-c31c4c4199e5"}]} {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:25:53.608252 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [req-5a852f1a-dcba-494d-ae43-f9314adf06a2 req-8d29b20d-4e63-450b-b71e-11f8b1ff956f service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:53.609970 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [req-5a852f1a-dcba-494d-ae43-f9314adf06a2 req-8d29b20d-4e63-450b-b71e-11f8b1ff956f service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:53.652435 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.compute.server_external_events [req-5a852f1a-dcba-494d-ae43-f9314adf06a2 req-8d29b20d-4e63-450b-b71e-11f8b1ff956f service nova] Creating event network-vif-plugged:80acceeb-fba4-45d0-b45a-c31c4c4199e5 for instance 062837f7-369c-477b-893d-36d1a9696004 on hv-cinder-83538 Jul 20 19:25:53.670057 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [req-5a852f1a-dcba-494d-ae43-f9314adf06a2 req-8d29b20d-4e63-450b-b71e-11f8b1ff956f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081934 Jul 20 19:25:53.670815 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 181/351] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 19:25:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:25:53.694668 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c2e4e4c9-135b-4fdf-803c-404f00e6ec64 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67416d4eea6946fdb77a09242e58a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66a7bac21e44b72a59bb74c917daae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:53.709730 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c2e4e4c9-135b-4fdf-803c-404f00e6ec64 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] 10.222.0.69 "GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004" status: 200 len: 1315 microversion: 2.1 time: 0.398970 Jul 20 19:25:53.711893 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 171/352] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:53 2022] GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004 => generated 1315 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:25:54.017673 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-4307f4ec-3852-4c52-bc9d-041274ae9a15 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:54.020543 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-4307f4ec-3852-4c52-bc9d-041274ae9a15 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: 230833df-72df-406e-8051-75b5032d5018] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:54.052916 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4307f4ec-3852-4c52-bc9d-041274ae9a15 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:54.053742 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4307f4ec-3852-4c52-bc9d-041274ae9a15 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:54.057703 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4307f4ec-3852-4c52-bc9d-041274ae9a15 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:54.059728 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4307f4ec-3852-4c52-bc9d-041274ae9a15 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:54.098725 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_cell1:SELECT=100 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:54.398379 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-4307f4ec-3852-4c52-bc9d-041274ae9a15 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:54.408733 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-4307f4ec-3852-4c52-bc9d-041274ae9a15 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018" status: 200 len: 1312 microversion: 2.1 time: 0.398695 Jul 20 19:25:54.409629 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 182/353] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:54 2022] GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018 => generated 1312 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:54.625621 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4df438bc-5d09-4b5b-9eb4-e58641502144 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:25:54.627457 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-4df438bc-5d09-4b5b-9eb4-e58641502144 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 053acc99-052e-4247-a54a-2799958f10e6] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:54.640623 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4df438bc-5d09-4b5b-9eb4-e58641502144 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:54.646664 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4df438bc-5d09-4b5b-9eb4-e58641502144 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:54.648648 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4df438bc-5d09-4b5b-9eb4-e58641502144 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:54.650285 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4df438bc-5d09-4b5b-9eb4-e58641502144 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:54.679505 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.objects.instance [None req-4df438bc-5d09-4b5b-9eb4-e58641502144 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lazy-loading 'flavor' on Instance uuid 053acc99-052e-4247-a54a-2799958f10e6 {{(pid=117761) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:25:54.729740 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-bdd8b997-c1b5-49ae-8b68-246635bb4ac8 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:54.730317 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-bdd8b997-c1b5-49ae-8b68-246635bb4ac8 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] [instance: 062837f7-369c-477b-893d-36d1a9696004] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:54.739688 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-bdd8b997-c1b5-49ae-8b68-246635bb4ac8 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:54.740147 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-bdd8b997-c1b5-49ae-8b68-246635bb4ac8 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:54.741053 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-bdd8b997-c1b5-49ae-8b68-246635bb4ac8 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:54.741346 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-bdd8b997-c1b5-49ae-8b68-246635bb4ac8 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:54.843338 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-4df438bc-5d09-4b5b-9eb4-e58641502144 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "POST /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6/action" status: 200 len: 32 microversion: 2.1 time: 0.228054 Jul 20 19:25:54.844885 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 172/354] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Jul 20 19:25:54 2022] POST /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6/action => generated 32 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 19:25:54.857912 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-961d4af4-ee14-41fc-abf6-2224a1cca0fd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:54.859022 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-961d4af4-ee14-41fc-abf6-2224a1cca0fd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 053acc99-052e-4247-a54a-2799958f10e6] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:54.872008 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-961d4af4-ee14-41fc-abf6-2224a1cca0fd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:54.873153 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-961d4af4-ee14-41fc-abf6-2224a1cca0fd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:54.874330 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-961d4af4-ee14-41fc-abf6-2224a1cca0fd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:54.874865 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-961d4af4-ee14-41fc-abf6-2224a1cca0fd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:55.017463 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-bdd8b997-c1b5-49ae-8b68-246635bb4ac8 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67416d4eea6946fdb77a09242e58a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66a7bac21e44b72a59bb74c917daae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:55.033848 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-bdd8b997-c1b5-49ae-8b68-246635bb4ac8 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] 10.222.0.69 "GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004" status: 200 len: 1315 microversion: 2.1 time: 0.308219 Jul 20 19:25:55.044311 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 183/355] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:54 2022] GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004 => generated 1315 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:55.052689 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [req-b5de2b7b-5b14-4be4-8e51-1317f539dd9f req-93da8e80-cf97-4210-aa38-01f7d9d063c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "230833df-72df-406e-8051-75b5032d5018", "tag": "bccc3941-efa0-4408-891d-c46c8a60260a"}]} {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:25:55.063528 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [req-b5de2b7b-5b14-4be4-8e51-1317f539dd9f req-93da8e80-cf97-4210-aa38-01f7d9d063c6 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:55.064441 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [req-b5de2b7b-5b14-4be4-8e51-1317f539dd9f req-93da8e80-cf97-4210-aa38-01f7d9d063c6 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:55.076685 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.compute.server_external_events [req-b5de2b7b-5b14-4be4-8e51-1317f539dd9f req-93da8e80-cf97-4210-aa38-01f7d9d063c6 service nova] Creating event network-changed:bccc3941-efa0-4408-891d-c46c8a60260a for instance 230833df-72df-406e-8051-75b5032d5018 on hv-cinder-83538 Jul 20 19:25:55.081933 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [req-b5de2b7b-5b14-4be4-8e51-1317f539dd9f req-93da8e80-cf97-4210-aa38-01f7d9d063c6 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032763 Jul 20 19:25:55.082536 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 184/356] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 19:25:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:25:55.201623 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-961d4af4-ee14-41fc-abf6-2224a1cca0fd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:55.209873 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-961d4af4-ee14-41fc-abf6-2224a1cca0fd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6" status: 200 len: 1522 microversion: 2.1 time: 0.359261 Jul 20 19:25:55.220610 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 173/357] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:54 2022] GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6 => generated 1522 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:25:55.427030 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-a302dbdf-03d6-4626-801e-17bf89a79b42 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:55.427627 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-a302dbdf-03d6-4626-801e-17bf89a79b42 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: 230833df-72df-406e-8051-75b5032d5018] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:55.434916 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a302dbdf-03d6-4626-801e-17bf89a79b42 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:55.435387 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a302dbdf-03d6-4626-801e-17bf89a79b42 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:55.436141 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a302dbdf-03d6-4626-801e-17bf89a79b42 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:55.436573 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a302dbdf-03d6-4626-801e-17bf89a79b42 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:55.584278 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-a302dbdf-03d6-4626-801e-17bf89a79b42 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:55.592887 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-a302dbdf-03d6-4626-801e-17bf89a79b42 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018" status: 200 len: 1312 microversion: 2.1 time: 0.169974 Jul 20 19:25:55.593618 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 185/358] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:55 2022] GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018 => generated 1312 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:56.051415 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-2629595b-57fb-4f53-b529-da708ee0b5da tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:56.052022 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-2629595b-57fb-4f53-b529-da708ee0b5da tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] [instance: 062837f7-369c-477b-893d-36d1a9696004] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:56.059972 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2629595b-57fb-4f53-b529-da708ee0b5da tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:56.060500 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2629595b-57fb-4f53-b529-da708ee0b5da tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:56.061402 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2629595b-57fb-4f53-b529-da708ee0b5da tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:56.061920 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2629595b-57fb-4f53-b529-da708ee0b5da tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:56.194121 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-2629595b-57fb-4f53-b529-da708ee0b5da tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67416d4eea6946fdb77a09242e58a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66a7bac21e44b72a59bb74c917daae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:56.202152 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-2629595b-57fb-4f53-b529-da708ee0b5da tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] 10.222.0.69 "GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004" status: 200 len: 1315 microversion: 2.1 time: 0.154486 Jul 20 19:25:56.202724 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 174/359] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:56 2022] GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:56.227542 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-8edea5d1-2b3b-4ce0-af53-23f79a6d5809 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:56.228146 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-8edea5d1-2b3b-4ce0-af53-23f79a6d5809 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 053acc99-052e-4247-a54a-2799958f10e6] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:56.234982 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8edea5d1-2b3b-4ce0-af53-23f79a6d5809 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:56.235429 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8edea5d1-2b3b-4ce0-af53-23f79a6d5809 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:56.236384 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8edea5d1-2b3b-4ce0-af53-23f79a6d5809 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:56.236830 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8edea5d1-2b3b-4ce0-af53-23f79a6d5809 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:56.374907 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-8edea5d1-2b3b-4ce0-af53-23f79a6d5809 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:56.382265 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-8edea5d1-2b3b-4ce0-af53-23f79a6d5809 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6" status: 200 len: 1522 microversion: 2.1 time: 0.158565 Jul 20 19:25:56.382829 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 186/360] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:56 2022] GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:56.609991 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-2ebaa170-c457-4103-8570-9f264f61c0ee tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:56.610820 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-2ebaa170-c457-4103-8570-9f264f61c0ee tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: 230833df-72df-406e-8051-75b5032d5018] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:56.618113 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2ebaa170-c457-4103-8570-9f264f61c0ee tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:56.618745 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2ebaa170-c457-4103-8570-9f264f61c0ee tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:56.619511 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2ebaa170-c457-4103-8570-9f264f61c0ee tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:56.619935 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2ebaa170-c457-4103-8570-9f264f61c0ee tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:56.814640 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-2ebaa170-c457-4103-8570-9f264f61c0ee tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:56.822869 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-2ebaa170-c457-4103-8570-9f264f61c0ee tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018" status: 200 len: 1312 microversion: 2.1 time: 0.216950 Jul 20 19:25:56.823518 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 175/361] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:56 2022] GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018 => generated 1312 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:57.219312 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-0c82c982-94d8-447d-987b-6f5fe6024f4c tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:57.220023 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-0c82c982-94d8-447d-987b-6f5fe6024f4c tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] [instance: 062837f7-369c-477b-893d-36d1a9696004] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:57.226295 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-0c82c982-94d8-447d-987b-6f5fe6024f4c tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:57.226819 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-0c82c982-94d8-447d-987b-6f5fe6024f4c tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:57.227655 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-0c82c982-94d8-447d-987b-6f5fe6024f4c tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:57.228211 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-0c82c982-94d8-447d-987b-6f5fe6024f4c tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:57.371788 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-0c82c982-94d8-447d-987b-6f5fe6024f4c tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67416d4eea6946fdb77a09242e58a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66a7bac21e44b72a59bb74c917daae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:57.380858 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-0c82c982-94d8-447d-987b-6f5fe6024f4c tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] 10.222.0.69 "GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004" status: 200 len: 1315 microversion: 2.1 time: 0.165577 Jul 20 19:25:57.381657 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 187/362] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:57 2022] GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:57.399497 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-6afb5b22-390d-480b-9634-ba02621f918d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:57.400109 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-6afb5b22-390d-480b-9634-ba02621f918d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 053acc99-052e-4247-a54a-2799958f10e6] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:57.407663 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6afb5b22-390d-480b-9634-ba02621f918d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:57.408115 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6afb5b22-390d-480b-9634-ba02621f918d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:57.409166 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6afb5b22-390d-480b-9634-ba02621f918d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:57.409626 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6afb5b22-390d-480b-9634-ba02621f918d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:57.542952 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6afb5b22-390d-480b-9634-ba02621f918d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:57.545419 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:57.552021 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-6afb5b22-390d-480b-9634-ba02621f918d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6" status: 200 len: 1522 microversion: 2.1 time: 0.156650 Jul 20 19:25:57.552589 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 176/363] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:57 2022] GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:57.841240 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-8f60ed49-fe41-4606-84b5-602cb28a4a7a tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:57.841785 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-8f60ed49-fe41-4606-84b5-602cb28a4a7a tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: 230833df-72df-406e-8051-75b5032d5018] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:57.847942 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8f60ed49-fe41-4606-84b5-602cb28a4a7a tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:57.848381 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8f60ed49-fe41-4606-84b5-602cb28a4a7a tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:57.849128 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8f60ed49-fe41-4606-84b5-602cb28a4a7a tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:57.849588 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8f60ed49-fe41-4606-84b5-602cb28a4a7a tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:57.978487 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-8f60ed49-fe41-4606-84b5-602cb28a4a7a tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:57.986679 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-8f60ed49-fe41-4606-84b5-602cb28a4a7a tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018" status: 200 len: 1312 microversion: 2.1 time: 0.150345 Jul 20 19:25:57.987221 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 188/364] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:57 2022] GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018 => generated 1312 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:58.398511 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-f0aa7003-8b70-4aeb-8032-4ecdcc97e665 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:58.399423 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-f0aa7003-8b70-4aeb-8032-4ecdcc97e665 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] [instance: 062837f7-369c-477b-893d-36d1a9696004] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:58.407133 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f0aa7003-8b70-4aeb-8032-4ecdcc97e665 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:58.407661 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f0aa7003-8b70-4aeb-8032-4ecdcc97e665 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:58.408350 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f0aa7003-8b70-4aeb-8032-4ecdcc97e665 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:58.408837 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f0aa7003-8b70-4aeb-8032-4ecdcc97e665 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:58.541487 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-f0aa7003-8b70-4aeb-8032-4ecdcc97e665 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67416d4eea6946fdb77a09242e58a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66a7bac21e44b72a59bb74c917daae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:58.549129 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-f0aa7003-8b70-4aeb-8032-4ecdcc97e665 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] 10.222.0.69 "GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004" status: 200 len: 1315 microversion: 2.1 time: 0.155004 Jul 20 19:25:58.549668 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 177/365] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:58 2022] GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:25:58.569433 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-fab9962e-250c-4454-afa7-c6acf5f7ef91 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:58.570133 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-fab9962e-250c-4454-afa7-c6acf5f7ef91 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 053acc99-052e-4247-a54a-2799958f10e6] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:58.578056 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-fab9962e-250c-4454-afa7-c6acf5f7ef91 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:58.578514 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-fab9962e-250c-4454-afa7-c6acf5f7ef91 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:58.579571 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-fab9962e-250c-4454-afa7-c6acf5f7ef91 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:58.580007 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-fab9962e-250c-4454-afa7-c6acf5f7ef91 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:58.719535 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-fab9962e-250c-4454-afa7-c6acf5f7ef91 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:58.736207 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-fab9962e-250c-4454-afa7-c6acf5f7ef91 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6" status: 200 len: 1522 microversion: 2.1 time: 0.170439 Jul 20 19:25:58.736791 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 189/366] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:58 2022] GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:59.003583 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-5ccc31b7-a640-426a-94e6-dead3f0107f0 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:59.004176 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-5ccc31b7-a640-426a-94e6-dead3f0107f0 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: 230833df-72df-406e-8051-75b5032d5018] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:59.010372 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5ccc31b7-a640-426a-94e6-dead3f0107f0 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:59.010944 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5ccc31b7-a640-426a-94e6-dead3f0107f0 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:59.011982 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5ccc31b7-a640-426a-94e6-dead3f0107f0 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:59.012425 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5ccc31b7-a640-426a-94e6-dead3f0107f0 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:59.152486 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-5ccc31b7-a640-426a-94e6-dead3f0107f0 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:59.160615 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-5ccc31b7-a640-426a-94e6-dead3f0107f0 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018" status: 200 len: 1312 microversion: 2.1 time: 0.160864 Jul 20 19:25:59.161186 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 178/367] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:58 2022] GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018 => generated 1312 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:25:59.566604 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-fd889fbe-e34f-42d9-9cbf-2d7049a4cc81 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:59.567209 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-fd889fbe-e34f-42d9-9cbf-2d7049a4cc81 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] [instance: 062837f7-369c-477b-893d-36d1a9696004] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:59.573468 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-fd889fbe-e34f-42d9-9cbf-2d7049a4cc81 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:59.574089 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-fd889fbe-e34f-42d9-9cbf-2d7049a4cc81 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:59.574771 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-fd889fbe-e34f-42d9-9cbf-2d7049a4cc81 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:59.575200 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-fd889fbe-e34f-42d9-9cbf-2d7049a4cc81 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:59.718410 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-fd889fbe-e34f-42d9-9cbf-2d7049a4cc81 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67416d4eea6946fdb77a09242e58a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66a7bac21e44b72a59bb74c917daae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:59.725939 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-fd889fbe-e34f-42d9-9cbf-2d7049a4cc81 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] 10.222.0.69 "GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004" status: 200 len: 1315 microversion: 2.1 time: 0.163171 Jul 20 19:25:59.726576 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 190/368] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:59 2022] GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:25:59.753815 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-530a55d5-ea92-425f-8cb8-5de5b0651dbc tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:59.754469 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-530a55d5-ea92-425f-8cb8-5de5b0651dbc tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 053acc99-052e-4247-a54a-2799958f10e6] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:59.761502 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-530a55d5-ea92-425f-8cb8-5de5b0651dbc tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:59.761975 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-530a55d5-ea92-425f-8cb8-5de5b0651dbc tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:59.762737 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-530a55d5-ea92-425f-8cb8-5de5b0651dbc tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:59.763164 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-530a55d5-ea92-425f-8cb8-5de5b0651dbc tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:59.900070 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-530a55d5-ea92-425f-8cb8-5de5b0651dbc tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:59.908417 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-530a55d5-ea92-425f-8cb8-5de5b0651dbc tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6" status: 200 len: 1522 microversion: 2.1 time: 0.158453 Jul 20 19:25:59.908990 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 179/369] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:59 2022] GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:00.178605 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-e82cbf21-c355-4f8b-87bd-7972ccccc4ae tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:00.179227 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-e82cbf21-c355-4f8b-87bd-7972ccccc4ae tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: 230833df-72df-406e-8051-75b5032d5018] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:00.185533 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e82cbf21-c355-4f8b-87bd-7972ccccc4ae tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:00.185971 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e82cbf21-c355-4f8b-87bd-7972ccccc4ae tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:00.186725 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e82cbf21-c355-4f8b-87bd-7972ccccc4ae tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:00.187151 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e82cbf21-c355-4f8b-87bd-7972ccccc4ae tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:00.325932 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-e82cbf21-c355-4f8b-87bd-7972ccccc4ae tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:00.333347 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-e82cbf21-c355-4f8b-87bd-7972ccccc4ae tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018" status: 200 len: 1312 microversion: 2.1 time: 0.158533 Jul 20 19:26:00.333944 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 191/370] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:00 2022] GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018 => generated 1312 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:00.743220 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-aa341bbb-6f15-432e-b9fe-82ad3ac3180f tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:00.743838 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-aa341bbb-6f15-432e-b9fe-82ad3ac3180f tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] [instance: 062837f7-369c-477b-893d-36d1a9696004] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:00.750579 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aa341bbb-6f15-432e-b9fe-82ad3ac3180f tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:00.751029 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aa341bbb-6f15-432e-b9fe-82ad3ac3180f tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:00.751819 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aa341bbb-6f15-432e-b9fe-82ad3ac3180f tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:00.752255 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aa341bbb-6f15-432e-b9fe-82ad3ac3180f tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:00.888990 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-aa341bbb-6f15-432e-b9fe-82ad3ac3180f tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67416d4eea6946fdb77a09242e58a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66a7bac21e44b72a59bb74c917daae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:00.897460 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-aa341bbb-6f15-432e-b9fe-82ad3ac3180f tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] 10.222.0.69 "GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004" status: 200 len: 1315 microversion: 2.1 time: 0.157988 Jul 20 19:26:00.898088 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 180/371] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:00 2022] GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:00.931430 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-3fb2b654-bb00-4c2a-b062-e14c3730a87f tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:00.932035 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-3fb2b654-bb00-4c2a-b062-e14c3730a87f tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 053acc99-052e-4247-a54a-2799958f10e6] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:00.939275 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3fb2b654-bb00-4c2a-b062-e14c3730a87f tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:00.939723 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3fb2b654-bb00-4c2a-b062-e14c3730a87f tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:00.940493 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3fb2b654-bb00-4c2a-b062-e14c3730a87f tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:00.940926 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3fb2b654-bb00-4c2a-b062-e14c3730a87f tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:01.078135 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-3fb2b654-bb00-4c2a-b062-e14c3730a87f tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:01.085552 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-3fb2b654-bb00-4c2a-b062-e14c3730a87f tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6" status: 200 len: 1522 microversion: 2.1 time: 0.158119 Jul 20 19:26:01.086108 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 192/372] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:00 2022] GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:01.351942 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d2e6f3d6-426a-49f2-9be6-3b0fb09f0536 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:01.352545 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d2e6f3d6-426a-49f2-9be6-3b0fb09f0536 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: 230833df-72df-406e-8051-75b5032d5018] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:01.359779 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d2e6f3d6-426a-49f2-9be6-3b0fb09f0536 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:01.360230 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d2e6f3d6-426a-49f2-9be6-3b0fb09f0536 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:01.361001 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d2e6f3d6-426a-49f2-9be6-3b0fb09f0536 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:01.361430 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d2e6f3d6-426a-49f2-9be6-3b0fb09f0536 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:01.506337 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d2e6f3d6-426a-49f2-9be6-3b0fb09f0536 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:01.514393 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d2e6f3d6-426a-49f2-9be6-3b0fb09f0536 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018" status: 200 len: 1312 microversion: 2.1 time: 0.166343 Jul 20 19:26:01.514966 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 181/373] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:01 2022] GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018 => generated 1312 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:01.915177 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-a71eb400-b9a6-4855-aed9-4598687df94d tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:01.915770 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-a71eb400-b9a6-4855-aed9-4598687df94d tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] [instance: 062837f7-369c-477b-893d-36d1a9696004] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:01.923053 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a71eb400-b9a6-4855-aed9-4598687df94d tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:01.923603 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a71eb400-b9a6-4855-aed9-4598687df94d tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:01.924400 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a71eb400-b9a6-4855-aed9-4598687df94d tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:01.924917 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a71eb400-b9a6-4855-aed9-4598687df94d tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:02.067298 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-a71eb400-b9a6-4855-aed9-4598687df94d tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67416d4eea6946fdb77a09242e58a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66a7bac21e44b72a59bb74c917daae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:02.075237 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-a71eb400-b9a6-4855-aed9-4598687df94d tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] 10.222.0.69 "GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004" status: 200 len: 1315 microversion: 2.1 time: 0.163898 Jul 20 19:26:02.075816 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 193/374] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:01 2022] GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:02.102937 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-43f9753c-8de2-4537-a431-46fcf4022a88 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:02.103539 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-43f9753c-8de2-4537-a431-46fcf4022a88 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 053acc99-052e-4247-a54a-2799958f10e6] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:02.110753 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-43f9753c-8de2-4537-a431-46fcf4022a88 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:02.111200 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-43f9753c-8de2-4537-a431-46fcf4022a88 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:02.111955 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-43f9753c-8de2-4537-a431-46fcf4022a88 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:02.112382 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-43f9753c-8de2-4537-a431-46fcf4022a88 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:02.251177 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-43f9753c-8de2-4537-a431-46fcf4022a88 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:02.259950 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-43f9753c-8de2-4537-a431-46fcf4022a88 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6" status: 200 len: 1522 microversion: 2.1 time: 0.160935 Jul 20 19:26:02.260522 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 182/375] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:02 2022] GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:02.532769 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-93b113ca-f404-4c43-9714-36f736f81cdf tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:02.533371 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-93b113ca-f404-4c43-9714-36f736f81cdf tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: 230833df-72df-406e-8051-75b5032d5018] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:02.540419 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-93b113ca-f404-4c43-9714-36f736f81cdf tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:02.541132 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-93b113ca-f404-4c43-9714-36f736f81cdf tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:02.541756 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-93b113ca-f404-4c43-9714-36f736f81cdf tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:02.542769 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-93b113ca-f404-4c43-9714-36f736f81cdf tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:02.687278 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-93b113ca-f404-4c43-9714-36f736f81cdf tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:02.696730 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-93b113ca-f404-4c43-9714-36f736f81cdf tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018" status: 200 len: 1312 microversion: 2.1 time: 0.168253 Jul 20 19:26:02.697307 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 194/376] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:02 2022] GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018 => generated 1312 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:03.096459 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4d14db1b-bc48-41e6-b6e6-c5d58b1a9561 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:03.096981 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-4d14db1b-bc48-41e6-b6e6-c5d58b1a9561 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] [instance: 062837f7-369c-477b-893d-36d1a9696004] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:03.103186 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4d14db1b-bc48-41e6-b6e6-c5d58b1a9561 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:03.103779 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4d14db1b-bc48-41e6-b6e6-c5d58b1a9561 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:03.104377 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4d14db1b-bc48-41e6-b6e6-c5d58b1a9561 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:03.104808 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4d14db1b-bc48-41e6-b6e6-c5d58b1a9561 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:03.242008 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-4d14db1b-bc48-41e6-b6e6-c5d58b1a9561 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67416d4eea6946fdb77a09242e58a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66a7bac21e44b72a59bb74c917daae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:03.250364 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-4d14db1b-bc48-41e6-b6e6-c5d58b1a9561 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] 10.222.0.69 "GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004" status: 200 len: 1315 microversion: 2.1 time: 0.158029 Jul 20 19:26:03.250902 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 183/377] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:03 2022] GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:03.277850 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-7f310b3c-cc74-4d93-845e-64c5b8355344 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:03.278476 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-7f310b3c-cc74-4d93-845e-64c5b8355344 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 053acc99-052e-4247-a54a-2799958f10e6] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:03.284989 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-7f310b3c-cc74-4d93-845e-64c5b8355344 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:03.285429 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-7f310b3c-cc74-4d93-845e-64c5b8355344 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:03.286214 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-7f310b3c-cc74-4d93-845e-64c5b8355344 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:03.286640 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-7f310b3c-cc74-4d93-845e-64c5b8355344 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:03.416264 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-7f310b3c-cc74-4d93-845e-64c5b8355344 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:03.424610 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-7f310b3c-cc74-4d93-845e-64c5b8355344 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6" status: 200 len: 1522 microversion: 2.1 time: 0.151078 Jul 20 19:26:03.425168 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 195/378] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:03 2022] GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:03.713420 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-fab791e6-4434-4f89-98e2-0f52190c6889 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:03.714555 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-fab791e6-4434-4f89-98e2-0f52190c6889 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: 230833df-72df-406e-8051-75b5032d5018] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:03.721397 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fab791e6-4434-4f89-98e2-0f52190c6889 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:03.721869 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fab791e6-4434-4f89-98e2-0f52190c6889 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:03.722637 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fab791e6-4434-4f89-98e2-0f52190c6889 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:03.723064 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fab791e6-4434-4f89-98e2-0f52190c6889 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:03.858215 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-fab791e6-4434-4f89-98e2-0f52190c6889 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:03.866282 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-fab791e6-4434-4f89-98e2-0f52190c6889 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018" status: 200 len: 1312 microversion: 2.1 time: 0.156841 Jul 20 19:26:03.866856 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 184/379] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:03 2022] GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018 => generated 1312 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:04.268885 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-d5128db4-8aed-4b4d-b723-575149250562 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:04.279185 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-d5128db4-8aed-4b4d-b723-575149250562 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] [instance: 062837f7-369c-477b-893d-36d1a9696004] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:04.279185 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d5128db4-8aed-4b4d-b723-575149250562 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:04.279883 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d5128db4-8aed-4b4d-b723-575149250562 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:04.280022 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d5128db4-8aed-4b4d-b723-575149250562 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:04.280457 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d5128db4-8aed-4b4d-b723-575149250562 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:04.412454 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-d5128db4-8aed-4b4d-b723-575149250562 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67416d4eea6946fdb77a09242e58a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66a7bac21e44b72a59bb74c917daae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:04.419997 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-d5128db4-8aed-4b4d-b723-575149250562 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] 10.222.0.69 "GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004" status: 200 len: 1315 microversion: 2.1 time: 0.155539 Jul 20 19:26:04.420555 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 196/380] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:04 2022] GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:04.442022 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-3278dff6-3ffb-4626-b5f9-0b5d5de58f9c tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:04.442653 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-3278dff6-3ffb-4626-b5f9-0b5d5de58f9c tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 053acc99-052e-4247-a54a-2799958f10e6] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:04.449164 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3278dff6-3ffb-4626-b5f9-0b5d5de58f9c tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:04.449639 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3278dff6-3ffb-4626-b5f9-0b5d5de58f9c tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:04.450394 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3278dff6-3ffb-4626-b5f9-0b5d5de58f9c tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:04.450823 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3278dff6-3ffb-4626-b5f9-0b5d5de58f9c tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:04.579782 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3278dff6-3ffb-4626-b5f9-0b5d5de58f9c tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:04.587568 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-3278dff6-3ffb-4626-b5f9-0b5d5de58f9c tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6" status: 200 len: 1522 microversion: 2.1 time: 0.149318 Jul 20 19:26:04.588126 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 185/381] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:04 2022] GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:04.882893 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-f3e633eb-e75b-44ec-802b-fd000ac14860 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:04.883494 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-f3e633eb-e75b-44ec-802b-fd000ac14860 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: 230833df-72df-406e-8051-75b5032d5018] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:04.890335 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f3e633eb-e75b-44ec-802b-fd000ac14860 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:04.890825 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f3e633eb-e75b-44ec-802b-fd000ac14860 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:04.891623 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f3e633eb-e75b-44ec-802b-fd000ac14860 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:04.892050 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f3e633eb-e75b-44ec-802b-fd000ac14860 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:05.031271 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-f3e633eb-e75b-44ec-802b-fd000ac14860 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:05.038633 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-f3e633eb-e75b-44ec-802b-fd000ac14860 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018" status: 200 len: 1312 microversion: 2.1 time: 0.159477 Jul 20 19:26:05.039193 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 197/382] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:04 2022] GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018 => generated 1312 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:05.436684 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d09276c5-07f2-4dc3-b64d-763592524f89 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:05.437302 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d09276c5-07f2-4dc3-b64d-763592524f89 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] [instance: 062837f7-369c-477b-893d-36d1a9696004] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:05.443883 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d09276c5-07f2-4dc3-b64d-763592524f89 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:05.444477 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d09276c5-07f2-4dc3-b64d-763592524f89 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:05.445086 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d09276c5-07f2-4dc3-b64d-763592524f89 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:05.445549 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d09276c5-07f2-4dc3-b64d-763592524f89 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:05.577692 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d09276c5-07f2-4dc3-b64d-763592524f89 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67416d4eea6946fdb77a09242e58a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66a7bac21e44b72a59bb74c917daae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:05.585000 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d09276c5-07f2-4dc3-b64d-763592524f89 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] 10.222.0.69 "GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004" status: 200 len: 1315 microversion: 2.1 time: 0.152191 Jul 20 19:26:05.585588 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 186/383] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:05 2022] GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:05.604011 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-c6282cba-fb9a-4dff-b598-4276b2fe2c70 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:05.604690 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-c6282cba-fb9a-4dff-b598-4276b2fe2c70 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 053acc99-052e-4247-a54a-2799958f10e6] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:05.610885 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c6282cba-fb9a-4dff-b598-4276b2fe2c70 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:05.611330 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c6282cba-fb9a-4dff-b598-4276b2fe2c70 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:05.612087 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c6282cba-fb9a-4dff-b598-4276b2fe2c70 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:05.612519 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c6282cba-fb9a-4dff-b598-4276b2fe2c70 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:05.744669 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-c6282cba-fb9a-4dff-b598-4276b2fe2c70 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:05.752439 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-c6282cba-fb9a-4dff-b598-4276b2fe2c70 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6" status: 200 len: 1522 microversion: 2.1 time: 0.152257 Jul 20 19:26:05.753004 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 198/384] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:05 2022] GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:06.055749 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-f29bc1e8-37b1-4ab2-b40a-5501b05ae9f1 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:06.056347 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-f29bc1e8-37b1-4ab2-b40a-5501b05ae9f1 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: 230833df-72df-406e-8051-75b5032d5018] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:06.062964 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f29bc1e8-37b1-4ab2-b40a-5501b05ae9f1 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:06.063411 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f29bc1e8-37b1-4ab2-b40a-5501b05ae9f1 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:06.064173 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f29bc1e8-37b1-4ab2-b40a-5501b05ae9f1 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:06.064604 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f29bc1e8-37b1-4ab2-b40a-5501b05ae9f1 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:06.190456 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-f29bc1e8-37b1-4ab2-b40a-5501b05ae9f1 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:06.197672 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-f29bc1e8-37b1-4ab2-b40a-5501b05ae9f1 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018" status: 200 len: 1312 microversion: 2.1 time: 0.145789 Jul 20 19:26:06.198855 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 187/385] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:06 2022] GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018 => generated 1312 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:06.602159 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-38a8c03d-9218-45e5-8abc-5bbfd8298e8f tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:06.602762 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-38a8c03d-9218-45e5-8abc-5bbfd8298e8f tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] [instance: 062837f7-369c-477b-893d-36d1a9696004] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:06.609536 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-38a8c03d-9218-45e5-8abc-5bbfd8298e8f tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:06.610084 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-38a8c03d-9218-45e5-8abc-5bbfd8298e8f tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:06.610728 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-38a8c03d-9218-45e5-8abc-5bbfd8298e8f tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:06.611164 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-38a8c03d-9218-45e5-8abc-5bbfd8298e8f tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:06.741475 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-38a8c03d-9218-45e5-8abc-5bbfd8298e8f tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67416d4eea6946fdb77a09242e58a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66a7bac21e44b72a59bb74c917daae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:06.743812 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_cell1:SELECT=100 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:06.750330 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-38a8c03d-9218-45e5-8abc-5bbfd8298e8f tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] 10.222.0.69 "GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004" status: 200 len: 1315 microversion: 2.1 time: 0.152022 Jul 20 19:26:06.750898 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 199/386] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:06 2022] GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:06.769643 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d9954273-b212-420e-bf30-71a1fd8ed69f tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:06.770259 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d9954273-b212-420e-bf30-71a1fd8ed69f tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 053acc99-052e-4247-a54a-2799958f10e6] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:06.777287 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d9954273-b212-420e-bf30-71a1fd8ed69f tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:06.777754 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d9954273-b212-420e-bf30-71a1fd8ed69f tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:06.778517 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d9954273-b212-420e-bf30-71a1fd8ed69f tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:06.778951 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d9954273-b212-420e-bf30-71a1fd8ed69f tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:06.912218 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d9954273-b212-420e-bf30-71a1fd8ed69f tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:06.920221 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d9954273-b212-420e-bf30-71a1fd8ed69f tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6" status: 200 len: 1522 microversion: 2.1 time: 0.154379 Jul 20 19:26:06.920780 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 188/387] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:06 2022] GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:07.215244 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-b3209e37-55b3-4c1e-9767-2b809beddc7c tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:07.216114 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-b3209e37-55b3-4c1e-9767-2b809beddc7c tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: 230833df-72df-406e-8051-75b5032d5018] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:07.222394 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b3209e37-55b3-4c1e-9767-2b809beddc7c tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:07.222841 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b3209e37-55b3-4c1e-9767-2b809beddc7c tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:07.223597 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b3209e37-55b3-4c1e-9767-2b809beddc7c tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:07.224030 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b3209e37-55b3-4c1e-9767-2b809beddc7c tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:07.352040 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-b3209e37-55b3-4c1e-9767-2b809beddc7c tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:07.360063 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-b3209e37-55b3-4c1e-9767-2b809beddc7c tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018" status: 200 len: 1312 microversion: 2.1 time: 0.148838 Jul 20 19:26:07.360618 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 200/388] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:07 2022] GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018 => generated 1312 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:07.767600 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a8ba7e35-9262-4143-9fbf-b98850c9414f tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:07.768202 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a8ba7e35-9262-4143-9fbf-b98850c9414f tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] [instance: 062837f7-369c-477b-893d-36d1a9696004] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:07.774627 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a8ba7e35-9262-4143-9fbf-b98850c9414f tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:07.775216 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a8ba7e35-9262-4143-9fbf-b98850c9414f tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:07.775810 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a8ba7e35-9262-4143-9fbf-b98850c9414f tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:07.776308 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a8ba7e35-9262-4143-9fbf-b98850c9414f tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:07.904705 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a8ba7e35-9262-4143-9fbf-b98850c9414f tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67416d4eea6946fdb77a09242e58a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66a7bac21e44b72a59bb74c917daae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:07.911968 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a8ba7e35-9262-4143-9fbf-b98850c9414f tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] 10.222.0.69 "GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004" status: 200 len: 1315 microversion: 2.1 time: 0.148234 Jul 20 19:26:07.912527 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 189/389] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:07 2022] GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:07.936679 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-ce2032b6-e077-4ddf-a3b2-8879e7eb5947 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:07.937311 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-ce2032b6-e077-4ddf-a3b2-8879e7eb5947 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 053acc99-052e-4247-a54a-2799958f10e6] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:07.943492 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-ce2032b6-e077-4ddf-a3b2-8879e7eb5947 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:07.943943 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-ce2032b6-e077-4ddf-a3b2-8879e7eb5947 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:07.944698 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-ce2032b6-e077-4ddf-a3b2-8879e7eb5947 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:07.945131 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-ce2032b6-e077-4ddf-a3b2-8879e7eb5947 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:08.077749 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-ce2032b6-e077-4ddf-a3b2-8879e7eb5947 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:08.085383 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-ce2032b6-e077-4ddf-a3b2-8879e7eb5947 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6" status: 200 len: 1522 microversion: 2.1 time: 0.153234 Jul 20 19:26:08.085981 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 201/390] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:07 2022] GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:08.376790 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-f34ce1c4-be52-4381-a909-4d63c862c674 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:08.377396 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-f34ce1c4-be52-4381-a909-4d63c862c674 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: 230833df-72df-406e-8051-75b5032d5018] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:08.383416 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f34ce1c4-be52-4381-a909-4d63c862c674 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:08.383863 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f34ce1c4-be52-4381-a909-4d63c862c674 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:08.384656 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f34ce1c4-be52-4381-a909-4d63c862c674 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:08.385089 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f34ce1c4-be52-4381-a909-4d63c862c674 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:08.514690 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-f34ce1c4-be52-4381-a909-4d63c862c674 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:08.522184 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-f34ce1c4-be52-4381-a909-4d63c862c674 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018" status: 200 len: 1312 microversion: 2.1 time: 0.149355 Jul 20 19:26:08.522746 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 190/391] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:08 2022] GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018 => generated 1312 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:08.930251 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-1bf02cfa-81db-44ea-b8fc-717cfedc0374 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:08.930862 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-1bf02cfa-81db-44ea-b8fc-717cfedc0374 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] [instance: 062837f7-369c-477b-893d-36d1a9696004] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:08.937424 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1bf02cfa-81db-44ea-b8fc-717cfedc0374 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:08.938017 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1bf02cfa-81db-44ea-b8fc-717cfedc0374 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:08.938638 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1bf02cfa-81db-44ea-b8fc-717cfedc0374 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:08.939070 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1bf02cfa-81db-44ea-b8fc-717cfedc0374 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:09.078366 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-1bf02cfa-81db-44ea-b8fc-717cfedc0374 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67416d4eea6946fdb77a09242e58a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66a7bac21e44b72a59bb74c917daae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:09.085588 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-1bf02cfa-81db-44ea-b8fc-717cfedc0374 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] 10.222.0.69 "GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004" status: 200 len: 1315 microversion: 2.1 time: 0.159151 Jul 20 19:26:09.086146 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 202/392] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:08 2022] GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:09.102290 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d08d86e7-f1ba-400a-9a65-76a3f47588b8 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:09.102895 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d08d86e7-f1ba-400a-9a65-76a3f47588b8 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 053acc99-052e-4247-a54a-2799958f10e6] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:09.110032 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d08d86e7-f1ba-400a-9a65-76a3f47588b8 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:09.110481 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d08d86e7-f1ba-400a-9a65-76a3f47588b8 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:09.111239 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d08d86e7-f1ba-400a-9a65-76a3f47588b8 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:09.111684 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d08d86e7-f1ba-400a-9a65-76a3f47588b8 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:09.239172 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d08d86e7-f1ba-400a-9a65-76a3f47588b8 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:09.247957 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d08d86e7-f1ba-400a-9a65-76a3f47588b8 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6" status: 200 len: 1522 microversion: 2.1 time: 0.149414 Jul 20 19:26:09.248521 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 191/393] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:09 2022] GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:09.539566 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-645b8a82-a31b-4492-9631-1985f1ae0990 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:09.540080 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-645b8a82-a31b-4492-9631-1985f1ae0990 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: 230833df-72df-406e-8051-75b5032d5018] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:09.546285 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-645b8a82-a31b-4492-9631-1985f1ae0990 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:09.546727 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-645b8a82-a31b-4492-9631-1985f1ae0990 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:09.547483 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-645b8a82-a31b-4492-9631-1985f1ae0990 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:09.547919 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-645b8a82-a31b-4492-9631-1985f1ae0990 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:09.680138 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-645b8a82-a31b-4492-9631-1985f1ae0990 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:09.688298 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-645b8a82-a31b-4492-9631-1985f1ae0990 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018" status: 200 len: 1312 microversion: 2.1 time: 0.152658 Jul 20 19:26:09.688860 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 203/394] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:09 2022] GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018 => generated 1312 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:10.103055 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a2872670-df76-4b7b-ac92-c2041205af02 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:10.103760 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a2872670-df76-4b7b-ac92-c2041205af02 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] [instance: 062837f7-369c-477b-893d-36d1a9696004] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:10.111049 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a2872670-df76-4b7b-ac92-c2041205af02 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:10.111567 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a2872670-df76-4b7b-ac92-c2041205af02 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:10.112341 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a2872670-df76-4b7b-ac92-c2041205af02 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:10.112769 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a2872670-df76-4b7b-ac92-c2041205af02 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:10.261242 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a2872670-df76-4b7b-ac92-c2041205af02 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67416d4eea6946fdb77a09242e58a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66a7bac21e44b72a59bb74c917daae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:10.265855 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-3a95ef15-bb99-45c7-8219-49b4a88f069b tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:10.267021 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-3a95ef15-bb99-45c7-8219-49b4a88f069b tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 053acc99-052e-4247-a54a-2799958f10e6] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:10.269921 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_api:SELECT=82 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:10.272955 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a2872670-df76-4b7b-ac92-c2041205af02 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] 10.222.0.69 "GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004" status: 200 len: 1315 microversion: 2.1 time: 0.173529 Jul 20 19:26:10.277319 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3a95ef15-bb99-45c7-8219-49b4a88f069b tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:10.277781 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3a95ef15-bb99-45c7-8219-49b4a88f069b tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:10.278600 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3a95ef15-bb99-45c7-8219-49b4a88f069b tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:10.279044 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3a95ef15-bb99-45c7-8219-49b4a88f069b tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:10.284474 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 192/395] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:10 2022] GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:10.425208 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-3a95ef15-bb99-45c7-8219-49b4a88f069b tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:10.437783 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-3a95ef15-bb99-45c7-8219-49b4a88f069b tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6" status: 200 len: 1522 microversion: 2.1 time: 0.177291 Jul 20 19:26:10.438586 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 204/396] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:10 2022] GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:10.705180 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d7084578-7f20-4303-9c94-06311efd5fbb tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:10.705906 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d7084578-7f20-4303-9c94-06311efd5fbb tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: 230833df-72df-406e-8051-75b5032d5018] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:10.712989 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d7084578-7f20-4303-9c94-06311efd5fbb tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:10.714028 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d7084578-7f20-4303-9c94-06311efd5fbb tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:10.714805 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d7084578-7f20-4303-9c94-06311efd5fbb tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:10.715236 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d7084578-7f20-4303-9c94-06311efd5fbb tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:10.733265 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:10.864450 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d7084578-7f20-4303-9c94-06311efd5fbb tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:10.872770 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d7084578-7f20-4303-9c94-06311efd5fbb tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018" status: 200 len: 1312 microversion: 2.1 time: 0.171433 Jul 20 19:26:10.873367 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 193/397] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:10 2022] GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018 => generated 1312 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:11.293353 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-cb6aad92-50fb-4d2c-a839-1e0ca862e3b0 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:11.294968 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-cb6aad92-50fb-4d2c-a839-1e0ca862e3b0 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] [instance: 062837f7-369c-477b-893d-36d1a9696004] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:11.301628 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-cb6aad92-50fb-4d2c-a839-1e0ca862e3b0 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:11.301628 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-cb6aad92-50fb-4d2c-a839-1e0ca862e3b0 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:11.302368 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-cb6aad92-50fb-4d2c-a839-1e0ca862e3b0 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:11.302796 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-cb6aad92-50fb-4d2c-a839-1e0ca862e3b0 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:11.456707 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-0007bcdc-fe4f-4a5f-acd4-6136ab193c55 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:11.458489 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-0007bcdc-fe4f-4a5f-acd4-6136ab193c55 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 053acc99-052e-4247-a54a-2799958f10e6] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:11.467645 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0007bcdc-fe4f-4a5f-acd4-6136ab193c55 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:11.468584 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0007bcdc-fe4f-4a5f-acd4-6136ab193c55 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:11.469724 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0007bcdc-fe4f-4a5f-acd4-6136ab193c55 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:11.470424 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0007bcdc-fe4f-4a5f-acd4-6136ab193c55 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:11.496716 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-cb6aad92-50fb-4d2c-a839-1e0ca862e3b0 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67416d4eea6946fdb77a09242e58a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66a7bac21e44b72a59bb74c917daae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:11.505215 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-cb6aad92-50fb-4d2c-a839-1e0ca862e3b0 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] 10.222.0.69 "GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004" status: 200 len: 1315 microversion: 2.1 time: 0.217447 Jul 20 19:26:11.505809 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 205/398] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:11 2022] GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:11.619451 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0007bcdc-fe4f-4a5f-acd4-6136ab193c55 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:11.629023 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-0007bcdc-fe4f-4a5f-acd4-6136ab193c55 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6" status: 200 len: 1522 microversion: 2.1 time: 0.177151 Jul 20 19:26:11.640293 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 194/399] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:11 2022] GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:11.894429 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-f99c73af-23dc-4169-afc7-3a397b3eb7b0 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:11.895102 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-f99c73af-23dc-4169-afc7-3a397b3eb7b0 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: 230833df-72df-406e-8051-75b5032d5018] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:11.901145 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f99c73af-23dc-4169-afc7-3a397b3eb7b0 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:11.901758 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f99c73af-23dc-4169-afc7-3a397b3eb7b0 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:11.902578 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f99c73af-23dc-4169-afc7-3a397b3eb7b0 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:11.903018 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f99c73af-23dc-4169-afc7-3a397b3eb7b0 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:12.046557 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-f99c73af-23dc-4169-afc7-3a397b3eb7b0 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:12.054369 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-f99c73af-23dc-4169-afc7-3a397b3eb7b0 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018" status: 200 len: 1312 microversion: 2.1 time: 0.163929 Jul 20 19:26:12.054923 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 206/400] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:11 2022] GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018 => generated 1312 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:12.524344 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-1a11f5af-98d2-4261-84ca-46e5eabf0719 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:12.524981 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-1a11f5af-98d2-4261-84ca-46e5eabf0719 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] [instance: 062837f7-369c-477b-893d-36d1a9696004] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:12.531928 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1a11f5af-98d2-4261-84ca-46e5eabf0719 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:12.532376 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1a11f5af-98d2-4261-84ca-46e5eabf0719 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:12.533147 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1a11f5af-98d2-4261-84ca-46e5eabf0719 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:12.533610 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1a11f5af-98d2-4261-84ca-46e5eabf0719 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:12.646749 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-515aa1ef-86de-4ce6-9120-3f7d27f64807 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:12.647924 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-515aa1ef-86de-4ce6-9120-3f7d27f64807 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 053acc99-052e-4247-a54a-2799958f10e6] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:12.654538 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-515aa1ef-86de-4ce6-9120-3f7d27f64807 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:12.654992 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-515aa1ef-86de-4ce6-9120-3f7d27f64807 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:12.655768 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-515aa1ef-86de-4ce6-9120-3f7d27f64807 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:12.656265 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-515aa1ef-86de-4ce6-9120-3f7d27f64807 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:12.750226 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1a11f5af-98d2-4261-84ca-46e5eabf0719 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67416d4eea6946fdb77a09242e58a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66a7bac21e44b72a59bb74c917daae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:12.762762 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-1a11f5af-98d2-4261-84ca-46e5eabf0719 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] 10.222.0.69 "GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004" status: 200 len: 1465 microversion: 2.1 time: 0.242803 Jul 20 19:26:12.765552 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 195/401] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:12 2022] GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004 => generated 1465 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:12.806028 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-515aa1ef-86de-4ce6-9120-3f7d27f64807 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:12.814842 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-515aa1ef-86de-4ce6-9120-3f7d27f64807 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6" status: 200 len: 1522 microversion: 2.1 time: 0.171892 Jul 20 19:26:12.817764 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a6ca38a7-cb32-46be-ad7d-ad42c8f85bc4 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:12.818592 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a6ca38a7-cb32-46be-ad7d-ad42c8f85bc4 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] [instance: 062837f7-369c-477b-893d-36d1a9696004] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:12.824655 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 207/402] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:12 2022] GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:12.825801 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a6ca38a7-cb32-46be-ad7d-ad42c8f85bc4 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:12.826321 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a6ca38a7-cb32-46be-ad7d-ad42c8f85bc4 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:12.827420 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a6ca38a7-cb32-46be-ad7d-ad42c8f85bc4 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:12.827930 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a6ca38a7-cb32-46be-ad7d-ad42c8f85bc4 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:12.857960 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a6ca38a7-cb32-46be-ad7d-ad42c8f85bc4 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] [instance: 062837f7-369c-477b-893d-36d1a9696004] Going to try to terminate instance {{(pid=117761) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 19:26:12.935587 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_api:SELECT=80 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:12.956302 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a6ca38a7-cb32-46be-ad7d-ad42c8f85bc4 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] 10.222.0.69 "DELETE /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004" status: 204 len: 0 microversion: 2.1 time: 0.143591 Jul 20 19:26:12.956813 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 196/403] 10.222.0.69 () {58 vars in 1238 bytes} [Wed Jul 20 19:26:12 2022] DELETE /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 19:26:12.968172 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-b2664cbd-cab9-4fb3-9a18-663f285f0447 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:12.968781 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-b2664cbd-cab9-4fb3-9a18-663f285f0447 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] [instance: 062837f7-369c-477b-893d-36d1a9696004] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:12.976331 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b2664cbd-cab9-4fb3-9a18-663f285f0447 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:12.976767 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b2664cbd-cab9-4fb3-9a18-663f285f0447 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:12.977557 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b2664cbd-cab9-4fb3-9a18-663f285f0447 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:12.978251 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b2664cbd-cab9-4fb3-9a18-663f285f0447 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:13.080884 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-3261e6bd-6407-4b32-8b24-ed686be38b0b tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:13.081647 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-3261e6bd-6407-4b32-8b24-ed686be38b0b tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: 230833df-72df-406e-8051-75b5032d5018] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:13.094634 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3261e6bd-6407-4b32-8b24-ed686be38b0b tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:13.098411 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3261e6bd-6407-4b32-8b24-ed686be38b0b tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:13.099757 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3261e6bd-6407-4b32-8b24-ed686be38b0b tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:13.101669 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3261e6bd-6407-4b32-8b24-ed686be38b0b tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:13.139640 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-b2664cbd-cab9-4fb3-9a18-663f285f0447 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67416d4eea6946fdb77a09242e58a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66a7bac21e44b72a59bb74c917daae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:13.147749 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-b2664cbd-cab9-4fb3-9a18-663f285f0447 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] 10.222.0.69 "GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004" status: 200 len: 1471 microversion: 2.1 time: 0.185739 Jul 20 19:26:13.148633 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 208/404] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:12 2022] GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004 => generated 1471 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:13.292825 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3261e6bd-6407-4b32-8b24-ed686be38b0b tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:13.300583 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-3261e6bd-6407-4b32-8b24-ed686be38b0b tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018" status: 200 len: 1312 microversion: 2.1 time: 0.232164 Jul 20 19:26:13.301481 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 197/405] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:13 2022] GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018 => generated 1312 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:13.830777 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-d4ef8fdc-b670-43cd-b033-0a358c55b499 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:13.832029 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-d4ef8fdc-b670-43cd-b033-0a358c55b499 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 053acc99-052e-4247-a54a-2799958f10e6] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:13.839560 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d4ef8fdc-b670-43cd-b033-0a358c55b499 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:13.840865 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d4ef8fdc-b670-43cd-b033-0a358c55b499 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:13.841938 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d4ef8fdc-b670-43cd-b033-0a358c55b499 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:13.842430 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d4ef8fdc-b670-43cd-b033-0a358c55b499 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:13.975273 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [req-86043cef-7d22-42a9-9e00-29d698e8b170 req-fdded654-d5c9-44b6-8e75-a6b69e47657b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "230833df-72df-406e-8051-75b5032d5018", "name": "network-vif-plugged", "status": "completed", "tag": "bccc3941-efa0-4408-891d-c46c8a60260a"}]} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:26:13.992756 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-86043cef-7d22-42a9-9e00-29d698e8b170 req-fdded654-d5c9-44b6-8e75-a6b69e47657b service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:13.993425 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-86043cef-7d22-42a9-9e00-29d698e8b170 req-fdded654-d5c9-44b6-8e75-a6b69e47657b service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:14.006235 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.compute.server_external_events [req-86043cef-7d22-42a9-9e00-29d698e8b170 req-fdded654-d5c9-44b6-8e75-a6b69e47657b service nova] Creating event network-vif-plugged:bccc3941-efa0-4408-891d-c46c8a60260a for instance 230833df-72df-406e-8051-75b5032d5018 on hv-cinder-83538 Jul 20 19:26:14.013231 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [req-86043cef-7d22-42a9-9e00-29d698e8b170 req-fdded654-d5c9-44b6-8e75-a6b69e47657b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041859 Jul 20 19:26:14.014646 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 198/406] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 19:26:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:26:14.019354 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-d4ef8fdc-b670-43cd-b033-0a358c55b499 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:14.027619 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-d4ef8fdc-b670-43cd-b033-0a358c55b499 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6" status: 200 len: 1522 microversion: 2.1 time: 0.200439 Jul 20 19:26:14.028213 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 209/407] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:13 2022] GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6 => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:26:14.167636 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-13f9dce1-d11b-4c6d-8871-79579cbd03b5 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:14.168454 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-13f9dce1-d11b-4c6d-8871-79579cbd03b5 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] [instance: 062837f7-369c-477b-893d-36d1a9696004] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:14.174817 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-13f9dce1-d11b-4c6d-8871-79579cbd03b5 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:14.175267 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-13f9dce1-d11b-4c6d-8871-79579cbd03b5 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:14.176080 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-13f9dce1-d11b-4c6d-8871-79579cbd03b5 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:14.176516 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-13f9dce1-d11b-4c6d-8871-79579cbd03b5 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:14.322940 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-8f6d60df-ff01-4b14-b542-2d60efce0443 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:14.324408 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-8f6d60df-ff01-4b14-b542-2d60efce0443 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: 230833df-72df-406e-8051-75b5032d5018] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:14.332510 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8f6d60df-ff01-4b14-b542-2d60efce0443 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:14.333063 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8f6d60df-ff01-4b14-b542-2d60efce0443 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:14.335459 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8f6d60df-ff01-4b14-b542-2d60efce0443 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:14.336095 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8f6d60df-ff01-4b14-b542-2d60efce0443 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:14.376539 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-13f9dce1-d11b-4c6d-8871-79579cbd03b5 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67416d4eea6946fdb77a09242e58a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66a7bac21e44b72a59bb74c917daae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:14.396780 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-13f9dce1-d11b-4c6d-8871-79579cbd03b5 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] 10.222.0.69 "GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004" status: 200 len: 1471 microversion: 2.1 time: 0.234335 Jul 20 19:26:14.397447 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 199/408] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:14 2022] GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004 => generated 1471 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:14.489090 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-8f6d60df-ff01-4b14-b542-2d60efce0443 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:14.498397 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-8f6d60df-ff01-4b14-b542-2d60efce0443 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018" status: 200 len: 1312 microversion: 2.1 time: 0.184656 Jul 20 19:26:14.499263 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 210/409] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:14 2022] GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018 => generated 1312 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:15.044999 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-0a0c6bc3-dcaa-4396-aec7-456a0982bfec tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:15.046627 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-0a0c6bc3-dcaa-4396-aec7-456a0982bfec tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 053acc99-052e-4247-a54a-2799958f10e6] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:15.054363 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0a0c6bc3-dcaa-4396-aec7-456a0982bfec tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:15.055054 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0a0c6bc3-dcaa-4396-aec7-456a0982bfec tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:15.056492 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0a0c6bc3-dcaa-4396-aec7-456a0982bfec tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:15.057732 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0a0c6bc3-dcaa-4396-aec7-456a0982bfec tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:15.192319 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0a0c6bc3-dcaa-4396-aec7-456a0982bfec tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:15.200532 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-0a0c6bc3-dcaa-4396-aec7-456a0982bfec tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6" status: 200 len: 1522 microversion: 2.1 time: 0.160111 Jul 20 19:26:15.201110 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 200/410] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:15 2022] GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:15.415101 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-160020fb-4d2a-4d50-b3a5-d23b394d656c tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:15.415837 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-160020fb-4d2a-4d50-b3a5-d23b394d656c tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] [instance: 062837f7-369c-477b-893d-36d1a9696004] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:15.423220 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-160020fb-4d2a-4d50-b3a5-d23b394d656c tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:15.423677 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-160020fb-4d2a-4d50-b3a5-d23b394d656c tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:15.424447 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-160020fb-4d2a-4d50-b3a5-d23b394d656c tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:15.424880 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-160020fb-4d2a-4d50-b3a5-d23b394d656c tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:15.516104 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-9dffb4be-89d9-4a8c-87c9-1ee51ff218d6 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:15.516790 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-9dffb4be-89d9-4a8c-87c9-1ee51ff218d6 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: 230833df-72df-406e-8051-75b5032d5018] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:15.523147 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9dffb4be-89d9-4a8c-87c9-1ee51ff218d6 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:15.523599 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9dffb4be-89d9-4a8c-87c9-1ee51ff218d6 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:15.524370 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9dffb4be-89d9-4a8c-87c9-1ee51ff218d6 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:15.524798 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9dffb4be-89d9-4a8c-87c9-1ee51ff218d6 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:15.556929 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-160020fb-4d2a-4d50-b3a5-d23b394d656c tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67416d4eea6946fdb77a09242e58a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66a7bac21e44b72a59bb74c917daae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:15.565118 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-160020fb-4d2a-4d50-b3a5-d23b394d656c tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] 10.222.0.69 "GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004" status: 200 len: 1471 microversion: 2.1 time: 0.153947 Jul 20 19:26:15.565962 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 211/411] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:15 2022] GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004 => generated 1471 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:15.956310 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-9dffb4be-89d9-4a8c-87c9-1ee51ff218d6 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:15.964100 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-9dffb4be-89d9-4a8c-87c9-1ee51ff218d6 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018" status: 200 len: 1312 microversion: 2.1 time: 0.451267 Jul 20 19:26:15.964670 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 201/412] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:15 2022] GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018 => generated 1312 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:26:16.218901 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-7d47ff48-a332-45e0-900e-90113411e41e tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:16.220166 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-7d47ff48-a332-45e0-900e-90113411e41e tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 053acc99-052e-4247-a54a-2799958f10e6] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:16.226031 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-7d47ff48-a332-45e0-900e-90113411e41e tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:16.226474 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-7d47ff48-a332-45e0-900e-90113411e41e tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:16.227233 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-7d47ff48-a332-45e0-900e-90113411e41e tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:16.227660 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-7d47ff48-a332-45e0-900e-90113411e41e tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:16.360907 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-7d47ff48-a332-45e0-900e-90113411e41e tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:16.368482 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-7d47ff48-a332-45e0-900e-90113411e41e tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6" status: 200 len: 1522 microversion: 2.1 time: 0.154683 Jul 20 19:26:16.369050 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 212/413] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:16 2022] GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:16.582689 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-60597865-555c-4394-8235-db322a048f25 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:16.583302 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-60597865-555c-4394-8235-db322a048f25 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] [instance: 062837f7-369c-477b-893d-36d1a9696004] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:16.591581 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-60597865-555c-4394-8235-db322a048f25 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:16.592031 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-60597865-555c-4394-8235-db322a048f25 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:16.592813 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-60597865-555c-4394-8235-db322a048f25 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:16.593251 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-60597865-555c-4394-8235-db322a048f25 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:16.731833 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-60597865-555c-4394-8235-db322a048f25 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67416d4eea6946fdb77a09242e58a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66a7bac21e44b72a59bb74c917daae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:16.739438 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-60597865-555c-4394-8235-db322a048f25 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] 10.222.0.69 "GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004" status: 200 len: 1471 microversion: 2.1 time: 0.160411 Jul 20 19:26:16.740108 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 202/414] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:16 2022] GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004 => generated 1471 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:16.981702 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-1554a6e8-25aa-48a1-8b3a-6299c6695cd5 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:16.981702 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-1554a6e8-25aa-48a1-8b3a-6299c6695cd5 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: 230833df-72df-406e-8051-75b5032d5018] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:16.987896 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1554a6e8-25aa-48a1-8b3a-6299c6695cd5 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:16.988338 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1554a6e8-25aa-48a1-8b3a-6299c6695cd5 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:16.989185 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1554a6e8-25aa-48a1-8b3a-6299c6695cd5 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:16.989783 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1554a6e8-25aa-48a1-8b3a-6299c6695cd5 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:17.138036 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-1554a6e8-25aa-48a1-8b3a-6299c6695cd5 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:17.147750 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-1554a6e8-25aa-48a1-8b3a-6299c6695cd5 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018" status: 200 len: 1312 microversion: 2.1 time: 0.170034 Jul 20 19:26:17.148339 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 213/415] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:16 2022] GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018 => generated 1312 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:17.386838 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-343dbb71-1c21-48c0-b74c-0ad8b14bb632 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:17.387446 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-343dbb71-1c21-48c0-b74c-0ad8b14bb632 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 053acc99-052e-4247-a54a-2799958f10e6] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:17.393381 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-343dbb71-1c21-48c0-b74c-0ad8b14bb632 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:17.393869 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-343dbb71-1c21-48c0-b74c-0ad8b14bb632 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:17.394640 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-343dbb71-1c21-48c0-b74c-0ad8b14bb632 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:17.395073 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-343dbb71-1c21-48c0-b74c-0ad8b14bb632 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:17.597631 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-343dbb71-1c21-48c0-b74c-0ad8b14bb632 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:17.605429 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-343dbb71-1c21-48c0-b74c-0ad8b14bb632 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6" status: 200 len: 1522 microversion: 2.1 time: 0.223261 Jul 20 19:26:17.606668 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 203/416] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:17 2022] GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6 => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:17.761119 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-3186c4ae-013d-4641-8528-d3a30a742c58 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:17.762098 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-3186c4ae-013d-4641-8528-d3a30a742c58 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] [instance: 062837f7-369c-477b-893d-36d1a9696004] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:17.770574 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3186c4ae-013d-4641-8528-d3a30a742c58 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:17.771030 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3186c4ae-013d-4641-8528-d3a30a742c58 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:17.771858 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3186c4ae-013d-4641-8528-d3a30a742c58 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:17.772421 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3186c4ae-013d-4641-8528-d3a30a742c58 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:17.807733 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [req-bdccdb3a-b803-4281-b2e3-f14c97e70822 req-d794c4ba-ea64-4db1-a880-b24d4a7d78f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "062837f7-369c-477b-893d-36d1a9696004", "name": "network-vif-deleted", "tag": "80acceeb-fba4-45d0-b45a-c31c4c4199e5"}]} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:26:17.816579 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-bdccdb3a-b803-4281-b2e3-f14c97e70822 req-d794c4ba-ea64-4db1-a880-b24d4a7d78f2 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:17.817241 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-bdccdb3a-b803-4281-b2e3-f14c97e70822 req-d794c4ba-ea64-4db1-a880-b24d4a7d78f2 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:17.829585 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.compute.server_external_events [req-bdccdb3a-b803-4281-b2e3-f14c97e70822 req-d794c4ba-ea64-4db1-a880-b24d4a7d78f2 service nova] Creating event network-vif-deleted:80acceeb-fba4-45d0-b45a-c31c4c4199e5 for instance 062837f7-369c-477b-893d-36d1a9696004 on hv-cinder-83538 Jul 20 19:26:17.834849 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [req-bdccdb3a-b803-4281-b2e3-f14c97e70822 req-d794c4ba-ea64-4db1-a880-b24d4a7d78f2 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031817 Jul 20 19:26:17.837994 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 204/417] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 19:26:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:26:17.859245 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-3186c4ae-013d-4641-8528-d3a30a742c58 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67416d4eea6946fdb77a09242e58a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66a7bac21e44b72a59bb74c917daae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:17.868227 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-3186c4ae-013d-4641-8528-d3a30a742c58 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] 10.222.0.69 "GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004" status: 200 len: 1429 microversion: 2.1 time: 0.110880 Jul 20 19:26:17.869152 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 214/418] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:17 2022] GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004 => generated 1429 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:18.164933 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ad87f393-3645-4f69-81f6-eb2c23896354 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:18.165696 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ad87f393-3645-4f69-81f6-eb2c23896354 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: 230833df-72df-406e-8051-75b5032d5018] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:18.172669 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ad87f393-3645-4f69-81f6-eb2c23896354 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:18.173129 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ad87f393-3645-4f69-81f6-eb2c23896354 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:18.173965 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ad87f393-3645-4f69-81f6-eb2c23896354 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:18.174403 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ad87f393-3645-4f69-81f6-eb2c23896354 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:18.306844 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ad87f393-3645-4f69-81f6-eb2c23896354 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:18.314933 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ad87f393-3645-4f69-81f6-eb2c23896354 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018" status: 200 len: 1495 microversion: 2.1 time: 0.154208 Jul 20 19:26:18.315503 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 205/419] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:18 2022] GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018 => generated 1495 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:18.623870 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-8e32877a-ad36-44c4-96f9-858ea2493a33 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:18.624385 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-8e32877a-ad36-44c4-96f9-858ea2493a33 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 053acc99-052e-4247-a54a-2799958f10e6] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:18.630451 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8e32877a-ad36-44c4-96f9-858ea2493a33 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:18.630902 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8e32877a-ad36-44c4-96f9-858ea2493a33 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:18.631666 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8e32877a-ad36-44c4-96f9-858ea2493a33 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:18.632103 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8e32877a-ad36-44c4-96f9-858ea2493a33 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:18.762178 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-8e32877a-ad36-44c4-96f9-858ea2493a33 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:18.769623 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-8e32877a-ad36-44c4-96f9-858ea2493a33 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6" status: 200 len: 1522 microversion: 2.1 time: 0.150278 Jul 20 19:26:18.770184 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 215/420] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:18 2022] GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:18.886525 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d5c99ed9-78c5-4620-a6bc-7a00b5ab5f8b tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:18.887080 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d5c99ed9-78c5-4620-a6bc-7a00b5ab5f8b tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] [instance: 062837f7-369c-477b-893d-36d1a9696004] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:18.893743 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d5c99ed9-78c5-4620-a6bc-7a00b5ab5f8b tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:18.894193 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d5c99ed9-78c5-4620-a6bc-7a00b5ab5f8b tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:18.894990 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d5c99ed9-78c5-4620-a6bc-7a00b5ab5f8b tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:18.895451 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d5c99ed9-78c5-4620-a6bc-7a00b5ab5f8b tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:18.926588 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d5c99ed9-78c5-4620-a6bc-7a00b5ab5f8b tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:18.927022 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d5c99ed9-78c5-4620-a6bc-7a00b5ab5f8b tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:18.927490 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.objects.instance [None req-d5c99ed9-78c5-4620-a6bc-7a00b5ab5f8b tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lazy-loading 'fault' on Instance uuid 062837f7-369c-477b-893d-36d1a9696004 {{(pid=117761) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:26:18.971638 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d5c99ed9-78c5-4620-a6bc-7a00b5ab5f8b tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67416d4eea6946fdb77a09242e58a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66a7bac21e44b72a59bb74c917daae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:18.979997 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d5c99ed9-78c5-4620-a6bc-7a00b5ab5f8b tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] 10.222.0.69 "GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004" status: 200 len: 1305 microversion: 2.1 time: 0.097460 Jul 20 19:26:18.980562 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 206/421] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:18 2022] GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004 => generated 1305 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:19.787259 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-751c6292-cbde-4db2-b07d-c026307a4ae3 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:19.787864 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-751c6292-cbde-4db2-b07d-c026307a4ae3 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 053acc99-052e-4247-a54a-2799958f10e6] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:19.794513 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-751c6292-cbde-4db2-b07d-c026307a4ae3 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:19.794961 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-751c6292-cbde-4db2-b07d-c026307a4ae3 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:19.795719 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-751c6292-cbde-4db2-b07d-c026307a4ae3 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:19.796151 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-751c6292-cbde-4db2-b07d-c026307a4ae3 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:19.811147 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_cell1:SELECT=100 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:19.927698 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-751c6292-cbde-4db2-b07d-c026307a4ae3 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:19.935579 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-751c6292-cbde-4db2-b07d-c026307a4ae3 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6" status: 200 len: 1522 microversion: 2.1 time: 0.152168 Jul 20 19:26:19.936262 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 216/422] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:19 2022] GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:19.996017 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-213cda11-5fc8-4849-a8ca-64b6bfa44976 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:19.996613 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-213cda11-5fc8-4849-a8ca-64b6bfa44976 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] [instance: 062837f7-369c-477b-893d-36d1a9696004] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:20.003052 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-213cda11-5fc8-4849-a8ca-64b6bfa44976 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:20.003492 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-213cda11-5fc8-4849-a8ca-64b6bfa44976 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:20.004241 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-213cda11-5fc8-4849-a8ca-64b6bfa44976 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:20.004665 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-213cda11-5fc8-4849-a8ca-64b6bfa44976 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:20.034833 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-213cda11-5fc8-4849-a8ca-64b6bfa44976 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:20.035269 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-213cda11-5fc8-4849-a8ca-64b6bfa44976 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:20.035712 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.objects.instance [None req-213cda11-5fc8-4849-a8ca-64b6bfa44976 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lazy-loading 'fault' on Instance uuid 062837f7-369c-477b-893d-36d1a9696004 {{(pid=117761) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:26:20.076910 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-213cda11-5fc8-4849-a8ca-64b6bfa44976 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67416d4eea6946fdb77a09242e58a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66a7bac21e44b72a59bb74c917daae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:20.084335 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-213cda11-5fc8-4849-a8ca-64b6bfa44976 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] 10.222.0.69 "GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004" status: 200 len: 1305 microversion: 2.1 time: 0.092127 Jul 20 19:26:20.084892 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 207/423] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:19 2022] GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004 => generated 1305 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:20.953189 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-b807c111-72af-48b6-b91c-1f4ebb2ec6ce tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:20.953808 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-b807c111-72af-48b6-b91c-1f4ebb2ec6ce tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 053acc99-052e-4247-a54a-2799958f10e6] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:20.959886 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b807c111-72af-48b6-b91c-1f4ebb2ec6ce tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:20.960327 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b807c111-72af-48b6-b91c-1f4ebb2ec6ce tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:20.961064 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b807c111-72af-48b6-b91c-1f4ebb2ec6ce tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:20.961488 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b807c111-72af-48b6-b91c-1f4ebb2ec6ce tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:21.099567 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-b807c111-72af-48b6-b91c-1f4ebb2ec6ce tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:21.101945 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-1d9eccbd-9023-4fc9-8a0e-a8482d88c451 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:21.102564 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-1d9eccbd-9023-4fc9-8a0e-a8482d88c451 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] [instance: 062837f7-369c-477b-893d-36d1a9696004] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:21.107208 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-b807c111-72af-48b6-b91c-1f4ebb2ec6ce tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6" status: 200 len: 1522 microversion: 2.1 time: 0.157757 Jul 20 19:26:21.107770 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 217/424] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:20 2022] GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:21.108906 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1d9eccbd-9023-4fc9-8a0e-a8482d88c451 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:21.109360 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1d9eccbd-9023-4fc9-8a0e-a8482d88c451 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:21.110172 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1d9eccbd-9023-4fc9-8a0e-a8482d88c451 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:21.110607 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1d9eccbd-9023-4fc9-8a0e-a8482d88c451 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:21.142484 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1d9eccbd-9023-4fc9-8a0e-a8482d88c451 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:21.142931 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1d9eccbd-9023-4fc9-8a0e-a8482d88c451 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:21.143377 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.objects.instance [None req-1d9eccbd-9023-4fc9-8a0e-a8482d88c451 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lazy-loading 'fault' on Instance uuid 062837f7-369c-477b-893d-36d1a9696004 {{(pid=117761) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:26:21.183436 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1d9eccbd-9023-4fc9-8a0e-a8482d88c451 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67416d4eea6946fdb77a09242e58a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66a7bac21e44b72a59bb74c917daae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:21.185732 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:21.192416 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-1d9eccbd-9023-4fc9-8a0e-a8482d88c451 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] 10.222.0.69 "GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004" status: 200 len: 1305 microversion: 2.1 time: 0.094270 Jul 20 19:26:21.192986 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 208/425] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:21 2022] GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004 => generated 1305 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:26:22.124776 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-3ec6270e-50da-40d5-8838-3c030d0c03e2 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:22.125403 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-3ec6270e-50da-40d5-8838-3c030d0c03e2 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 053acc99-052e-4247-a54a-2799958f10e6] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:22.131389 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3ec6270e-50da-40d5-8838-3c030d0c03e2 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:22.131838 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3ec6270e-50da-40d5-8838-3c030d0c03e2 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:22.132596 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3ec6270e-50da-40d5-8838-3c030d0c03e2 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:22.133034 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3ec6270e-50da-40d5-8838-3c030d0c03e2 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:22.210514 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-03599b59-7955-4a19-8135-64eeb7696cbf tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:22.211230 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-03599b59-7955-4a19-8135-64eeb7696cbf tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] [instance: 062837f7-369c-477b-893d-36d1a9696004] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:22.219263 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-03599b59-7955-4a19-8135-64eeb7696cbf tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:22.219705 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-03599b59-7955-4a19-8135-64eeb7696cbf tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:22.220723 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-03599b59-7955-4a19-8135-64eeb7696cbf tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:22.221153 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-03599b59-7955-4a19-8135-64eeb7696cbf tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:22.256262 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-03599b59-7955-4a19-8135-64eeb7696cbf tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:22.256696 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-03599b59-7955-4a19-8135-64eeb7696cbf tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:22.257143 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.objects.instance [None req-03599b59-7955-4a19-8135-64eeb7696cbf tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lazy-loading 'fault' on Instance uuid 062837f7-369c-477b-893d-36d1a9696004 {{(pid=117761) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:26:22.298463 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-03599b59-7955-4a19-8135-64eeb7696cbf tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67416d4eea6946fdb77a09242e58a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66a7bac21e44b72a59bb74c917daae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:22.305832 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-03599b59-7955-4a19-8135-64eeb7696cbf tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] 10.222.0.69 "GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004" status: 200 len: 1305 microversion: 2.1 time: 0.099618 Jul 20 19:26:22.306391 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 209/426] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:22 2022] GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004 => generated 1305 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:26:22.402869 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-3ec6270e-50da-40d5-8838-3c030d0c03e2 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:22.410553 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-3ec6270e-50da-40d5-8838-3c030d0c03e2 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6" status: 200 len: 1522 microversion: 2.1 time: 0.289671 Jul 20 19:26:22.411340 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 218/427] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:22 2022] GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6 => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:22.551681 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-03d2e336-202d-46a0-96ab-45f62d6e5245 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:22.552193 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-03d2e336-202d-46a0-96ab-45f62d6e5245 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: 230833df-72df-406e-8051-75b5032d5018] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:22.558681 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-03d2e336-202d-46a0-96ab-45f62d6e5245 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:22.559129 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-03d2e336-202d-46a0-96ab-45f62d6e5245 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:22.559894 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-03d2e336-202d-46a0-96ab-45f62d6e5245 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:22.560330 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-03d2e336-202d-46a0-96ab-45f62d6e5245 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:22.586839 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-03d2e336-202d-46a0-96ab-45f62d6e5245 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: 230833df-72df-406e-8051-75b5032d5018] Going to try to terminate instance {{(pid=117761) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 19:26:22.662454 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-03d2e336-202d-46a0-96ab-45f62d6e5245 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "DELETE /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018" status: 204 len: 0 microversion: 2.1 time: 0.114703 Jul 20 19:26:22.663035 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 210/428] 10.222.0.69 () {58 vars in 1238 bytes} [Wed Jul 20 19:26:22 2022] DELETE /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 19:26:22.672687 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-8f86b95c-1308-4752-9041-53abb796394f tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:22.673280 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-8f86b95c-1308-4752-9041-53abb796394f tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: 230833df-72df-406e-8051-75b5032d5018] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:22.679699 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8f86b95c-1308-4752-9041-53abb796394f tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:22.680138 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8f86b95c-1308-4752-9041-53abb796394f tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:22.680913 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8f86b95c-1308-4752-9041-53abb796394f tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:22.681336 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8f86b95c-1308-4752-9041-53abb796394f tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:22.812421 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-8f86b95c-1308-4752-9041-53abb796394f tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:22.820439 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-8f86b95c-1308-4752-9041-53abb796394f tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018" status: 200 len: 1501 microversion: 2.1 time: 0.151516 Jul 20 19:26:22.820993 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 219/429] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:22 2022] GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018 => generated 1501 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:23.324896 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-b84c3ad4-41cc-49e2-bb12-71faa493a5ca tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:23.325524 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-b84c3ad4-41cc-49e2-bb12-71faa493a5ca tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] [instance: 062837f7-369c-477b-893d-36d1a9696004] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:23.332020 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b84c3ad4-41cc-49e2-bb12-71faa493a5ca tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:23.332472 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b84c3ad4-41cc-49e2-bb12-71faa493a5ca tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:23.333238 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b84c3ad4-41cc-49e2-bb12-71faa493a5ca tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:23.333705 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b84c3ad4-41cc-49e2-bb12-71faa493a5ca tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:23.365172 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b84c3ad4-41cc-49e2-bb12-71faa493a5ca tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:23.365626 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b84c3ad4-41cc-49e2-bb12-71faa493a5ca tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:23.366068 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.objects.instance [None req-b84c3ad4-41cc-49e2-bb12-71faa493a5ca tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lazy-loading 'fault' on Instance uuid 062837f7-369c-477b-893d-36d1a9696004 {{(pid=117761) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:26:23.410761 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-b84c3ad4-41cc-49e2-bb12-71faa493a5ca tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67416d4eea6946fdb77a09242e58a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66a7bac21e44b72a59bb74c917daae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:23.418274 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-b84c3ad4-41cc-49e2-bb12-71faa493a5ca tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] 10.222.0.69 "GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004" status: 200 len: 1305 microversion: 2.1 time: 0.098648 Jul 20 19:26:23.418834 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 211/430] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:23 2022] GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004 => generated 1305 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:23.427851 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-4e58abd6-51bf-4f30-a5ab-6478bb2536c0 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:23.428487 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-4e58abd6-51bf-4f30-a5ab-6478bb2536c0 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 053acc99-052e-4247-a54a-2799958f10e6] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:23.435582 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4e58abd6-51bf-4f30-a5ab-6478bb2536c0 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:23.436031 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4e58abd6-51bf-4f30-a5ab-6478bb2536c0 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:23.436790 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4e58abd6-51bf-4f30-a5ab-6478bb2536c0 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:23.437334 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4e58abd6-51bf-4f30-a5ab-6478bb2536c0 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:23.571686 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-4e58abd6-51bf-4f30-a5ab-6478bb2536c0 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:23.579620 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-4e58abd6-51bf-4f30-a5ab-6478bb2536c0 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6" status: 200 len: 1522 microversion: 2.1 time: 0.155387 Jul 20 19:26:23.580326 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 220/431] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:23 2022] GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:23.838521 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-1b37c63e-36c6-4ed4-bd04-f66c5dd1ea48 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:23.839342 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-1b37c63e-36c6-4ed4-bd04-f66c5dd1ea48 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: 230833df-72df-406e-8051-75b5032d5018] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:23.846030 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1b37c63e-36c6-4ed4-bd04-f66c5dd1ea48 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:23.846681 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1b37c63e-36c6-4ed4-bd04-f66c5dd1ea48 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:23.847443 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1b37c63e-36c6-4ed4-bd04-f66c5dd1ea48 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:23.847872 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1b37c63e-36c6-4ed4-bd04-f66c5dd1ea48 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:23.982186 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1b37c63e-36c6-4ed4-bd04-f66c5dd1ea48 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:23.989602 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-1b37c63e-36c6-4ed4-bd04-f66c5dd1ea48 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018" status: 200 len: 1501 microversion: 2.1 time: 0.155360 Jul 20 19:26:23.990160 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 212/432] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:23 2022] GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018 => generated 1501 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:24.436080 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-4d8b2d05-352b-4ee9-9637-576497d7fef1 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:24.436689 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-4d8b2d05-352b-4ee9-9637-576497d7fef1 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] [instance: 062837f7-369c-477b-893d-36d1a9696004] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:24.442785 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4d8b2d05-352b-4ee9-9637-576497d7fef1 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:24.443232 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4d8b2d05-352b-4ee9-9637-576497d7fef1 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:24.444016 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4d8b2d05-352b-4ee9-9637-576497d7fef1 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:24.444450 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4d8b2d05-352b-4ee9-9637-576497d7fef1 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:24.475742 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4d8b2d05-352b-4ee9-9637-576497d7fef1 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:24.476142 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4d8b2d05-352b-4ee9-9637-576497d7fef1 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:24.476595 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.objects.instance [None req-4d8b2d05-352b-4ee9-9637-576497d7fef1 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lazy-loading 'fault' on Instance uuid 062837f7-369c-477b-893d-36d1a9696004 {{(pid=117762) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:26:24.524627 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-4d8b2d05-352b-4ee9-9637-576497d7fef1 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67416d4eea6946fdb77a09242e58a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66a7bac21e44b72a59bb74c917daae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:24.532876 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-4d8b2d05-352b-4ee9-9637-576497d7fef1 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] 10.222.0.69 "GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004" status: 200 len: 1305 microversion: 2.1 time: 0.101069 Jul 20 19:26:24.533440 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 221/433] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:24 2022] GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004 => generated 1305 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:24.598124 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-0a7c187a-2b53-43e0-b81b-a16f3226b012 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:24.598671 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-0a7c187a-2b53-43e0-b81b-a16f3226b012 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 053acc99-052e-4247-a54a-2799958f10e6] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:24.606054 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0a7c187a-2b53-43e0-b81b-a16f3226b012 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:24.606493 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0a7c187a-2b53-43e0-b81b-a16f3226b012 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:24.607254 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0a7c187a-2b53-43e0-b81b-a16f3226b012 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:24.607680 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0a7c187a-2b53-43e0-b81b-a16f3226b012 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:24.749881 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0a7c187a-2b53-43e0-b81b-a16f3226b012 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:24.757591 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-0a7c187a-2b53-43e0-b81b-a16f3226b012 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6" status: 200 len: 1522 microversion: 2.1 time: 0.163836 Jul 20 19:26:24.758081 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 213/434] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:24 2022] GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:25.006978 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-d8b3c4ac-95d6-489a-af5e-64d3cc72822b tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:25.007806 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-d8b3c4ac-95d6-489a-af5e-64d3cc72822b tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: 230833df-72df-406e-8051-75b5032d5018] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:25.016217 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d8b3c4ac-95d6-489a-af5e-64d3cc72822b tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:25.016666 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d8b3c4ac-95d6-489a-af5e-64d3cc72822b tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:25.017473 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d8b3c4ac-95d6-489a-af5e-64d3cc72822b tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:25.017940 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d8b3c4ac-95d6-489a-af5e-64d3cc72822b tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:25.200600 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-d8b3c4ac-95d6-489a-af5e-64d3cc72822b tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:25.208188 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-d8b3c4ac-95d6-489a-af5e-64d3cc72822b tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018" status: 200 len: 1501 microversion: 2.1 time: 0.205016 Jul 20 19:26:25.208848 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 222/435] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:25 2022] GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018 => generated 1501 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:25.549588 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c50ea7a2-c56b-432e-978a-bfe228e600f7 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:25.550076 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c50ea7a2-c56b-432e-978a-bfe228e600f7 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] [instance: 062837f7-369c-477b-893d-36d1a9696004] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:25.556784 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c50ea7a2-c56b-432e-978a-bfe228e600f7 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:25.558045 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c50ea7a2-c56b-432e-978a-bfe228e600f7 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:25.559098 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c50ea7a2-c56b-432e-978a-bfe228e600f7 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:25.559786 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c50ea7a2-c56b-432e-978a-bfe228e600f7 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:25.575560 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.wsgi [None req-c50ea7a2-c56b-432e-978a-bfe228e600f7 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] HTTP exception thrown: Instance 062837f7-369c-477b-893d-36d1a9696004 could not be found. Jul 20 19:26:25.578238 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c50ea7a2-c56b-432e-978a-bfe228e600f7 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Request method failure captured: Jul 20 19:26:25.578238 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004 HTTP/1.1 Jul 20 19:26:25.578238 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 19:26:25.578238 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 19:26:25.578238 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 19:26:25.578238 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 0 Jul 20 19:26:25.578238 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 19:26:25.578238 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 19:26:25.578238 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 19:26:25.578238 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 19:26:25.578238 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2FacryM0UmyGAKaGbYWsQ22191CjxY3wn2yEX2ikE-6RLKsQkTlmJrG52On9Sr967BRabY7CAJmpz0QPBrZwTC2vXXisTI6yVPoyvBvKnpgGvBu6dZ5Ok2LgpkyOguwWZFRH9ksl5xIwtJwHepMoXC4qNkBolKyBEcdlu4CVqHT92vg Jul 20 19:26:25.578238 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 19:26:25.578238 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 19:26:25.578238 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 19:26:25.578238 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 19:26:25.578238 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 19:26:25.578238 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 19:26:25.578238 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: d66a7bac21e44b72a59bb74c917daae1 Jul 20 19:26:25.578238 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-VolumesNegativeTest-989797685 Jul 20 19:26:25.578238 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 19:26:25.578238 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 19:26:25.579532 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d66a7bac21e44b72a59bb74c917daae1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d66a7bac21e44b72a59bb74c917daae1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_d66a7bac21e44b72a59bb74c917daae1", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/d66a7bac21e44b72a59bb74c917daae1"}]}] Jul 20 19:26:25.579532 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-VolumesNegativeTest-989797685 Jul 20 19:26:25.579532 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: d66a7bac21e44b72a59bb74c917daae1 Jul 20 19:26:25.579532 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-VolumesNegativeTest-989797685 Jul 20 19:26:25.579532 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-VolumesNegativeTest-989797685-project Jul 20 19:26:25.579532 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 19:26:25.579532 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 19:26:25.579532 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: 67416d4eea6946fdb77a09242e58a12f Jul 20 19:26:25.579532 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-VolumesNegativeTest-989797685-project Jul 20 19:26:25.579532 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: > Jul 20 19:26:25.579532 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Instance 062837f7-369c-477b-893d-36d1a9696004 could not be found. Jul 20 19:26:25.579532 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'id': '062837f7-369c-477b-893d-36d1a9696004'} Jul 20 19:26:25.580324 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:26:25.580324 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:26:25.580324 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:26:25.580324 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:26:25.580324 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:26:25.580324 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:26:25.580324 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:26:25.580324 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:26:25.580324 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:26:25.580324 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:26:25.580324 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 062837f7-369c-477b-893d-36d1a9696004 could not be found. Jul 20 19:26:25.580324 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:26:25.580324 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:26:25.580324 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:26:25.580324 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:26:25.580324 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:26:25.580324 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:26:25.580324 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:26:25.580324 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:26:25.580324 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:26:25.581559 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:26:25.581559 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:26:25.581559 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:26:25.581559 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:26:25.581559 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:26:25.581559 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:26:25.581559 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:26:25.581559 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 062837f7-369c-477b-893d-36d1a9696004 could not be found. Jul 20 19:26:25.581559 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:26:25.581559 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:26:25.581559 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:26:25.581559 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:26:25.581559 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:26:25.581559 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:26:25.581559 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:26:25.581559 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:26:25.581559 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 062837f7-369c-477b-893d-36d1a9696004 could not be found. Jul 20 19:26:25.581559 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:26:25.583769 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c50ea7a2-c56b-432e-978a-bfe228e600f7 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] Returning 404 to user: Instance 062837f7-369c-477b-893d-36d1a9696004 could not be found. {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:26:25.584782 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c50ea7a2-c56b-432e-978a-bfe228e600f7 tempest-VolumesNegativeTest-989797685 tempest-VolumesNegativeTest-989797685-project] 10.222.0.69 "GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004" status: 404 len: 111 microversion: 2.1 time: 0.039159 Jul 20 19:26:25.585972 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 214/436] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:25 2022] GET /compute/v2.1/servers/062837f7-369c-477b-893d-36d1a9696004 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:26:25.778267 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-d8d2c35d-73b0-4883-ac9f-a7bbf61530cd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:25.779017 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-d8d2c35d-73b0-4883-ac9f-a7bbf61530cd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 053acc99-052e-4247-a54a-2799958f10e6] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:25.800781 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d8d2c35d-73b0-4883-ac9f-a7bbf61530cd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:25.810267 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d8d2c35d-73b0-4883-ac9f-a7bbf61530cd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:25.812359 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d8d2c35d-73b0-4883-ac9f-a7bbf61530cd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:25.812999 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d8d2c35d-73b0-4883-ac9f-a7bbf61530cd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:25.850625 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [req-4ca3d5ab-129e-4c08-abeb-ddedebe1727c req-60a20ba1-058b-4e70-8ed6-e874e71f0605 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "230833df-72df-406e-8051-75b5032d5018", "name": "network-vif-deleted", "tag": "bccc3941-efa0-4408-891d-c46c8a60260a"}]} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:26:25.880306 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-4ca3d5ab-129e-4c08-abeb-ddedebe1727c req-60a20ba1-058b-4e70-8ed6-e874e71f0605 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:25.881498 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-4ca3d5ab-129e-4c08-abeb-ddedebe1727c req-60a20ba1-058b-4e70-8ed6-e874e71f0605 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:25.893974 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.compute.server_external_events [req-4ca3d5ab-129e-4c08-abeb-ddedebe1727c req-60a20ba1-058b-4e70-8ed6-e874e71f0605 service nova] Creating event network-vif-deleted:bccc3941-efa0-4408-891d-c46c8a60260a for instance 230833df-72df-406e-8051-75b5032d5018 on hv-cinder-83538 Jul 20 19:26:25.914998 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [req-4ca3d5ab-129e-4c08-abeb-ddedebe1727c req-60a20ba1-058b-4e70-8ed6-e874e71f0605 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064185 Jul 20 19:26:25.915908 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 215/437] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 19:26:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:26:26.000934 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-d8d2c35d-73b0-4883-ac9f-a7bbf61530cd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:26.008485 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-d8d2c35d-73b0-4883-ac9f-a7bbf61530cd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6" status: 200 len: 1522 microversion: 2.1 time: 0.235667 Jul 20 19:26:26.010963 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 223/438] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:25 2022] GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6 => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:26.229491 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-964e9a6e-f762-437e-8f6c-6bdb821b0fd1 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:26.230597 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-964e9a6e-f762-437e-8f6c-6bdb821b0fd1 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: 230833df-72df-406e-8051-75b5032d5018] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:26.237359 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-964e9a6e-f762-437e-8f6c-6bdb821b0fd1 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:26.237850 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-964e9a6e-f762-437e-8f6c-6bdb821b0fd1 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:26.238619 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-964e9a6e-f762-437e-8f6c-6bdb821b0fd1 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:26.239227 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-964e9a6e-f762-437e-8f6c-6bdb821b0fd1 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:26.286276 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-964e9a6e-f762-437e-8f6c-6bdb821b0fd1 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:26.287402 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-964e9a6e-f762-437e-8f6c-6bdb821b0fd1 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:26.287873 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.objects.instance [None req-964e9a6e-f762-437e-8f6c-6bdb821b0fd1 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lazy-loading 'fault' on Instance uuid 230833df-72df-406e-8051-75b5032d5018 {{(pid=117761) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:26:26.342951 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-964e9a6e-f762-437e-8f6c-6bdb821b0fd1 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79c7408524e979cf0e9a595fe731a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cf9bd2ea44ebe8edd25559baafc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:26.356092 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-964e9a6e-f762-437e-8f6c-6bdb821b0fd1 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018" status: 200 len: 1302 microversion: 2.1 time: 0.132600 Jul 20 19:26:26.367136 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 216/439] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:26 2022] GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018 => generated 1302 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:27.026753 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-c8a35d5c-0432-478b-892e-d204bc4d953d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:27.027472 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-c8a35d5c-0432-478b-892e-d204bc4d953d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 053acc99-052e-4247-a54a-2799958f10e6] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:27.035499 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c8a35d5c-0432-478b-892e-d204bc4d953d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:27.036608 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c8a35d5c-0432-478b-892e-d204bc4d953d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:27.036996 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c8a35d5c-0432-478b-892e-d204bc4d953d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:27.038244 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c8a35d5c-0432-478b-892e-d204bc4d953d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:27.197553 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-c8a35d5c-0432-478b-892e-d204bc4d953d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:27.205656 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-c8a35d5c-0432-478b-892e-d204bc4d953d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6" status: 200 len: 1522 microversion: 2.1 time: 0.183586 Jul 20 19:26:27.206236 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 224/440] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:27 2022] GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:27.374489 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-147313b7-2496-4df4-999c-a82d9eefa680 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:27.375078 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-147313b7-2496-4df4-999c-a82d9eefa680 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] [instance: 230833df-72df-406e-8051-75b5032d5018] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:27.381390 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-147313b7-2496-4df4-999c-a82d9eefa680 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:27.381938 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-147313b7-2496-4df4-999c-a82d9eefa680 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:27.382705 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-147313b7-2496-4df4-999c-a82d9eefa680 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:27.383136 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-147313b7-2496-4df4-999c-a82d9eefa680 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:27.396358 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.wsgi [None req-147313b7-2496-4df4-999c-a82d9eefa680 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] HTTP exception thrown: Instance 230833df-72df-406e-8051-75b5032d5018 could not be found. Jul 20 19:26:27.397996 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-147313b7-2496-4df4-999c-a82d9eefa680 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Request method failure captured: Jul 20 19:26:27.397996 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018 HTTP/1.1 Jul 20 19:26:27.397996 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 19:26:27.397996 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 19:26:27.397996 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 19:26:27.397996 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 0 Jul 20 19:26:27.397996 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 19:26:27.397996 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 19:26:27.397996 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 19:26:27.397996 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 19:26:27.397996 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2FZsn7685DM9SLvtQV_LDBZDykfdEYx6SNSStXL5oaRkCrrKqGHsgQWEyXvKrCQMLaoSl3PTSvWE3zx8PB7Lpjs6Kjh0TRXL_K-G7m-RCQ8GUQpsMQ-rbAbgF2bGpFmqtgIC5uqbam_lnhV7mop476Sk3e_ThGJUHsElxBP8yFq_osY Jul 20 19:26:27.397996 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 19:26:27.397996 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 19:26:27.397996 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 19:26:27.397996 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 19:26:27.397996 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 19:26:27.397996 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 19:26:27.397996 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: a51cf9bd2ea44ebe8edd25559baafc4e Jul 20 19:26:27.397996 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-VolumesActionsTest-2131679193 Jul 20 19:26:27.397996 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 19:26:27.397996 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 19:26:27.399505 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a51cf9bd2ea44ebe8edd25559baafc4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a51cf9bd2ea44ebe8edd25559baafc4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_a51cf9bd2ea44ebe8edd25559baafc4e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/a51cf9bd2ea44ebe8edd25559baafc4e"}]}] Jul 20 19:26:27.399505 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-VolumesActionsTest-2131679193 Jul 20 19:26:27.399505 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: a51cf9bd2ea44ebe8edd25559baafc4e Jul 20 19:26:27.399505 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-VolumesActionsTest-2131679193 Jul 20 19:26:27.399505 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-VolumesActionsTest-2131679193-project Jul 20 19:26:27.399505 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 19:26:27.399505 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 19:26:27.399505 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: afa79c7408524e979cf0e9a595fe731a Jul 20 19:26:27.399505 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-VolumesActionsTest-2131679193-project Jul 20 19:26:27.399505 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: > Jul 20 19:26:27.399505 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Instance 230833df-72df-406e-8051-75b5032d5018 could not be found. Jul 20 19:26:27.399505 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'id': '230833df-72df-406e-8051-75b5032d5018'} Jul 20 19:26:27.400473 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:26:27.400473 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:26:27.400473 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:26:27.400473 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:26:27.400473 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:26:27.400473 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:26:27.400473 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:26:27.400473 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:26:27.400473 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:26:27.400473 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:26:27.400473 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 230833df-72df-406e-8051-75b5032d5018 could not be found. Jul 20 19:26:27.400473 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:26:27.400473 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:26:27.400473 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:26:27.400473 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:26:27.400473 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:26:27.400473 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:26:27.400473 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:26:27.400473 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:26:27.400473 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:26:27.401762 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:26:27.401762 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:26:27.401762 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:26:27.401762 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:26:27.401762 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:26:27.401762 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:26:27.401762 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:26:27.401762 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 230833df-72df-406e-8051-75b5032d5018 could not be found. Jul 20 19:26:27.401762 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:26:27.401762 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:26:27.401762 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:26:27.401762 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:26:27.401762 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:26:27.401762 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:26:27.401762 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:26:27.401762 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:26:27.401762 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 230833df-72df-406e-8051-75b5032d5018 could not be found. Jul 20 19:26:27.401762 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:26:27.403022 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-147313b7-2496-4df4-999c-a82d9eefa680 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] Returning 404 to user: Instance 230833df-72df-406e-8051-75b5032d5018 could not be found. {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:26:27.403022 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-147313b7-2496-4df4-999c-a82d9eefa680 tempest-VolumesActionsTest-2131679193 tempest-VolumesActionsTest-2131679193-project] 10.222.0.69 "GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018" status: 404 len: 111 microversion: 2.1 time: 0.028672 Jul 20 19:26:27.403022 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 217/441] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:27 2022] GET /compute/v2.1/servers/230833df-72df-406e-8051-75b5032d5018 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:26:28.223185 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-c7e2f39a-02b1-4946-9ea6-8a073fc48d17 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:28.224672 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-c7e2f39a-02b1-4946-9ea6-8a073fc48d17 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 053acc99-052e-4247-a54a-2799958f10e6] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:28.232599 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c7e2f39a-02b1-4946-9ea6-8a073fc48d17 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:28.233065 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c7e2f39a-02b1-4946-9ea6-8a073fc48d17 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:28.233857 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c7e2f39a-02b1-4946-9ea6-8a073fc48d17 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:28.234297 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c7e2f39a-02b1-4946-9ea6-8a073fc48d17 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:28.380226 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-c7e2f39a-02b1-4946-9ea6-8a073fc48d17 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:28.388154 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-c7e2f39a-02b1-4946-9ea6-8a073fc48d17 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6" status: 200 len: 1522 microversion: 2.1 time: 0.168735 Jul 20 19:26:28.388706 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 225/442] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:28 2022] GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:29.404496 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-daadf71d-4dc5-45a2-b46a-fb2712512f47 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:29.405104 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-daadf71d-4dc5-45a2-b46a-fb2712512f47 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 053acc99-052e-4247-a54a-2799958f10e6] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:29.416967 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-daadf71d-4dc5-45a2-b46a-fb2712512f47 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:29.416967 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-daadf71d-4dc5-45a2-b46a-fb2712512f47 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:29.416967 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-daadf71d-4dc5-45a2-b46a-fb2712512f47 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:29.416967 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-daadf71d-4dc5-45a2-b46a-fb2712512f47 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:29.553228 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-daadf71d-4dc5-45a2-b46a-fb2712512f47 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:29.561013 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-daadf71d-4dc5-45a2-b46a-fb2712512f47 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6" status: 200 len: 1522 microversion: 2.1 time: 0.160589 Jul 20 19:26:29.561718 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 218/443] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:29 2022] GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:30.577375 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-5c39acb4-feb3-40b4-902d-749cb36e4217 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:30.577931 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-5c39acb4-feb3-40b4-902d-749cb36e4217 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 053acc99-052e-4247-a54a-2799958f10e6] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:30.584370 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-5c39acb4-feb3-40b4-902d-749cb36e4217 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:30.584818 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-5c39acb4-feb3-40b4-902d-749cb36e4217 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:30.585607 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-5c39acb4-feb3-40b4-902d-749cb36e4217 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:30.586044 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-5c39acb4-feb3-40b4-902d-749cb36e4217 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:30.716044 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-5c39acb4-feb3-40b4-902d-749cb36e4217 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:30.723510 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-5c39acb4-feb3-40b4-902d-749cb36e4217 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6" status: 200 len: 1522 microversion: 2.1 time: 0.150131 Jul 20 19:26:30.724065 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 226/444] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:30 2022] GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:31.740172 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e2530071-174f-48ba-97b5-a4c4031a0eff tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:31.740782 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e2530071-174f-48ba-97b5-a4c4031a0eff tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 053acc99-052e-4247-a54a-2799958f10e6] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:31.747366 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e2530071-174f-48ba-97b5-a4c4031a0eff tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:31.747816 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e2530071-174f-48ba-97b5-a4c4031a0eff tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:31.748576 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e2530071-174f-48ba-97b5-a4c4031a0eff tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:31.749013 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e2530071-174f-48ba-97b5-a4c4031a0eff tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:31.881272 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e2530071-174f-48ba-97b5-a4c4031a0eff tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:31.889361 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e2530071-174f-48ba-97b5-a4c4031a0eff tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6" status: 200 len: 1522 microversion: 2.1 time: 0.153097 Jul 20 19:26:31.889959 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 219/445] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:31 2022] GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:32.907218 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-7a1bc77a-50c8-4e40-987b-d7eca3a5bb1b tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:32.907910 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-7a1bc77a-50c8-4e40-987b-d7eca3a5bb1b tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 053acc99-052e-4247-a54a-2799958f10e6] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:32.913932 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-7a1bc77a-50c8-4e40-987b-d7eca3a5bb1b tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:32.914374 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-7a1bc77a-50c8-4e40-987b-d7eca3a5bb1b tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:32.915124 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-7a1bc77a-50c8-4e40-987b-d7eca3a5bb1b tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:32.915551 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-7a1bc77a-50c8-4e40-987b-d7eca3a5bb1b tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:33.043304 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-7a1bc77a-50c8-4e40-987b-d7eca3a5bb1b tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:33.051392 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-7a1bc77a-50c8-4e40-987b-d7eca3a5bb1b tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6" status: 200 len: 1522 microversion: 2.1 time: 0.148740 Jul 20 19:26:33.051949 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 227/446] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:32 2022] GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:26:34.068686 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-305cb8e2-4039-4533-95c3-862ee32fbbea tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:34.069282 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-305cb8e2-4039-4533-95c3-862ee32fbbea tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 053acc99-052e-4247-a54a-2799958f10e6] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:34.075637 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-305cb8e2-4039-4533-95c3-862ee32fbbea tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:34.076113 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-305cb8e2-4039-4533-95c3-862ee32fbbea tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:34.076871 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-305cb8e2-4039-4533-95c3-862ee32fbbea tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:34.077301 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-305cb8e2-4039-4533-95c3-862ee32fbbea tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:34.205095 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-305cb8e2-4039-4533-95c3-862ee32fbbea tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:34.212916 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-305cb8e2-4039-4533-95c3-862ee32fbbea tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6" status: 200 len: 1522 microversion: 2.1 time: 0.148051 Jul 20 19:26:34.213474 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 220/447] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:34 2022] GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:35.237151 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-78c8b95a-9a52-44a1-bd12-e1e8ca419ae0 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:35.237877 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-78c8b95a-9a52-44a1-bd12-e1e8ca419ae0 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 053acc99-052e-4247-a54a-2799958f10e6] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:35.248716 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-78c8b95a-9a52-44a1-bd12-e1e8ca419ae0 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:35.249424 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-78c8b95a-9a52-44a1-bd12-e1e8ca419ae0 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:35.250693 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-78c8b95a-9a52-44a1-bd12-e1e8ca419ae0 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:35.251226 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-78c8b95a-9a52-44a1-bd12-e1e8ca419ae0 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:35.436398 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-78c8b95a-9a52-44a1-bd12-e1e8ca419ae0 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:35.445465 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-78c8b95a-9a52-44a1-bd12-e1e8ca419ae0 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6" status: 200 len: 1522 microversion: 2.1 time: 0.218165 Jul 20 19:26:35.446734 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 228/448] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:35 2022] GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:36.475079 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-54a7857b-68a1-4475-ba5f-31961890c7ee tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:36.480111 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-54a7857b-68a1-4475-ba5f-31961890c7ee tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 053acc99-052e-4247-a54a-2799958f10e6] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:36.500847 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-54a7857b-68a1-4475-ba5f-31961890c7ee tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:36.507101 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-54a7857b-68a1-4475-ba5f-31961890c7ee tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:36.508710 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-54a7857b-68a1-4475-ba5f-31961890c7ee tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:36.509227 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-54a7857b-68a1-4475-ba5f-31961890c7ee tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:36.734905 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-54a7857b-68a1-4475-ba5f-31961890c7ee tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:36.745682 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-54a7857b-68a1-4475-ba5f-31961890c7ee tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6" status: 200 len: 1522 microversion: 2.1 time: 0.282056 Jul 20 19:26:36.758427 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 221/449] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:36 2022] GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6 => generated 1522 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:37.766840 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-acdade24-072e-47b7-a8c7-febb017deb26 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:37.768634 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-acdade24-072e-47b7-a8c7-febb017deb26 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 053acc99-052e-4247-a54a-2799958f10e6] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:37.779335 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-acdade24-072e-47b7-a8c7-febb017deb26 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:37.779777 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-acdade24-072e-47b7-a8c7-febb017deb26 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:37.780687 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-acdade24-072e-47b7-a8c7-febb017deb26 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:37.781123 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-acdade24-072e-47b7-a8c7-febb017deb26 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:37.923010 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-acdade24-072e-47b7-a8c7-febb017deb26 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:37.931068 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-acdade24-072e-47b7-a8c7-febb017deb26 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6" status: 200 len: 1522 microversion: 2.1 time: 0.169905 Jul 20 19:26:37.932146 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 229/450] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:37 2022] GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:38.952349 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-0a602570-46f5-452c-8a64-f803a8c8dc13 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:38.954083 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-0a602570-46f5-452c-8a64-f803a8c8dc13 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 053acc99-052e-4247-a54a-2799958f10e6] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:38.966704 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0a602570-46f5-452c-8a64-f803a8c8dc13 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:38.970766 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0a602570-46f5-452c-8a64-f803a8c8dc13 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:38.973165 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0a602570-46f5-452c-8a64-f803a8c8dc13 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:38.979443 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0a602570-46f5-452c-8a64-f803a8c8dc13 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:39.225806 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0a602570-46f5-452c-8a64-f803a8c8dc13 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:39.239222 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-0a602570-46f5-452c-8a64-f803a8c8dc13 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6" status: 200 len: 1502 microversion: 2.1 time: 0.289923 Jul 20 19:26:39.242909 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 222/451] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:38 2022] GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6 => generated 1502 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:26:39.260438 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-39e5bdb5-45f8-499e-8931-feacc5611c2c tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "128a13b8-cf90-4aec-b3d9-91594caa6d51"}} {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:26:39.261687 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-39e5bdb5-45f8-499e-8931-feacc5611c2c tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 053acc99-052e-4247-a54a-2799958f10e6] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:39.280405 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-39e5bdb5-45f8-499e-8931-feacc5611c2c tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:39.280741 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-39e5bdb5-45f8-499e-8931-feacc5611c2c tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:39.281549 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-39e5bdb5-45f8-499e-8931-feacc5611c2c tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:39.281984 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-39e5bdb5-45f8-499e-8931-feacc5611c2c tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:39.318381 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.wsgi [None req-39e5bdb5-45f8-499e-8931-feacc5611c2c tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] HTTP exception thrown: Cannot 'attach_volume' instance 053acc99-052e-4247-a54a-2799958f10e6 while it is in vm_state rescued Jul 20 19:26:39.320838 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-39e5bdb5-45f8-499e-8931-feacc5611c2c tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Request method failure captured: Jul 20 19:26:39.320838 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: request: POST /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6/os-volume_attachments HTTP/1.1 Jul 20 19:26:39.320838 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: Accept: application/json Jul 20 19:26:39.320838 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: Accept-Encoding: identity Jul 20 19:26:39.320838 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: Connection: close Jul 20 19:26:39.320838 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: Content-Length: 74 Jul 20 19:26:39.320838 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: Content-Type: application/json Jul 20 19:26:39.320838 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: Host: 10.222.0.69 Jul 20 19:26:39.320838 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: Openstack-System-Scope: None Jul 20 19:26:39.320838 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: User-Agent: python-urllib3/1.26.9 Jul 20 19:26:39.320838 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Auth-Token: gAAAAABi2FZGdJT3PjrXOalhxF4cK7yFRY_rdKs7nWDyfOnHDqihLmSc76hrlTVi8pwFl4fc0_PdYOdKi8ehCojNmpTfeHu0z7420hnbFU_7tQyUQZJWpu7NkYJxMVzpGVG2-8TAgdTN19E5_16lQGWKKWKpZnKtS08L9dJthhYfMLyISTLj6Mc Jul 20 19:26:39.320838 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Domain-Id: None Jul 20 19:26:39.320838 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Domain-Name: None Jul 20 19:26:39.320838 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Identity-Status: Confirmed Jul 20 19:26:39.320838 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Is-Admin-Project: True Jul 20 19:26:39.320838 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Project-Domain-Id: default Jul 20 19:26:39.320838 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Project-Domain-Name: Default Jul 20 19:26:39.320838 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Project-Id: 8821facab6ed48588d9d484b5e3d98ba Jul 20 19:26:39.320838 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1121196344 Jul 20 19:26:39.320838 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Role: reader,member Jul 20 19:26:39.320838 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Roles: reader,member Jul 20 19:26:39.322246 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8821facab6ed48588d9d484b5e3d98ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8821facab6ed48588d9d484b5e3d98ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8821facab6ed48588d9d484b5e3d98ba", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8821facab6ed48588d9d484b5e3d98ba"}]}] Jul 20 19:26:39.322246 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1121196344 Jul 20 19:26:39.322246 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Tenant-Id: 8821facab6ed48588d9d484b5e3d98ba Jul 20 19:26:39.322246 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1121196344 Jul 20 19:26:39.322246 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-User: tempest-ServerRescueNegativeTestJSON-1121196344-project Jul 20 19:26:39.322246 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-User-Domain-Id: default Jul 20 19:26:39.322246 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-User-Domain-Name: Default Jul 20 19:26:39.322246 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-User-Id: 9192f2842ca044f08e5f95f98f2e1b88 Jul 20 19:26:39.322246 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1121196344-project Jul 20 19:26:39.322246 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: Jul 20 19:26:39.322246 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: {"volumeAttachment": {"volumeId": "128a13b8-cf90-4aec-b3d9-91594caa6d51"}} Jul 20 19:26:39.322246 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: method: > Jul 20 19:26:39.323081 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: exception: Cannot 'attach_volume' instance 053acc99-052e-4247-a54a-2799958f10e6 while it is in vm_state rescued Jul 20 19:26:39.323081 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: action_args: {'server_id': '053acc99-052e-4247-a54a-2799958f10e6', 'body': {'volumeAttachment': {'volumeId': '128a13b8-cf90-4aec-b3d9-91594caa6d51'}}} Jul 20 19:26:39.323081 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:26:39.323081 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:26:39.323081 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 20 19:26:39.323081 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 20 19:26:39.323081 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 19:26:39.323081 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 19:26:39.323081 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 19:26:39.323081 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 19:26:39.323081 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 053acc99-052e-4247-a54a-2799958f10e6 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 20 19:26:39.323081 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Jul 20 19:26:39.323081 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:26:39.323081 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Jul 20 19:26:39.323081 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:26:39.323081 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:26:39.323081 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:26:39.323081 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:26:39.323081 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:26:39.325674 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:26:39.325674 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:26:39.325674 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 19:26:39.325674 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 19:26:39.325674 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 19:26:39.325674 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 19:26:39.325674 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 19:26:39.325674 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 19:26:39.325674 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 20 19:26:39.325674 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 19:26:39.325674 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 19:26:39.325674 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 19:26:39.325674 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 053acc99-052e-4247-a54a-2799958f10e6 while it is in vm_state rescued Jul 20 19:26:39.325674 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Jul 20 19:26:39.325674 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:26:39.325674 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Jul 20 19:26:39.325674 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:26:39.325674 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:26:39.325674 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:26:39.328334 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:26:39.328334 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:26:39.328334 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 053acc99-052e-4247-a54a-2799958f10e6 while it is in vm_state rescued Jul 20 19:26:39.328334 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Jul 20 19:26:39.330204 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-39e5bdb5-45f8-499e-8931-feacc5611c2c tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Returning 409 to user: Cannot 'attach_volume' instance 053acc99-052e-4247-a54a-2799958f10e6 while it is in vm_state rescued {{(pid=117762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:26:39.331719 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-39e5bdb5-45f8-499e-8931-feacc5611c2c tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "POST /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.075934 Jul 20 19:26:39.333386 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 230/452] 10.222.0.69 () {60 vars in 1322 bytes} [Wed Jul 20 19:26:39 2022] POST /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6/os-volume_attachments => generated 152 bytes in 78 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 19:26:39.342801 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e55f0da6-d094-4780-b204-3626a66e777d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:26:39.343615 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e55f0da6-d094-4780-b204-3626a66e777d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 053acc99-052e-4247-a54a-2799958f10e6] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:39.351039 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e55f0da6-d094-4780-b204-3626a66e777d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:39.352099 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e55f0da6-d094-4780-b204-3626a66e777d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:39.353058 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e55f0da6-d094-4780-b204-3626a66e777d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:39.353689 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e55f0da6-d094-4780-b204-3626a66e777d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:39.461900 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:39.478538 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e55f0da6-d094-4780-b204-3626a66e777d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "POST /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6/action" status: 202 len: 0 microversion: 2.1 time: 0.140239 Jul 20 19:26:39.479968 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 223/453] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Jul 20 19:26:39 2022] POST /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 19:26:39.488975 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-e7a68d74-a21d-45bc-a1f0-fb2674deefdc tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:39.490298 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-e7a68d74-a21d-45bc-a1f0-fb2674deefdc tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 053acc99-052e-4247-a54a-2799958f10e6] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:39.498485 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e7a68d74-a21d-45bc-a1f0-fb2674deefdc tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:39.499211 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e7a68d74-a21d-45bc-a1f0-fb2674deefdc tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:39.500185 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e7a68d74-a21d-45bc-a1f0-fb2674deefdc tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:39.500798 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e7a68d74-a21d-45bc-a1f0-fb2674deefdc tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:39.724938 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-e7a68d74-a21d-45bc-a1f0-fb2674deefdc tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:39.733834 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-e7a68d74-a21d-45bc-a1f0-fb2674deefdc tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6" status: 200 len: 1510 microversion: 2.1 time: 0.248939 Jul 20 19:26:39.757337 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 231/454] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:39 2022] GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6 => generated 1510 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:40.752632 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-b60db83c-a099-4679-be9c-31770fd490f0 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:40.753334 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-b60db83c-a099-4679-be9c-31770fd490f0 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 053acc99-052e-4247-a54a-2799958f10e6] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:40.760722 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b60db83c-a099-4679-be9c-31770fd490f0 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:40.761169 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b60db83c-a099-4679-be9c-31770fd490f0 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:40.761970 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b60db83c-a099-4679-be9c-31770fd490f0 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:40.762620 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b60db83c-a099-4679-be9c-31770fd490f0 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:40.910118 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-b60db83c-a099-4679-be9c-31770fd490f0 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:40.920517 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-b60db83c-a099-4679-be9c-31770fd490f0 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6" status: 200 len: 1510 microversion: 2.1 time: 0.172398 Jul 20 19:26:40.921381 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 224/455] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:40 2022] GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6 => generated 1510 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:41.938827 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-66e8e455-39c2-4806-9909-6bc1b277e5fe tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:41.939455 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-66e8e455-39c2-4806-9909-6bc1b277e5fe tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 053acc99-052e-4247-a54a-2799958f10e6] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:41.941296 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_api:SELECT=58 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:41.946430 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-66e8e455-39c2-4806-9909-6bc1b277e5fe tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:41.947120 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-66e8e455-39c2-4806-9909-6bc1b277e5fe tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:41.947902 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-66e8e455-39c2-4806-9909-6bc1b277e5fe tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:41.948344 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-66e8e455-39c2-4806-9909-6bc1b277e5fe tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:42.093144 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-66e8e455-39c2-4806-9909-6bc1b277e5fe tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:42.101013 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-66e8e455-39c2-4806-9909-6bc1b277e5fe tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6" status: 200 len: 1510 microversion: 2.1 time: 0.166680 Jul 20 19:26:42.102172 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 232/456] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:41 2022] GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6 => generated 1510 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:42.539186 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c41648a1-d7ea-4ecf-a99a-140f73d265ad tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2016212409", "imageRef": "59575804-e013-4dec-af24-b6c2dbbce73a", "flavorRef": "452", "networks": [{"uuid": "3876f343-881d-4a45-a291-349275ccea28"}]}} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:26:42.598678 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.network.neutron [None req-c41648a1-d7ea-4ecf-a99a-140f73d265ad tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] validate_networks() for [('3876f343-881d-4a45-a291-349275ccea28', None, None, None, None, None)] {{(pid=117761) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 19:26:43.060359 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.virt.hardware [None req-c41648a1-d7ea-4ecf-a99a-140f73d265ad tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Flavor limits 0:0:0 {{(pid=117761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 19:26:43.061165 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.virt.hardware [None req-c41648a1-d7ea-4ecf-a99a-140f73d265ad tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Image limits 0:0:0 {{(pid=117761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 19:26:43.061877 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.virt.hardware [None req-c41648a1-d7ea-4ecf-a99a-140f73d265ad tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Flavor pref 0:0:0 {{(pid=117761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 19:26:43.062359 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.virt.hardware [None req-c41648a1-d7ea-4ecf-a99a-140f73d265ad tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Image pref 0:0:0 {{(pid=117761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 19:26:43.063196 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.virt.hardware [None req-c41648a1-d7ea-4ecf-a99a-140f73d265ad tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 19:26:43.067443 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=2 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:43.077771 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c41648a1-d7ea-4ecf-a99a-140f73d265ad tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:43.078329 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c41648a1-d7ea-4ecf-a99a-140f73d265ad tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:43.079534 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c41648a1-d7ea-4ecf-a99a-140f73d265ad tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:43.080445 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c41648a1-d7ea-4ecf-a99a-140f73d265ad tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:43.105778 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.quota [None req-c41648a1-d7ea-4ecf-a99a-140f73d265ad tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Getting quotas for project e0bb4af78c1d4589b1d3cc90d5e6be63. Resources: {'cores', 'ram', 'instances'} {{(pid=117761) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:26:43.110772 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.quota [None req-c41648a1-d7ea-4ecf-a99a-140f73d265ad tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Getting quotas for user 78ae826a812b44328c48b82e9498ad8b and project e0bb4af78c1d4589b1d3cc90d5e6be63. Resources: {'cores', 'ram', 'instances'} {{(pid=117761) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:26:43.119999 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-6630fc4b-9681-4f42-a3a2-953ecf3f95fa tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:43.124653 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-6630fc4b-9681-4f42-a3a2-953ecf3f95fa tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 053acc99-052e-4247-a54a-2799958f10e6] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:43.132661 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-6630fc4b-9681-4f42-a3a2-953ecf3f95fa tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:43.133639 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-6630fc4b-9681-4f42-a3a2-953ecf3f95fa tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:43.133809 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c41648a1-d7ea-4ecf-a99a-140f73d265ad tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Going to run 1 instances... {{(pid=117761) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 19:26:43.135019 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-6630fc4b-9681-4f42-a3a2-953ecf3f95fa tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:43.135581 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-6630fc4b-9681-4f42-a3a2-953ecf3f95fa tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:43.138653 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c41648a1-d7ea-4ecf-a99a-140f73d265ad tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] [instance: 510f02a7-afc2-414f-bcd3-c197ffb96641] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='59575804-e013-4dec-af24-b6c2dbbce73a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117761) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 19:26:43.142611 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_cell1:SELECT=100 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:43.221691 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c41648a1-d7ea-4ecf-a99a-140f73d265ad tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.685770 Jul 20 19:26:43.223253 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 225/457] 10.222.0.69 () {60 vars in 1146 bytes} [Wed Jul 20 19:26:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 19:26:43.241914 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4e379bd6-ac28-4759-b9d0-4068103019b9 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:43.242877 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-4e379bd6-ac28-4759-b9d0-4068103019b9 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] [instance: 510f02a7-afc2-414f-bcd3-c197ffb96641] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:43.317115 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-6630fc4b-9681-4f42-a3a2-953ecf3f95fa tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:43.324210 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-4e379bd6-ac28-4759-b9d0-4068103019b9 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ae826a812b44328c48b82e9498ad8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bb4af78c1d4589b1d3cc90d5e6be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:43.344539 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-4e379bd6-ac28-4759-b9d0-4068103019b9 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] 10.222.0.69 "GET /compute/v2.1/servers/510f02a7-afc2-414f-bcd3-c197ffb96641" status: 200 len: 1219 microversion: 2.1 time: 0.114651 Jul 20 19:26:43.353752 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 226/458] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:43 2022] GET /compute/v2.1/servers/510f02a7-afc2-414f-bcd3-c197ffb96641 => generated 1219 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:43.353939 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-6630fc4b-9681-4f42-a3a2-953ecf3f95fa tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6" status: 200 len: 1510 microversion: 2.1 time: 0.231022 Jul 20 19:26:43.353939 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 233/459] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:43 2022] GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6 => generated 1510 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:44.366809 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-a753cd3b-5e24-49ba-bad5-7dd58b988cbd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:44.367611 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-3433ade1-0302-478d-af55-1b22e9d7264b tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:44.368133 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-3433ade1-0302-478d-af55-1b22e9d7264b tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] [instance: 510f02a7-afc2-414f-bcd3-c197ffb96641] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:44.368939 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-a753cd3b-5e24-49ba-bad5-7dd58b988cbd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 053acc99-052e-4247-a54a-2799958f10e6] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:44.377194 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a753cd3b-5e24-49ba-bad5-7dd58b988cbd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:44.378154 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a753cd3b-5e24-49ba-bad5-7dd58b988cbd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:44.379415 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a753cd3b-5e24-49ba-bad5-7dd58b988cbd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:44.380231 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a753cd3b-5e24-49ba-bad5-7dd58b988cbd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:44.381659 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3433ade1-0302-478d-af55-1b22e9d7264b tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:44.382304 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3433ade1-0302-478d-af55-1b22e9d7264b tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:44.383103 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3433ade1-0302-478d-af55-1b22e9d7264b tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:44.383666 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3433ade1-0302-478d-af55-1b22e9d7264b tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:44.471105 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3433ade1-0302-478d-af55-1b22e9d7264b tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ae826a812b44328c48b82e9498ad8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bb4af78c1d4589b1d3cc90d5e6be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:44.485922 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-3433ade1-0302-478d-af55-1b22e9d7264b tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] 10.222.0.69 "GET /compute/v2.1/servers/510f02a7-afc2-414f-bcd3-c197ffb96641" status: 200 len: 1223 microversion: 2.1 time: 0.125463 Jul 20 19:26:44.486820 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 227/460] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:44 2022] GET /compute/v2.1/servers/510f02a7-afc2-414f-bcd3-c197ffb96641 => generated 1223 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:44.546743 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-a753cd3b-5e24-49ba-bad5-7dd58b988cbd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:44.555145 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-a753cd3b-5e24-49ba-bad5-7dd58b988cbd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6" status: 200 len: 1510 microversion: 2.1 time: 0.192052 Jul 20 19:26:44.555722 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 234/461] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:44 2022] GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6 => generated 1510 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:45.503079 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-f562a161-65de-4a4a-aa30-c836b32dde1c tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:45.503769 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-f562a161-65de-4a4a-aa30-c836b32dde1c tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] [instance: 510f02a7-afc2-414f-bcd3-c197ffb96641] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:45.511298 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f562a161-65de-4a4a-aa30-c836b32dde1c tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:45.511689 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f562a161-65de-4a4a-aa30-c836b32dde1c tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:45.513720 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f562a161-65de-4a4a-aa30-c836b32dde1c tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:45.514115 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f562a161-65de-4a4a-aa30-c836b32dde1c tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:45.572877 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-d36492c6-096c-4775-8a41-a60d0b0e54c8 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:45.574356 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-d36492c6-096c-4775-8a41-a60d0b0e54c8 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 053acc99-052e-4247-a54a-2799958f10e6] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:45.590792 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d36492c6-096c-4775-8a41-a60d0b0e54c8 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:45.591696 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d36492c6-096c-4775-8a41-a60d0b0e54c8 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:45.593116 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d36492c6-096c-4775-8a41-a60d0b0e54c8 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:45.593781 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d36492c6-096c-4775-8a41-a60d0b0e54c8 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:45.635098 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-f562a161-65de-4a4a-aa30-c836b32dde1c tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ae826a812b44328c48b82e9498ad8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bb4af78c1d4589b1d3cc90d5e6be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:45.646171 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-f562a161-65de-4a4a-aa30-c836b32dde1c tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] 10.222.0.69 "GET /compute/v2.1/servers/510f02a7-afc2-414f-bcd3-c197ffb96641" status: 200 len: 1223 microversion: 2.1 time: 0.146523 Jul 20 19:26:45.658453 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 228/462] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:45 2022] GET /compute/v2.1/servers/510f02a7-afc2-414f-bcd3-c197ffb96641 => generated 1223 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:45.768693 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-d36492c6-096c-4775-8a41-a60d0b0e54c8 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:45.779526 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-d36492c6-096c-4775-8a41-a60d0b0e54c8 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6" status: 200 len: 1510 microversion: 2.1 time: 0.210851 Jul 20 19:26:45.780089 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 235/463] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:45 2022] GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6 => generated 1510 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:46.666466 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-805934c8-85ed-428b-8c85-321aa4413e65 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:46.667072 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-805934c8-85ed-428b-8c85-321aa4413e65 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] [instance: 510f02a7-afc2-414f-bcd3-c197ffb96641] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:46.675179 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-805934c8-85ed-428b-8c85-321aa4413e65 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:46.675627 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-805934c8-85ed-428b-8c85-321aa4413e65 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:46.676690 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-805934c8-85ed-428b-8c85-321aa4413e65 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:46.677290 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-805934c8-85ed-428b-8c85-321aa4413e65 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:46.744908 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-805934c8-85ed-428b-8c85-321aa4413e65 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ae826a812b44328c48b82e9498ad8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bb4af78c1d4589b1d3cc90d5e6be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:46.753463 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-805934c8-85ed-428b-8c85-321aa4413e65 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] 10.222.0.69 "GET /compute/v2.1/servers/510f02a7-afc2-414f-bcd3-c197ffb96641" status: 200 len: 1223 microversion: 2.1 time: 0.091191 Jul 20 19:26:46.759847 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 229/464] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:46 2022] GET /compute/v2.1/servers/510f02a7-afc2-414f-bcd3-c197ffb96641 => generated 1223 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:46.799131 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-fc6f0860-749b-4982-b09f-1b9de45c0e99 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:46.799733 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-fc6f0860-749b-4982-b09f-1b9de45c0e99 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 053acc99-052e-4247-a54a-2799958f10e6] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:46.806034 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-fc6f0860-749b-4982-b09f-1b9de45c0e99 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:46.806702 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-fc6f0860-749b-4982-b09f-1b9de45c0e99 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:46.807473 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-fc6f0860-749b-4982-b09f-1b9de45c0e99 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:46.807906 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-fc6f0860-749b-4982-b09f-1b9de45c0e99 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:46.957970 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-fc6f0860-749b-4982-b09f-1b9de45c0e99 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:46.966877 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-fc6f0860-749b-4982-b09f-1b9de45c0e99 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6" status: 200 len: 1510 microversion: 2.1 time: 0.171229 Jul 20 19:26:46.967749 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 236/465] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:46 2022] GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6 => generated 1510 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:47.776326 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-8b2e8186-d9ee-41a9-8e4e-5b731c60aef6 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:47.778622 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-8b2e8186-d9ee-41a9-8e4e-5b731c60aef6 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] [instance: 510f02a7-afc2-414f-bcd3-c197ffb96641] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:47.788366 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8b2e8186-d9ee-41a9-8e4e-5b731c60aef6 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:47.789342 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8b2e8186-d9ee-41a9-8e4e-5b731c60aef6 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:47.790421 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8b2e8186-d9ee-41a9-8e4e-5b731c60aef6 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:47.791226 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8b2e8186-d9ee-41a9-8e4e-5b731c60aef6 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:47.872795 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8b2e8186-d9ee-41a9-8e4e-5b731c60aef6 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ae826a812b44328c48b82e9498ad8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bb4af78c1d4589b1d3cc90d5e6be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:47.881751 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-8b2e8186-d9ee-41a9-8e4e-5b731c60aef6 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] 10.222.0.69 "GET /compute/v2.1/servers/510f02a7-afc2-414f-bcd3-c197ffb96641" status: 200 len: 1223 microversion: 2.1 time: 0.113488 Jul 20 19:26:47.891844 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 230/466] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:47 2022] GET /compute/v2.1/servers/510f02a7-afc2-414f-bcd3-c197ffb96641 => generated 1223 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:47.984576 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-dd4e486c-a539-4ee0-8952-06511a8d6f65 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:47.985179 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-dd4e486c-a539-4ee0-8952-06511a8d6f65 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 053acc99-052e-4247-a54a-2799958f10e6] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:47.992863 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-dd4e486c-a539-4ee0-8952-06511a8d6f65 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:47.993310 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-dd4e486c-a539-4ee0-8952-06511a8d6f65 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:47.994298 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-dd4e486c-a539-4ee0-8952-06511a8d6f65 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:47.994874 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-dd4e486c-a539-4ee0-8952-06511a8d6f65 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:48.168403 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-dd4e486c-a539-4ee0-8952-06511a8d6f65 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:48.176849 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-dd4e486c-a539-4ee0-8952-06511a8d6f65 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6" status: 200 len: 1510 microversion: 2.1 time: 0.196475 Jul 20 19:26:48.177827 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 237/467] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:47 2022] GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6 => generated 1510 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:48.898495 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-5e41a372-7c78-4258-b996-855037898248 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:48.899120 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-5e41a372-7c78-4258-b996-855037898248 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] [instance: 510f02a7-afc2-414f-bcd3-c197ffb96641] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:48.907018 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5e41a372-7c78-4258-b996-855037898248 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:48.907773 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5e41a372-7c78-4258-b996-855037898248 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:48.908581 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5e41a372-7c78-4258-b996-855037898248 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:48.909018 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5e41a372-7c78-4258-b996-855037898248 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:48.976856 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-5e41a372-7c78-4258-b996-855037898248 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ae826a812b44328c48b82e9498ad8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bb4af78c1d4589b1d3cc90d5e6be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:48.985121 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-5e41a372-7c78-4258-b996-855037898248 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] 10.222.0.69 "GET /compute/v2.1/servers/510f02a7-afc2-414f-bcd3-c197ffb96641" status: 200 len: 1223 microversion: 2.1 time: 0.090516 Jul 20 19:26:48.995113 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 231/468] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:48 2022] GET /compute/v2.1/servers/510f02a7-afc2-414f-bcd3-c197ffb96641 => generated 1223 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:49.195336 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-9273881c-b309-4d1c-9293-d4aff62820cf tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:49.196032 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-9273881c-b309-4d1c-9293-d4aff62820cf tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 053acc99-052e-4247-a54a-2799958f10e6] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:49.203883 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9273881c-b309-4d1c-9293-d4aff62820cf tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:49.204612 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9273881c-b309-4d1c-9293-d4aff62820cf tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:49.205569 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9273881c-b309-4d1c-9293-d4aff62820cf tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:49.206153 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9273881c-b309-4d1c-9293-d4aff62820cf tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:49.358824 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-9273881c-b309-4d1c-9293-d4aff62820cf tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:49.372882 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-9273881c-b309-4d1c-9293-d4aff62820cf tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6" status: 200 len: 1510 microversion: 2.1 time: 0.181470 Jul 20 19:26:49.384704 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 238/469] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:49 2022] GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6 => generated 1510 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:50.008969 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-112d9a32-2449-4206-b276-da61d18d9e6a tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:50.008969 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-112d9a32-2449-4206-b276-da61d18d9e6a tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] [instance: 510f02a7-afc2-414f-bcd3-c197ffb96641] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:50.016733 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-112d9a32-2449-4206-b276-da61d18d9e6a tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:50.017307 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-112d9a32-2449-4206-b276-da61d18d9e6a tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:50.018348 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-112d9a32-2449-4206-b276-da61d18d9e6a tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:50.018878 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-112d9a32-2449-4206-b276-da61d18d9e6a tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:50.196665 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-112d9a32-2449-4206-b276-da61d18d9e6a tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ae826a812b44328c48b82e9498ad8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bb4af78c1d4589b1d3cc90d5e6be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:50.207732 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-112d9a32-2449-4206-b276-da61d18d9e6a tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] 10.222.0.69 "GET /compute/v2.1/servers/510f02a7-afc2-414f-bcd3-c197ffb96641" status: 200 len: 1271 microversion: 2.1 time: 0.208296 Jul 20 19:26:50.217888 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 232/470] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:49 2022] GET /compute/v2.1/servers/510f02a7-afc2-414f-bcd3-c197ffb96641 => generated 1271 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:50.404904 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-44574465-d7ec-4d75-ba9d-2ed34a427c81 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:50.404904 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-44574465-d7ec-4d75-ba9d-2ed34a427c81 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 053acc99-052e-4247-a54a-2799958f10e6] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:50.409456 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-44574465-d7ec-4d75-ba9d-2ed34a427c81 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:50.410498 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-44574465-d7ec-4d75-ba9d-2ed34a427c81 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:50.411085 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-44574465-d7ec-4d75-ba9d-2ed34a427c81 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:50.412156 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-44574465-d7ec-4d75-ba9d-2ed34a427c81 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:50.583684 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-44574465-d7ec-4d75-ba9d-2ed34a427c81 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:50.593365 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-44574465-d7ec-4d75-ba9d-2ed34a427c81 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6" status: 200 len: 1516 microversion: 2.1 time: 0.200959 Jul 20 19:26:50.594365 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 239/471] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:50 2022] GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6 => generated 1516 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:51.229252 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-7637cd15-bcb9-46ed-b09c-78284c741d21 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:51.229936 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-7637cd15-bcb9-46ed-b09c-78284c741d21 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] [instance: 510f02a7-afc2-414f-bcd3-c197ffb96641] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:51.238430 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7637cd15-bcb9-46ed-b09c-78284c741d21 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:51.238886 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7637cd15-bcb9-46ed-b09c-78284c741d21 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:51.239668 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7637cd15-bcb9-46ed-b09c-78284c741d21 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:51.240104 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7637cd15-bcb9-46ed-b09c-78284c741d21 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:51.354482 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-7637cd15-bcb9-46ed-b09c-78284c741d21 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ae826a812b44328c48b82e9498ad8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bb4af78c1d4589b1d3cc90d5e6be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:51.364206 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-7637cd15-bcb9-46ed-b09c-78284c741d21 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] 10.222.0.69 "GET /compute/v2.1/servers/510f02a7-afc2-414f-bcd3-c197ffb96641" status: 200 len: 1279 microversion: 2.1 time: 0.140058 Jul 20 19:26:51.373870 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 233/472] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:51 2022] GET /compute/v2.1/servers/510f02a7-afc2-414f-bcd3-c197ffb96641 => generated 1279 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:52.380800 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-b2d498dd-aa30-4d28-bd94-5fc422390bd6 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:52.381481 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-b2d498dd-aa30-4d28-bd94-5fc422390bd6 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] [instance: 510f02a7-afc2-414f-bcd3-c197ffb96641] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:52.387810 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b2d498dd-aa30-4d28-bd94-5fc422390bd6 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:52.388345 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b2d498dd-aa30-4d28-bd94-5fc422390bd6 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:52.389164 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b2d498dd-aa30-4d28-bd94-5fc422390bd6 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:52.389718 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b2d498dd-aa30-4d28-bd94-5fc422390bd6 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:52.531424 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-b2d498dd-aa30-4d28-bd94-5fc422390bd6 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ae826a812b44328c48b82e9498ad8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bb4af78c1d4589b1d3cc90d5e6be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:52.538814 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-b2d498dd-aa30-4d28-bd94-5fc422390bd6 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] 10.222.0.69 "GET /compute/v2.1/servers/510f02a7-afc2-414f-bcd3-c197ffb96641" status: 200 len: 1319 microversion: 2.1 time: 0.161889 Jul 20 19:26:52.539475 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 240/473] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:52 2022] GET /compute/v2.1/servers/510f02a7-afc2-414f-bcd3-c197ffb96641 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:52.576434 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [req-79fe947d-f21f-45ab-8c5d-6737e24e9911 req-db024a64-3eab-4f5b-b2b3-4b53fbf3cde2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "510f02a7-afc2-414f-bcd3-c197ffb96641", "tag": "e64bdd40-7e1f-4934-b9d4-0a7819f5121f"}]} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:26:52.586245 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-79fe947d-f21f-45ab-8c5d-6737e24e9911 req-db024a64-3eab-4f5b-b2b3-4b53fbf3cde2 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:52.586790 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-79fe947d-f21f-45ab-8c5d-6737e24e9911 req-db024a64-3eab-4f5b-b2b3-4b53fbf3cde2 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:52.602375 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.compute.server_external_events [req-79fe947d-f21f-45ab-8c5d-6737e24e9911 req-db024a64-3eab-4f5b-b2b3-4b53fbf3cde2 service nova] Creating event network-changed:e64bdd40-7e1f-4934-b9d4-0a7819f5121f for instance 510f02a7-afc2-414f-bcd3-c197ffb96641 on hv-cinder-83538 Jul 20 19:26:52.608434 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [req-79fe947d-f21f-45ab-8c5d-6737e24e9911 req-db024a64-3eab-4f5b-b2b3-4b53fbf3cde2 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035975 Jul 20 19:26:52.609492 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 234/474] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 19:26:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:26:53.557155 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-82d17f13-4de0-4bb3-abe7-5c2e406fd631 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:53.558059 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-82d17f13-4de0-4bb3-abe7-5c2e406fd631 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] [instance: 510f02a7-afc2-414f-bcd3-c197ffb96641] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:53.565024 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-82d17f13-4de0-4bb3-abe7-5c2e406fd631 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:53.565842 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-82d17f13-4de0-4bb3-abe7-5c2e406fd631 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:53.566618 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-82d17f13-4de0-4bb3-abe7-5c2e406fd631 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:53.567049 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-82d17f13-4de0-4bb3-abe7-5c2e406fd631 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:53.706681 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-82d17f13-4de0-4bb3-abe7-5c2e406fd631 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ae826a812b44328c48b82e9498ad8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bb4af78c1d4589b1d3cc90d5e6be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:53.714019 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-82d17f13-4de0-4bb3-abe7-5c2e406fd631 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] 10.222.0.69 "GET /compute/v2.1/servers/510f02a7-afc2-414f-bcd3-c197ffb96641" status: 200 len: 1319 microversion: 2.1 time: 0.161546 Jul 20 19:26:53.714582 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 241/475] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:53 2022] GET /compute/v2.1/servers/510f02a7-afc2-414f-bcd3-c197ffb96641 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:26:54.222119 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell0:SELECT=2 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:54.222917 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell0:SELECT=8 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:54.227541 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-65e5db4a-4096-4678-85e6-a84a4b05c96b tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Action: 'create', calling method: .version_select at 0x7ff60a2a3310>, body: {"keypair": {"name": "tempest-keypair-2006040141", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMOX0mbEqMOdj9cmUdMqoTMNSFYr1st1vIkYVU+VNmlq0VT6whsY3pyagwY3F/2/ondcl8JvRbuSjxpW1GQvpIo4Fza+hTXL1YI/9Ef9L6obXnwa+CmUKInxnmqjzRcDtQ=="}} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:26:54.242348 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.quota [None req-65e5db4a-4096-4678-85e6-a84a4b05c96b tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Getting quotas for project 8821facab6ed48588d9d484b5e3d98ba. Resources: {'key_pairs'} {{(pid=117761) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:26:54.246369 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.quota [None req-65e5db4a-4096-4678-85e6-a84a4b05c96b tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Getting quotas for user 9192f2842ca044f08e5f95f98f2e1b88 and project 8821facab6ed48588d9d484b5e3d98ba. Resources: {'key_pairs'} {{(pid=117761) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:26:54.257811 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR oslo.messaging._drivers.impl_rabbit [None req-65e5db4a-4096-4678-85e6-a84a4b05c96b tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [be140af4-670b-4878-af45-ffd6c10a5865] AMQP server on 10.222.0.69:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 20 19:26:54.730992 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-49a503fe-3eb7-47df-acaf-cad7ecbbeb7a tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:54.731627 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-49a503fe-3eb7-47df-acaf-cad7ecbbeb7a tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] [instance: 510f02a7-afc2-414f-bcd3-c197ffb96641] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:54.737797 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-49a503fe-3eb7-47df-acaf-cad7ecbbeb7a tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:54.738244 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-49a503fe-3eb7-47df-acaf-cad7ecbbeb7a tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:54.739007 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-49a503fe-3eb7-47df-acaf-cad7ecbbeb7a tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:54.739600 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-49a503fe-3eb7-47df-acaf-cad7ecbbeb7a tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:54.939074 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-49a503fe-3eb7-47df-acaf-cad7ecbbeb7a tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ae826a812b44328c48b82e9498ad8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bb4af78c1d4589b1d3cc90d5e6be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:54.948367 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-49a503fe-3eb7-47df-acaf-cad7ecbbeb7a tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] 10.222.0.69 "GET /compute/v2.1/servers/510f02a7-afc2-414f-bcd3-c197ffb96641" status: 200 len: 1319 microversion: 2.1 time: 0.221184 Jul 20 19:26:54.949150 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 242/476] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:54 2022] GET /compute/v2.1/servers/510f02a7-afc2-414f-bcd3-c197ffb96641 => generated 1319 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:26:55.270874 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO oslo.messaging._drivers.impl_rabbit [None req-65e5db4a-4096-4678-85e6-a84a4b05c96b tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [be140af4-670b-4878-af45-ffd6c10a5865] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 37324. Jul 20 19:26:55.290878 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-65e5db4a-4096-4678-85e6-a84a4b05c96b tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.069587 Jul 20 19:26:55.291748 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 235/477] 10.222.0.69 () {60 vars in 1158 bytes} [Wed Jul 20 19:26:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:26:55.970055 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-489a6c03-fc16-4f2a-838a-0c65db557178 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:55.970799 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-489a6c03-fc16-4f2a-838a-0c65db557178 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] [instance: 510f02a7-afc2-414f-bcd3-c197ffb96641] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:55.979271 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-489a6c03-fc16-4f2a-838a-0c65db557178 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:55.980952 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-489a6c03-fc16-4f2a-838a-0c65db557178 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:55.983045 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-489a6c03-fc16-4f2a-838a-0c65db557178 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:55.983514 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-489a6c03-fc16-4f2a-838a-0c65db557178 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:56.136064 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-489a6c03-fc16-4f2a-838a-0c65db557178 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ae826a812b44328c48b82e9498ad8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bb4af78c1d4589b1d3cc90d5e6be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:56.146373 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-489a6c03-fc16-4f2a-838a-0c65db557178 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] 10.222.0.69 "GET /compute/v2.1/servers/510f02a7-afc2-414f-bcd3-c197ffb96641" status: 200 len: 1319 microversion: 2.1 time: 0.184116 Jul 20 19:26:56.147561 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 243/478] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:55 2022] GET /compute/v2.1/servers/510f02a7-afc2-414f-bcd3-c197ffb96641 => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:56.835060 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-b62d65e5-d791-4542-8619-726f5a3c39df tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-808703377", "imageRef": "59575804-e013-4dec-af24-b6c2dbbce73a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "aef5723e-1807-4eb3-b101-2d519a5b7765"}], "security_groups": [{"name": "tempest-securitygroup--1224328016"}], "key_name": "tempest-keypair-2006040141", "user_data": "}} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:26:57.025493 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.network.neutron [None req-b62d65e5-d791-4542-8619-726f5a3c39df tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] validate_networks() for [('aef5723e-1807-4eb3-b101-2d519a5b7765', None, None, None, None, None)] {{(pid=117761) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 19:26:57.164178 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-d8827b0d-fda8-4a19-9276-6fbb55958686 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:57.164782 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-d8827b0d-fda8-4a19-9276-6fbb55958686 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] [instance: 510f02a7-afc2-414f-bcd3-c197ffb96641] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:57.171680 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d8827b0d-fda8-4a19-9276-6fbb55958686 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:57.172340 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d8827b0d-fda8-4a19-9276-6fbb55958686 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:57.173089 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d8827b0d-fda8-4a19-9276-6fbb55958686 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:57.173741 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d8827b0d-fda8-4a19-9276-6fbb55958686 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:57.329208 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-d8827b0d-fda8-4a19-9276-6fbb55958686 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ae826a812b44328c48b82e9498ad8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bb4af78c1d4589b1d3cc90d5e6be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:57.341456 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-d8827b0d-fda8-4a19-9276-6fbb55958686 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] 10.222.0.69 "GET /compute/v2.1/servers/510f02a7-afc2-414f-bcd3-c197ffb96641" status: 200 len: 1319 microversion: 2.1 time: 0.180976 Jul 20 19:26:57.344206 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 244/479] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:57 2022] GET /compute/v2.1/servers/510f02a7-afc2-414f-bcd3-c197ffb96641 => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:26:57.481214 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.virt.hardware [None req-b62d65e5-d791-4542-8619-726f5a3c39df tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Flavor limits 0:0:0 {{(pid=117761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 19:26:57.481670 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.virt.hardware [None req-b62d65e5-d791-4542-8619-726f5a3c39df tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Image limits 0:0:0 {{(pid=117761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 19:26:57.482140 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.virt.hardware [None req-b62d65e5-d791-4542-8619-726f5a3c39df tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Flavor pref 0:0:0 {{(pid=117761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 19:26:57.482543 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.virt.hardware [None req-b62d65e5-d791-4542-8619-726f5a3c39df tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Image pref 0:0:0 {{(pid=117761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 19:26:57.482950 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.virt.hardware [None req-b62d65e5-d791-4542-8619-726f5a3c39df tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 19:26:57.492254 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b62d65e5-d791-4542-8619-726f5a3c39df tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:57.492697 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b62d65e5-d791-4542-8619-726f5a3c39df tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:57.493485 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b62d65e5-d791-4542-8619-726f5a3c39df tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:57.493939 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b62d65e5-d791-4542-8619-726f5a3c39df tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:57.511788 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.quota [None req-b62d65e5-d791-4542-8619-726f5a3c39df tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Getting quotas for project 8821facab6ed48588d9d484b5e3d98ba. Resources: {'cores', 'ram', 'instances'} {{(pid=117761) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:26:57.516109 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.quota [None req-b62d65e5-d791-4542-8619-726f5a3c39df tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Getting quotas for user 9192f2842ca044f08e5f95f98f2e1b88 and project 8821facab6ed48588d9d484b5e3d98ba. Resources: {'cores', 'ram', 'instances'} {{(pid=117761) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:26:57.526905 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-b62d65e5-d791-4542-8619-726f5a3c39df tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Going to run 1 instances... {{(pid=117761) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 19:26:57.529488 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-b62d65e5-d791-4542-8619-726f5a3c39df tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 2b8da868-71d1-49ad-be95-25d0a41393e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='59575804-e013-4dec-af24-b6c2dbbce73a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117761) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 19:26:57.575604 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-b62d65e5-d791-4542-8619-726f5a3c39df tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.744810 Jul 20 19:26:57.576252 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 236/480] 10.222.0.69 () {60 vars in 1146 bytes} [Wed Jul 20 19:26:56 2022] POST /compute/v2.1/servers => generated 409 bytes in 746 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 19:26:57.586338 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-fffd5ecb-4bd3-420f-a951-038b02d2e195 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:57.586937 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-fffd5ecb-4bd3-420f-a951-038b02d2e195 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 2b8da868-71d1-49ad-be95-25d0a41393e9] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:57.651666 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-fffd5ecb-4bd3-420f-a951-038b02d2e195 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:57.660253 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-fffd5ecb-4bd3-420f-a951-038b02d2e195 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9" status: 200 len: 1245 microversion: 2.1 time: 0.077600 Jul 20 19:26:57.664121 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 245/481] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:57 2022] GET /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9 => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:58.361860 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-07b83120-7b54-4f76-845e-cc0310057de7 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:58.362310 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-07b83120-7b54-4f76-845e-cc0310057de7 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] [instance: 510f02a7-afc2-414f-bcd3-c197ffb96641] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:58.368835 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-07b83120-7b54-4f76-845e-cc0310057de7 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:58.369357 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-07b83120-7b54-4f76-845e-cc0310057de7 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:58.371487 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-07b83120-7b54-4f76-845e-cc0310057de7 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:58.371806 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-07b83120-7b54-4f76-845e-cc0310057de7 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:58.524198 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-07b83120-7b54-4f76-845e-cc0310057de7 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ae826a812b44328c48b82e9498ad8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bb4af78c1d4589b1d3cc90d5e6be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:58.531833 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-07b83120-7b54-4f76-845e-cc0310057de7 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] 10.222.0.69 "GET /compute/v2.1/servers/510f02a7-afc2-414f-bcd3-c197ffb96641" status: 200 len: 1319 microversion: 2.1 time: 0.174018 Jul 20 19:26:58.532396 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 237/482] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:58 2022] GET /compute/v2.1/servers/510f02a7-afc2-414f-bcd3-c197ffb96641 => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:58.680139 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-e34cc29e-cf00-4148-8a90-27c3182773c0 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:58.680768 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-e34cc29e-cf00-4148-8a90-27c3182773c0 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 2b8da868-71d1-49ad-be95-25d0a41393e9] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:58.687474 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e34cc29e-cf00-4148-8a90-27c3182773c0 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:58.687929 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e34cc29e-cf00-4148-8a90-27c3182773c0 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:58.688688 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e34cc29e-cf00-4148-8a90-27c3182773c0 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:58.689155 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e34cc29e-cf00-4148-8a90-27c3182773c0 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:58.757111 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-e34cc29e-cf00-4148-8a90-27c3182773c0 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:58.766019 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-e34cc29e-cf00-4148-8a90-27c3182773c0 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9" status: 200 len: 1297 microversion: 2.1 time: 0.089675 Jul 20 19:26:58.767109 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 246/483] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:58 2022] GET /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9 => generated 1297 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:59.549385 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c5b02655-ee85-4033-a0d5-f943a6698a67 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:59.550346 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c5b02655-ee85-4033-a0d5-f943a6698a67 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] [instance: 510f02a7-afc2-414f-bcd3-c197ffb96641] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:59.556960 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c5b02655-ee85-4033-a0d5-f943a6698a67 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:59.557831 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c5b02655-ee85-4033-a0d5-f943a6698a67 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:59.559111 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c5b02655-ee85-4033-a0d5-f943a6698a67 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:59.560133 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c5b02655-ee85-4033-a0d5-f943a6698a67 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:59.783990 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-2a02ce92-68ce-4752-9ab2-d7f60574eb5e tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:59.784597 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-2a02ce92-68ce-4752-9ab2-d7f60574eb5e tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 2b8da868-71d1-49ad-be95-25d0a41393e9] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:59.790892 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2a02ce92-68ce-4752-9ab2-d7f60574eb5e tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:59.791337 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2a02ce92-68ce-4752-9ab2-d7f60574eb5e tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:59.792096 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2a02ce92-68ce-4752-9ab2-d7f60574eb5e tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:59.792574 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2a02ce92-68ce-4752-9ab2-d7f60574eb5e tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:59.830019 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c5b02655-ee85-4033-a0d5-f943a6698a67 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ae826a812b44328c48b82e9498ad8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bb4af78c1d4589b1d3cc90d5e6be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:59.837503 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c5b02655-ee85-4033-a0d5-f943a6698a67 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] 10.222.0.69 "GET /compute/v2.1/servers/510f02a7-afc2-414f-bcd3-c197ffb96641" status: 200 len: 1319 microversion: 2.1 time: 0.292079 Jul 20 19:26:59.838092 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 238/484] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:59 2022] GET /compute/v2.1/servers/510f02a7-afc2-414f-bcd3-c197ffb96641 => generated 1319 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:59.928541 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-2a02ce92-68ce-4752-9ab2-d7f60574eb5e tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:59.938060 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-2a02ce92-68ce-4752-9ab2-d7f60574eb5e tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9" status: 200 len: 1371 microversion: 2.1 time: 0.157739 Jul 20 19:26:59.938539 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 247/485] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:59 2022] GET /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9 => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:27:00.284191 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [req-b5a03251-d1e2-4b4c-b4e0-4a5881352231 req-87b42c47-521b-4659-beb1-20396a3a3981 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b8da868-71d1-49ad-be95-25d0a41393e9", "tag": "e1440571-e796-4c28-8091-6adb4bfa88b0"}]} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:27:00.304177 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-b5a03251-d1e2-4b4c-b4e0-4a5881352231 req-87b42c47-521b-4659-beb1-20396a3a3981 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:00.304957 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-b5a03251-d1e2-4b4c-b4e0-4a5881352231 req-87b42c47-521b-4659-beb1-20396a3a3981 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:00.318830 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.compute.server_external_events [req-b5a03251-d1e2-4b4c-b4e0-4a5881352231 req-87b42c47-521b-4659-beb1-20396a3a3981 service nova] Creating event network-changed:e1440571-e796-4c28-8091-6adb4bfa88b0 for instance 2b8da868-71d1-49ad-be95-25d0a41393e9 on hv-cinder-83538 Jul 20 19:27:00.325012 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [req-b5a03251-d1e2-4b4c-b4e0-4a5881352231 req-87b42c47-521b-4659-beb1-20396a3a3981 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048945 Jul 20 19:27:00.327085 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 239/486] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 19:27:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:27:00.783070 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [req-8c959161-f8f1-40bc-9489-916768b5b4e4 req-09ce2214-5e25-449b-977d-8ad3f09de246 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "510f02a7-afc2-414f-bcd3-c197ffb96641", "name": "network-vif-plugged", "status": "completed", "tag": "e64bdd40-7e1f-4934-b9d4-0a7819f5121f"}]} {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:27:00.792011 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [req-8c959161-f8f1-40bc-9489-916768b5b4e4 req-09ce2214-5e25-449b-977d-8ad3f09de246 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:00.793256 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [req-8c959161-f8f1-40bc-9489-916768b5b4e4 req-09ce2214-5e25-449b-977d-8ad3f09de246 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:00.807033 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.compute.server_external_events [req-8c959161-f8f1-40bc-9489-916768b5b4e4 req-09ce2214-5e25-449b-977d-8ad3f09de246 service nova] Creating event network-vif-plugged:e64bdd40-7e1f-4934-b9d4-0a7819f5121f for instance 510f02a7-afc2-414f-bcd3-c197ffb96641 on hv-cinder-83538 Jul 20 19:27:00.812359 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [req-8c959161-f8f1-40bc-9489-916768b5b4e4 req-09ce2214-5e25-449b-977d-8ad3f09de246 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033159 Jul 20 19:27:00.813321 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 248/487] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 19:27:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:27:00.858428 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-7ca89819-f2ac-4a4c-8716-44f9be3a8abf tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:00.860195 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-7ca89819-f2ac-4a4c-8716-44f9be3a8abf tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] [instance: 510f02a7-afc2-414f-bcd3-c197ffb96641] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:00.866559 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7ca89819-f2ac-4a4c-8716-44f9be3a8abf tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:00.867008 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7ca89819-f2ac-4a4c-8716-44f9be3a8abf tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:00.867783 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7ca89819-f2ac-4a4c-8716-44f9be3a8abf tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:00.868216 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7ca89819-f2ac-4a4c-8716-44f9be3a8abf tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:00.955640 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-507fccf4-321e-4d5a-8d17-3cae2440597f tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:00.956252 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-507fccf4-321e-4d5a-8d17-3cae2440597f tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 2b8da868-71d1-49ad-be95-25d0a41393e9] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:00.962777 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-507fccf4-321e-4d5a-8d17-3cae2440597f tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:00.963230 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-507fccf4-321e-4d5a-8d17-3cae2440597f tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:00.963996 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-507fccf4-321e-4d5a-8d17-3cae2440597f tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:00.965447 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-507fccf4-321e-4d5a-8d17-3cae2440597f tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:01.116653 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-507fccf4-321e-4d5a-8d17-3cae2440597f tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:01.124877 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-507fccf4-321e-4d5a-8d17-3cae2440597f tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9" status: 200 len: 1371 microversion: 2.1 time: 0.173584 Jul 20 19:27:01.125479 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 249/488] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:27:00 2022] GET /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9 => generated 1371 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:27:01.167979 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-7ca89819-f2ac-4a4c-8716-44f9be3a8abf tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ae826a812b44328c48b82e9498ad8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bb4af78c1d4589b1d3cc90d5e6be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:01.175776 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-7ca89819-f2ac-4a4c-8716-44f9be3a8abf tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] 10.222.0.69 "GET /compute/v2.1/servers/510f02a7-afc2-414f-bcd3-c197ffb96641" status: 200 len: 1319 microversion: 2.1 time: 0.323815 Jul 20 19:27:01.176444 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 240/489] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:27:00 2022] GET /compute/v2.1/servers/510f02a7-afc2-414f-bcd3-c197ffb96641 => generated 1319 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:27:02.142345 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-9bf03392-b561-44e4-b47f-2a4ab027f6a6 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:02.142940 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-9bf03392-b561-44e4-b47f-2a4ab027f6a6 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 2b8da868-71d1-49ad-be95-25d0a41393e9] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:02.148958 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9bf03392-b561-44e4-b47f-2a4ab027f6a6 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:02.149402 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9bf03392-b561-44e4-b47f-2a4ab027f6a6 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:02.150184 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9bf03392-b561-44e4-b47f-2a4ab027f6a6 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:02.150614 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9bf03392-b561-44e4-b47f-2a4ab027f6a6 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:02.193171 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-fd706f32-0e5c-4fc5-8bfe-07a757c7ef39 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:02.193817 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-fd706f32-0e5c-4fc5-8bfe-07a757c7ef39 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] [instance: 510f02a7-afc2-414f-bcd3-c197ffb96641] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:02.200988 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fd706f32-0e5c-4fc5-8bfe-07a757c7ef39 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:02.201434 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fd706f32-0e5c-4fc5-8bfe-07a757c7ef39 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:02.202232 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fd706f32-0e5c-4fc5-8bfe-07a757c7ef39 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:02.202665 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fd706f32-0e5c-4fc5-8bfe-07a757c7ef39 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:02.283710 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-9bf03392-b561-44e4-b47f-2a4ab027f6a6 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:02.291767 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-9bf03392-b561-44e4-b47f-2a4ab027f6a6 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9" status: 200 len: 1371 microversion: 2.1 time: 0.153178 Jul 20 19:27:02.292388 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 250/490] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:27:02 2022] GET /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:27:02.342005 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-fd706f32-0e5c-4fc5-8bfe-07a757c7ef39 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ae826a812b44328c48b82e9498ad8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bb4af78c1d4589b1d3cc90d5e6be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:02.349414 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-fd706f32-0e5c-4fc5-8bfe-07a757c7ef39 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] 10.222.0.69 "GET /compute/v2.1/servers/510f02a7-afc2-414f-bcd3-c197ffb96641" status: 200 len: 1319 microversion: 2.1 time: 0.160032 Jul 20 19:27:02.350003 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 241/491] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:27:02 2022] GET /compute/v2.1/servers/510f02a7-afc2-414f-bcd3-c197ffb96641 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:27:03.308608 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-1456d9f5-6e14-41be-b247-741b30204b05 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:03.309226 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-1456d9f5-6e14-41be-b247-741b30204b05 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 2b8da868-71d1-49ad-be95-25d0a41393e9] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:03.317454 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1456d9f5-6e14-41be-b247-741b30204b05 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:03.318018 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1456d9f5-6e14-41be-b247-741b30204b05 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:03.318865 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1456d9f5-6e14-41be-b247-741b30204b05 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:03.319508 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1456d9f5-6e14-41be-b247-741b30204b05 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:03.335537 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_cell1:SELECT=100 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:03.366226 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a2e23532-9f68-4a9d-a027-4f427f9cb1eb tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:03.366769 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a2e23532-9f68-4a9d-a027-4f427f9cb1eb tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] [instance: 510f02a7-afc2-414f-bcd3-c197ffb96641] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:03.373244 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a2e23532-9f68-4a9d-a027-4f427f9cb1eb tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:03.373731 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a2e23532-9f68-4a9d-a027-4f427f9cb1eb tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:03.374512 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a2e23532-9f68-4a9d-a027-4f427f9cb1eb tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:03.374954 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a2e23532-9f68-4a9d-a027-4f427f9cb1eb tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:03.454848 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-1456d9f5-6e14-41be-b247-741b30204b05 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:03.463523 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-1456d9f5-6e14-41be-b247-741b30204b05 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9" status: 200 len: 1371 microversion: 2.1 time: 0.159012 Jul 20 19:27:03.464686 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 251/492] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:27:03 2022] GET /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9 => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:27:03.515529 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a2e23532-9f68-4a9d-a027-4f427f9cb1eb tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ae826a812b44328c48b82e9498ad8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bb4af78c1d4589b1d3cc90d5e6be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:03.523529 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a2e23532-9f68-4a9d-a027-4f427f9cb1eb tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] 10.222.0.69 "GET /compute/v2.1/servers/510f02a7-afc2-414f-bcd3-c197ffb96641" status: 200 len: 1507 microversion: 2.1 time: 0.161297 Jul 20 19:27:03.524100 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 242/493] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:27:03 2022] GET /compute/v2.1/servers/510f02a7-afc2-414f-bcd3-c197ffb96641 => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:27:04.482458 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-8ce609ba-036a-42b7-930a-519d5d9d4605 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:04.482980 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-8ce609ba-036a-42b7-930a-519d5d9d4605 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 2b8da868-71d1-49ad-be95-25d0a41393e9] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:04.488929 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8ce609ba-036a-42b7-930a-519d5d9d4605 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:04.489370 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8ce609ba-036a-42b7-930a-519d5d9d4605 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:04.490150 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8ce609ba-036a-42b7-930a-519d5d9d4605 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:04.490579 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8ce609ba-036a-42b7-930a-519d5d9d4605 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:04.624385 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-8ce609ba-036a-42b7-930a-519d5d9d4605 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:04.631989 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-8ce609ba-036a-42b7-930a-519d5d9d4605 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9" status: 200 len: 1371 microversion: 2.1 time: 0.154147 Jul 20 19:27:04.632555 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 252/494] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:27:04 2022] GET /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9 => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:27:05.650495 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4e6b8ccf-d06b-42d2-92ce-d0462b1ff518 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:05.651112 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-4e6b8ccf-d06b-42d2-92ce-d0462b1ff518 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 2b8da868-71d1-49ad-be95-25d0a41393e9] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:05.657894 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4e6b8ccf-d06b-42d2-92ce-d0462b1ff518 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:05.658347 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4e6b8ccf-d06b-42d2-92ce-d0462b1ff518 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:05.659124 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4e6b8ccf-d06b-42d2-92ce-d0462b1ff518 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:05.659561 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4e6b8ccf-d06b-42d2-92ce-d0462b1ff518 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:05.793139 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-4e6b8ccf-d06b-42d2-92ce-d0462b1ff518 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:05.801209 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-4e6b8ccf-d06b-42d2-92ce-d0462b1ff518 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9" status: 200 len: 1371 microversion: 2.1 time: 0.154683 Jul 20 19:27:05.801870 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 243/495] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:27:05 2022] GET /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9 => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:27:06.819783 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-d6ec88e6-3635-4dc4-b356-9de9ff9e9f0d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:06.820397 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-d6ec88e6-3635-4dc4-b356-9de9ff9e9f0d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 2b8da868-71d1-49ad-be95-25d0a41393e9] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:06.827342 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d6ec88e6-3635-4dc4-b356-9de9ff9e9f0d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:06.827788 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d6ec88e6-3635-4dc4-b356-9de9ff9e9f0d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:06.828555 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d6ec88e6-3635-4dc4-b356-9de9ff9e9f0d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:06.828988 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d6ec88e6-3635-4dc4-b356-9de9ff9e9f0d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:06.966324 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-d6ec88e6-3635-4dc4-b356-9de9ff9e9f0d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:06.973873 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-d6ec88e6-3635-4dc4-b356-9de9ff9e9f0d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9" status: 200 len: 1371 microversion: 2.1 time: 0.158872 Jul 20 19:27:06.974464 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 253/496] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:27:06 2022] GET /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9 => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:27:07.991465 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d144b1fa-4fb9-4ef6-9f2f-93fa096ff330 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:07.992069 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d144b1fa-4fb9-4ef6-9f2f-93fa096ff330 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 2b8da868-71d1-49ad-be95-25d0a41393e9] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:07.994479 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell0:SELECT=2 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:07.995141 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell0:SELECT=10 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:08.000956 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d144b1fa-4fb9-4ef6-9f2f-93fa096ff330 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:08.001429 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d144b1fa-4fb9-4ef6-9f2f-93fa096ff330 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:08.002220 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d144b1fa-4fb9-4ef6-9f2f-93fa096ff330 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:08.002656 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d144b1fa-4fb9-4ef6-9f2f-93fa096ff330 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:08.135941 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d144b1fa-4fb9-4ef6-9f2f-93fa096ff330 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:08.144096 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d144b1fa-4fb9-4ef6-9f2f-93fa096ff330 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9" status: 200 len: 1371 microversion: 2.1 time: 0.156484 Jul 20 19:27:08.144648 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 244/497] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:27:07 2022] GET /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9 => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:27:09.161353 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-9527644b-80ae-43d7-86f4-f8e322ba5a34 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:09.161977 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-9527644b-80ae-43d7-86f4-f8e322ba5a34 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 2b8da868-71d1-49ad-be95-25d0a41393e9] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:09.163805 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_cell0:SELECT=2 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:09.169980 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9527644b-80ae-43d7-86f4-f8e322ba5a34 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:09.170403 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9527644b-80ae-43d7-86f4-f8e322ba5a34 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:09.171173 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9527644b-80ae-43d7-86f4-f8e322ba5a34 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:09.171608 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9527644b-80ae-43d7-86f4-f8e322ba5a34 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:09.304076 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-9527644b-80ae-43d7-86f4-f8e322ba5a34 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:09.312149 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-9527644b-80ae-43d7-86f4-f8e322ba5a34 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9" status: 200 len: 1371 microversion: 2.1 time: 0.154660 Jul 20 19:27:09.312710 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 254/498] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:27:09 2022] GET /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9 => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:27:10.329927 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-2bd8129f-4662-4776-85cb-824f6efed48b tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:10.330537 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-2bd8129f-4662-4776-85cb-824f6efed48b tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 2b8da868-71d1-49ad-be95-25d0a41393e9] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:10.337932 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2bd8129f-4662-4776-85cb-824f6efed48b tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:10.338371 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2bd8129f-4662-4776-85cb-824f6efed48b tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:10.339134 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2bd8129f-4662-4776-85cb-824f6efed48b tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:10.339561 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2bd8129f-4662-4776-85cb-824f6efed48b tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:10.343279 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:10.488151 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-2bd8129f-4662-4776-85cb-824f6efed48b tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:10.500774 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-2bd8129f-4662-4776-85cb-824f6efed48b tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9" status: 200 len: 1371 microversion: 2.1 time: 0.174159 Jul 20 19:27:10.500774 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 245/499] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:27:10 2022] GET /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9 => generated 1371 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:27:11.517992 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-58c0883b-cfab-4fa7-905e-5f10b4772735 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:11.518610 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-58c0883b-cfab-4fa7-905e-5f10b4772735 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 2b8da868-71d1-49ad-be95-25d0a41393e9] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:11.524478 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-58c0883b-cfab-4fa7-905e-5f10b4772735 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:11.524930 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-58c0883b-cfab-4fa7-905e-5f10b4772735 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:11.525720 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-58c0883b-cfab-4fa7-905e-5f10b4772735 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:11.526161 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-58c0883b-cfab-4fa7-905e-5f10b4772735 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:11.666558 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-58c0883b-cfab-4fa7-905e-5f10b4772735 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:11.674080 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-58c0883b-cfab-4fa7-905e-5f10b4772735 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9" status: 200 len: 1371 microversion: 2.1 time: 0.160625 Jul 20 19:27:11.674641 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 255/500] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:27:11 2022] GET /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9 => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:27:11.768401 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 19:27:11.768654 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: Wed Jul 20 19:27:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 19:27:12.690890 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-7a123980-84da-4ebd-a891-ac26820a0292 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:12.691637 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-7a123980-84da-4ebd-a891-ac26820a0292 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 2b8da868-71d1-49ad-be95-25d0a41393e9] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:12.699013 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7a123980-84da-4ebd-a891-ac26820a0292 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:12.699463 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7a123980-84da-4ebd-a891-ac26820a0292 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:12.700273 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7a123980-84da-4ebd-a891-ac26820a0292 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:12.700704 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7a123980-84da-4ebd-a891-ac26820a0292 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:12.833013 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-7a123980-84da-4ebd-a891-ac26820a0292 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:12.840688 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-7a123980-84da-4ebd-a891-ac26820a0292 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9" status: 200 len: 1371 microversion: 2.1 time: 0.153819 Jul 20 19:27:12.841251 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 246/501] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:27:12 2022] GET /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9 => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:27:13.859900 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-8e44c25e-a7b0-443b-b8dd-984d3cd25026 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:13.859900 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-8e44c25e-a7b0-443b-b8dd-984d3cd25026 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 2b8da868-71d1-49ad-be95-25d0a41393e9] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:13.861228 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_api:SELECT=50 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:13.868230 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8e44c25e-a7b0-443b-b8dd-984d3cd25026 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:13.868681 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8e44c25e-a7b0-443b-b8dd-984d3cd25026 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:13.869451 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8e44c25e-a7b0-443b-b8dd-984d3cd25026 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:13.869906 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8e44c25e-a7b0-443b-b8dd-984d3cd25026 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:14.006801 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-8e44c25e-a7b0-443b-b8dd-984d3cd25026 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:14.014856 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-8e44c25e-a7b0-443b-b8dd-984d3cd25026 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9" status: 200 len: 1371 microversion: 2.1 time: 0.160496 Jul 20 19:27:14.015411 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 256/502] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:27:13 2022] GET /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9 => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:27:15.032144 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-86734bdc-81b7-4e62-bad2-77448c4268a3 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:15.032781 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-86734bdc-81b7-4e62-bad2-77448c4268a3 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 2b8da868-71d1-49ad-be95-25d0a41393e9] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:15.035088 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=7 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:15.040746 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-86734bdc-81b7-4e62-bad2-77448c4268a3 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:15.041191 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-86734bdc-81b7-4e62-bad2-77448c4268a3 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:15.041983 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-86734bdc-81b7-4e62-bad2-77448c4268a3 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:15.042474 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-86734bdc-81b7-4e62-bad2-77448c4268a3 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:15.179186 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-86734bdc-81b7-4e62-bad2-77448c4268a3 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:15.186808 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-86734bdc-81b7-4e62-bad2-77448c4268a3 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9" status: 200 len: 1371 microversion: 2.1 time: 0.159186 Jul 20 19:27:15.187450 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 247/503] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:27:15 2022] GET /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9 => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:27:16.203711 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-318a541a-85f7-4ed4-b92a-2b07b6dfdd87 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:16.204415 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-318a541a-85f7-4ed4-b92a-2b07b6dfdd87 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 2b8da868-71d1-49ad-be95-25d0a41393e9] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:16.210397 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-318a541a-85f7-4ed4-b92a-2b07b6dfdd87 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:16.210838 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-318a541a-85f7-4ed4-b92a-2b07b6dfdd87 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:16.211579 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-318a541a-85f7-4ed4-b92a-2b07b6dfdd87 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:16.212004 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-318a541a-85f7-4ed4-b92a-2b07b6dfdd87 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:16.347176 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-318a541a-85f7-4ed4-b92a-2b07b6dfdd87 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:16.354681 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-318a541a-85f7-4ed4-b92a-2b07b6dfdd87 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9" status: 200 len: 1371 microversion: 2.1 time: 0.154769 Jul 20 19:27:16.355252 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 257/504] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:27:16 2022] GET /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9 => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:27:17.371681 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c610ca7b-6ebe-4899-8f89-081c64538b71 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:17.372864 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c610ca7b-6ebe-4899-8f89-081c64538b71 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 2b8da868-71d1-49ad-be95-25d0a41393e9] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:17.379457 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c610ca7b-6ebe-4899-8f89-081c64538b71 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:17.379900 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c610ca7b-6ebe-4899-8f89-081c64538b71 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:17.380659 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c610ca7b-6ebe-4899-8f89-081c64538b71 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:17.381086 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c610ca7b-6ebe-4899-8f89-081c64538b71 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:17.514379 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c610ca7b-6ebe-4899-8f89-081c64538b71 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:17.522926 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c610ca7b-6ebe-4899-8f89-081c64538b71 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9" status: 200 len: 1371 microversion: 2.1 time: 0.154925 Jul 20 19:27:17.523549 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 248/505] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:27:17 2022] GET /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9 => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:27:18.540751 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-9341c9c0-b1cd-4767-8dbf-49c079c4f683 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:18.541354 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-9341c9c0-b1cd-4767-8dbf-49c079c4f683 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 2b8da868-71d1-49ad-be95-25d0a41393e9] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:18.547470 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9341c9c0-b1cd-4767-8dbf-49c079c4f683 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:18.547920 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9341c9c0-b1cd-4767-8dbf-49c079c4f683 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:18.548733 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9341c9c0-b1cd-4767-8dbf-49c079c4f683 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:18.549115 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9341c9c0-b1cd-4767-8dbf-49c079c4f683 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:18.682460 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-9341c9c0-b1cd-4767-8dbf-49c079c4f683 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:18.690777 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-9341c9c0-b1cd-4767-8dbf-49c079c4f683 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9" status: 200 len: 1371 microversion: 2.1 time: 0.153870 Jul 20 19:27:18.691336 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 258/506] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:27:18 2022] GET /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9 => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:27:19.708920 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e86b940d-d849-48ba-8502-804d20f5b9b7 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:19.709551 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e86b940d-d849-48ba-8502-804d20f5b9b7 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 2b8da868-71d1-49ad-be95-25d0a41393e9] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:19.716358 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e86b940d-d849-48ba-8502-804d20f5b9b7 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:19.716826 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e86b940d-d849-48ba-8502-804d20f5b9b7 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:19.717603 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e86b940d-d849-48ba-8502-804d20f5b9b7 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:19.718043 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e86b940d-d849-48ba-8502-804d20f5b9b7 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:19.853077 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e86b940d-d849-48ba-8502-804d20f5b9b7 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:19.860757 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e86b940d-d849-48ba-8502-804d20f5b9b7 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9" status: 200 len: 1371 microversion: 2.1 time: 0.156948 Jul 20 19:27:19.861326 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 249/507] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:27:19 2022] GET /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9 => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:27:20.877583 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-99f55532-ccde-41eb-a0ab-65844c53c59d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:20.878281 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-99f55532-ccde-41eb-a0ab-65844c53c59d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 2b8da868-71d1-49ad-be95-25d0a41393e9] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:20.884361 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-99f55532-ccde-41eb-a0ab-65844c53c59d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:20.884810 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-99f55532-ccde-41eb-a0ab-65844c53c59d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:20.885584 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-99f55532-ccde-41eb-a0ab-65844c53c59d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:20.886012 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-99f55532-ccde-41eb-a0ab-65844c53c59d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:21.022736 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-99f55532-ccde-41eb-a0ab-65844c53c59d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:21.030118 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-99f55532-ccde-41eb-a0ab-65844c53c59d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9" status: 200 len: 1371 microversion: 2.1 time: 0.156740 Jul 20 19:27:21.030667 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 259/508] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:27:20 2022] GET /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9 => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:27:22.047460 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-74184165-f2ca-4378-bb43-11691786fa42 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:22.048080 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-74184165-f2ca-4378-bb43-11691786fa42 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 2b8da868-71d1-49ad-be95-25d0a41393e9] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:22.055811 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-74184165-f2ca-4378-bb43-11691786fa42 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:22.056327 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-74184165-f2ca-4378-bb43-11691786fa42 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:22.057118 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-74184165-f2ca-4378-bb43-11691786fa42 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:22.057586 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-74184165-f2ca-4378-bb43-11691786fa42 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:22.191551 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-74184165-f2ca-4378-bb43-11691786fa42 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:22.198899 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-74184165-f2ca-4378-bb43-11691786fa42 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9" status: 200 len: 1371 microversion: 2.1 time: 0.155323 Jul 20 19:27:22.199461 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 250/509] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:27:22 2022] GET /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9 => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:27:23.216108 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-55ec9a0b-8326-4fe1-ac88-c615c79170ee tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:23.216748 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-55ec9a0b-8326-4fe1-ac88-c615c79170ee tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 2b8da868-71d1-49ad-be95-25d0a41393e9] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:23.223967 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-55ec9a0b-8326-4fe1-ac88-c615c79170ee tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:23.224449 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-55ec9a0b-8326-4fe1-ac88-c615c79170ee tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:23.225133 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-55ec9a0b-8326-4fe1-ac88-c615c79170ee tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:23.225597 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-55ec9a0b-8326-4fe1-ac88-c615c79170ee tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:23.363072 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-55ec9a0b-8326-4fe1-ac88-c615c79170ee tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:23.370712 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-55ec9a0b-8326-4fe1-ac88-c615c79170ee tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9" status: 200 len: 1371 microversion: 2.1 time: 0.158820 Jul 20 19:27:23.371276 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 260/510] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:27:23 2022] GET /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9 => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:27:24.387973 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-312d1ec7-5708-4b28-ab2a-84de9c1379ee tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:24.388722 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-312d1ec7-5708-4b28-ab2a-84de9c1379ee tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 2b8da868-71d1-49ad-be95-25d0a41393e9] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:24.396350 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-312d1ec7-5708-4b28-ab2a-84de9c1379ee tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:24.396699 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-312d1ec7-5708-4b28-ab2a-84de9c1379ee tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:24.397425 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-312d1ec7-5708-4b28-ab2a-84de9c1379ee tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:24.397901 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-312d1ec7-5708-4b28-ab2a-84de9c1379ee tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:24.506343 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [req-7f65fdc9-5359-4987-ba61-187b0f5f7716 req-b4d28f35-11ad-4f5d-bce0-e6b27322c1ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b8da868-71d1-49ad-be95-25d0a41393e9", "name": "network-vif-plugged", "status": "completed", "tag": "e1440571-e796-4c28-8091-6adb4bfa88b0"}]} {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:27:24.516980 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [req-7f65fdc9-5359-4987-ba61-187b0f5f7716 req-b4d28f35-11ad-4f5d-bce0-e6b27322c1ee service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:24.519024 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [req-7f65fdc9-5359-4987-ba61-187b0f5f7716 req-b4d28f35-11ad-4f5d-bce0-e6b27322c1ee service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:24.529578 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-312d1ec7-5708-4b28-ab2a-84de9c1379ee tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:24.531990 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.compute.server_external_events [req-7f65fdc9-5359-4987-ba61-187b0f5f7716 req-b4d28f35-11ad-4f5d-bce0-e6b27322c1ee service nova] Creating event network-vif-plugged:e1440571-e796-4c28-8091-6adb4bfa88b0 for instance 2b8da868-71d1-49ad-be95-25d0a41393e9 on hv-cinder-83538 Jul 20 19:27:24.537231 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [req-7f65fdc9-5359-4987-ba61-187b0f5f7716 req-b4d28f35-11ad-4f5d-bce0-e6b27322c1ee service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036048 Jul 20 19:27:24.538217 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 261/511] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 19:27:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:27:24.539484 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-312d1ec7-5708-4b28-ab2a-84de9c1379ee tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9" status: 200 len: 1371 microversion: 2.1 time: 0.155448 Jul 20 19:27:24.540157 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 251/512] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:27:24 2022] GET /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9 => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:27:25.557445 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-08a3d846-3d75-4064-af13-8cf92aae52e2 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:25.558211 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-08a3d846-3d75-4064-af13-8cf92aae52e2 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 2b8da868-71d1-49ad-be95-25d0a41393e9] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:25.565114 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-08a3d846-3d75-4064-af13-8cf92aae52e2 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:25.565641 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-08a3d846-3d75-4064-af13-8cf92aae52e2 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:25.566793 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-08a3d846-3d75-4064-af13-8cf92aae52e2 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:25.566923 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-08a3d846-3d75-4064-af13-8cf92aae52e2 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:25.929804 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-08a3d846-3d75-4064-af13-8cf92aae52e2 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:25.938436 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-08a3d846-3d75-4064-af13-8cf92aae52e2 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9" status: 200 len: 1371 microversion: 2.1 time: 0.385759 Jul 20 19:27:25.938997 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 262/513] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:27:25 2022] GET /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9 => generated 1371 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:27:26.955532 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-bc4f0b8d-87b5-43d2-a57b-f1ec66d73cfd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:26.956920 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-bc4f0b8d-87b5-43d2-a57b-f1ec66d73cfd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 2b8da868-71d1-49ad-be95-25d0a41393e9] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:26.963468 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bc4f0b8d-87b5-43d2-a57b-f1ec66d73cfd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:26.963917 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bc4f0b8d-87b5-43d2-a57b-f1ec66d73cfd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:26.964937 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bc4f0b8d-87b5-43d2-a57b-f1ec66d73cfd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:26.965374 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bc4f0b8d-87b5-43d2-a57b-f1ec66d73cfd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:27.094005 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-bc4f0b8d-87b5-43d2-a57b-f1ec66d73cfd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:27.101907 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-bc4f0b8d-87b5-43d2-a57b-f1ec66d73cfd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9" status: 200 len: 1371 microversion: 2.1 time: 0.150301 Jul 20 19:27:27.102464 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 252/514] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:27:26 2022] GET /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9 => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:27:28.118986 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-6cf115a7-cc59-45d1-a100-08a503b59bbd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:28.119522 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-6cf115a7-cc59-45d1-a100-08a503b59bbd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 2b8da868-71d1-49ad-be95-25d0a41393e9] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:28.125548 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-6cf115a7-cc59-45d1-a100-08a503b59bbd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:28.125999 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-6cf115a7-cc59-45d1-a100-08a503b59bbd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:28.126750 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-6cf115a7-cc59-45d1-a100-08a503b59bbd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:28.127205 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-6cf115a7-cc59-45d1-a100-08a503b59bbd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:28.255265 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-6cf115a7-cc59-45d1-a100-08a503b59bbd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:28.262659 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-6cf115a7-cc59-45d1-a100-08a503b59bbd tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9" status: 200 len: 1564 microversion: 2.1 time: 0.147674 Jul 20 19:27:28.263379 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 263/515] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:27:28 2022] GET /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9 => generated 1564 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:27:28.279891 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4cf4ae02-c198-4ac3-9124-d707619a3dc3 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:28.280397 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-4cf4ae02-c198-4ac3-9124-d707619a3dc3 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 2b8da868-71d1-49ad-be95-25d0a41393e9] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:28.288040 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4cf4ae02-c198-4ac3-9124-d707619a3dc3 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:28.288490 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4cf4ae02-c198-4ac3-9124-d707619a3dc3 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:28.289453 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4cf4ae02-c198-4ac3-9124-d707619a3dc3 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:28.290248 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4cf4ae02-c198-4ac3-9124-d707619a3dc3 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:28.380904 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-4cf4ae02-c198-4ac3-9124-d707619a3dc3 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.104873 Jul 20 19:27:28.381553 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 253/516] 10.222.0.69 () {58 vars in 1274 bytes} [Wed Jul 20 19:27:28 2022] GET /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:27:29.618865 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [req-2d1d4d43-6286-4f38-b2c4-d02a21ef96f8 req-dea5a019-af81-4969-a588-36f8c1789dc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b8da868-71d1-49ad-be95-25d0a41393e9", "tag": "e1440571-e796-4c28-8091-6adb4bfa88b0"}]} {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:27:29.629823 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [req-2d1d4d43-6286-4f38-b2c4-d02a21ef96f8 req-dea5a019-af81-4969-a588-36f8c1789dc8 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:29.630265 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [req-2d1d4d43-6286-4f38-b2c4-d02a21ef96f8 req-dea5a019-af81-4969-a588-36f8c1789dc8 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:29.642374 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.compute.server_external_events [req-2d1d4d43-6286-4f38-b2c4-d02a21ef96f8 req-dea5a019-af81-4969-a588-36f8c1789dc8 service nova] Creating event network-changed:e1440571-e796-4c28-8091-6adb4bfa88b0 for instance 2b8da868-71d1-49ad-be95-25d0a41393e9 on hv-cinder-83538 Jul 20 19:27:29.648179 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [req-2d1d4d43-6286-4f38-b2c4-d02a21ef96f8 req-dea5a019-af81-4969-a588-36f8c1789dc8 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033686 Jul 20 19:27:29.648928 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 264/517] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 19:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:28:06.770836 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_api:SELECT=13 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:06.771688 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=51 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:06.776165 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-dea2ff78-2bb9-4199-bf2d-3017244177e9 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0935d64f-99b4-4652-b08e-2177092fd043", "device": "/dev/sdb"}} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:28:06.777761 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-dea2ff78-2bb9-4199-bf2d-3017244177e9 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] [instance: 510f02a7-afc2-414f-bcd3-c197ffb96641] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:06.786064 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-dea2ff78-2bb9-4199-bf2d-3017244177e9 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:06.786509 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-dea2ff78-2bb9-4199-bf2d-3017244177e9 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:06.787276 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-dea2ff78-2bb9-4199-bf2d-3017244177e9 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:06.787704 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-dea2ff78-2bb9-4199-bf2d-3017244177e9 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:07.050256 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-dea2ff78-2bb9-4199-bf2d-3017244177e9 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] 10.222.0.69 "POST /compute/v2.1/servers/510f02a7-afc2-414f-bcd3-c197ffb96641/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280849 Jul 20 19:28:07.050862 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 254/518] 10.222.0.69 () {60 vars in 1322 bytes} [Wed Jul 20 19:28:06 2022] POST /compute/v2.1/servers/510f02a7-afc2-414f-bcd3-c197ffb96641/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:28:18.406094 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_api:SELECT=17 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:18.406851 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_cell1:SELECT=73 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:18.415124 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-e98fac5f-d054-4631-98c5-5d308e5b0017 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:28:18.416699 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-e98fac5f-d054-4631-98c5-5d308e5b0017 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:18.425322 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e98fac5f-d054-4631-98c5-5d308e5b0017 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:18.426035 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e98fac5f-d054-4631-98c5-5d308e5b0017 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:18.427301 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e98fac5f-d054-4631-98c5-5d308e5b0017 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:18.428244 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e98fac5f-d054-4631-98c5-5d308e5b0017 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:18.555943 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-e98fac5f-d054-4631-98c5-5d308e5b0017 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "POST /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a/action" status: 200 len: 28652 microversion: 2.1 time: 0.150963 Jul 20 19:28:18.556698 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 265/519] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Jul 20 19:28:18 2022] POST /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a/action => generated 28652 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 19:28:20.460490 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_api:SELECT=2 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:20.462214 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:20.468871 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e98c7311-458f-49a3-a7d9-2cb8e1480482 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:28:20.470382 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e98c7311-458f-49a3-a7d9-2cb8e1480482 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:20.481081 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e98c7311-458f-49a3-a7d9-2cb8e1480482 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:20.481995 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e98c7311-458f-49a3-a7d9-2cb8e1480482 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:20.483108 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e98c7311-458f-49a3-a7d9-2cb8e1480482 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:20.483723 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e98c7311-458f-49a3-a7d9-2cb8e1480482 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:23.819526 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e98c7311-458f-49a3-a7d9-2cb8e1480482 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "POST /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55/action" status: 200 len: 28628 microversion: 2.20 time: 3.366960 Jul 20 19:28:23.826468 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 255/520] 10.222.0.69 () {62 vars in 1318 bytes} [Wed Jul 20 19:28:20 2022] POST /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55/action => generated 28628 bytes in 3375 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 20 19:28:27.403682 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-d862de41-8556-46f1-9849-4ba680118fb8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Action: 'create', calling method: .version_select at 0x7ff60a399550>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-495469876", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDcc8IUpdoDouvR0I+aPE0S6Lf6h9i/3P1M9u3O2WWddlsXCcaHwNr3QYmBEzY8qB55njQjrcdzAbRFsPwX6u6KNCKiriERPx8yB5OpE4zPuwrxHvuferr37yJTGQfQ3Pw=="}} {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:28:27.420916 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.quota [None req-d862de41-8556-46f1-9849-4ba680118fb8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Getting quotas for project 8064950f9a1942149aa8d6c08c206850. Resources: {'key_pairs'} {{(pid=117762) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:28:27.426578 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.quota [None req-d862de41-8556-46f1-9849-4ba680118fb8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Getting quotas for user 8c67fe170c60476d88610d85f2528c52 and project 8064950f9a1942149aa8d6c08c206850. Resources: {'key_pairs'} {{(pid=117762) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:28:27.463305 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-d862de41-8556-46f1-9849-4ba680118fb8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.261167 Jul 20 19:28:27.464170 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 266/521] 10.222.0.69 () {60 vars in 1158 bytes} [Wed Jul 20 19:28:27 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:28:43.415291 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-51ca8e23-8db6-434d-9000-0069964d2774 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:43.416011 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-51ca8e23-8db6-434d-9000-0069964d2774 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] [instance: 510f02a7-afc2-414f-bcd3-c197ffb96641] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:43.423713 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_api:SELECT=2 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:43.424560 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=4 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:43.427578 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-51ca8e23-8db6-434d-9000-0069964d2774 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:43.428292 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-51ca8e23-8db6-434d-9000-0069964d2774 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:43.429297 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-51ca8e23-8db6-434d-9000-0069964d2774 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:43.429927 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-51ca8e23-8db6-434d-9000-0069964d2774 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:43.849750 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.objects.instance [None req-51ca8e23-8db6-434d-9000-0069964d2774 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lazy-loading 'services' on Instance uuid 510f02a7-afc2-414f-bcd3-c197ffb96641 {{(pid=117761) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:28:44.026495 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-51ca8e23-8db6-434d-9000-0069964d2774 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] 10.222.0.69 "DELETE /compute/v2.1/servers/510f02a7-afc2-414f-bcd3-c197ffb96641/os-volume_attachments/0935d64f-99b4-4652-b08e-2177092fd043" status: 202 len: 0 microversion: 2.1 time: 0.616496 Jul 20 19:28:44.027526 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 256/522] 10.222.0.69 () {58 vars in 1415 bytes} [Wed Jul 20 19:28:43 2022] DELETE /compute/v2.1/servers/510f02a7-afc2-414f-bcd3-c197ffb96641/os-volume_attachments/0935d64f-99b4-4652-b08e-2177092fd043 => generated 0 bytes in 619 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 19:28:46.270822 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-f5dead6d-b269-49c9-a970-7ffa1951d9c9 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:46.272121 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-f5dead6d-b269-49c9-a970-7ffa1951d9c9 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] [instance: 510f02a7-afc2-414f-bcd3-c197ffb96641] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:46.274957 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_cell1:SELECT=4 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:46.276496 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_cell0:SELECT=4 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:46.277832 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:46.287914 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f5dead6d-b269-49c9-a970-7ffa1951d9c9 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:46.288842 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f5dead6d-b269-49c9-a970-7ffa1951d9c9 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:46.289816 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f5dead6d-b269-49c9-a970-7ffa1951d9c9 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:46.290445 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f5dead6d-b269-49c9-a970-7ffa1951d9c9 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:46.324499 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-f5dead6d-b269-49c9-a970-7ffa1951d9c9 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] [instance: 510f02a7-afc2-414f-bcd3-c197ffb96641] Going to try to terminate instance {{(pid=117762) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 19:28:46.434353 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-f5dead6d-b269-49c9-a970-7ffa1951d9c9 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] 10.222.0.69 "DELETE /compute/v2.1/servers/510f02a7-afc2-414f-bcd3-c197ffb96641" status: 204 len: 0 microversion: 2.1 time: 0.167789 Jul 20 19:28:46.435400 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 267/523] 10.222.0.69 () {58 vars in 1238 bytes} [Wed Jul 20 19:28:46 2022] DELETE /compute/v2.1/servers/510f02a7-afc2-414f-bcd3-c197ffb96641 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 19:28:46.445702 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-699e6930-9e60-4960-ace3-0b4befc9a4f4 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:46.446394 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-699e6930-9e60-4960-ace3-0b4befc9a4f4 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] [instance: 510f02a7-afc2-414f-bcd3-c197ffb96641] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:46.454259 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-699e6930-9e60-4960-ace3-0b4befc9a4f4 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:46.454719 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-699e6930-9e60-4960-ace3-0b4befc9a4f4 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:46.455625 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-699e6930-9e60-4960-ace3-0b4befc9a4f4 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:46.457159 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-699e6930-9e60-4960-ace3-0b4befc9a4f4 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:46.645377 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-699e6930-9e60-4960-ace3-0b4befc9a4f4 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ae826a812b44328c48b82e9498ad8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bb4af78c1d4589b1d3cc90d5e6be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:46.655937 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-699e6930-9e60-4960-ace3-0b4befc9a4f4 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] 10.222.0.69 "GET /compute/v2.1/servers/510f02a7-afc2-414f-bcd3-c197ffb96641" status: 200 len: 1513 microversion: 2.1 time: 0.215933 Jul 20 19:28:46.662702 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 257/524] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:46 2022] GET /compute/v2.1/servers/510f02a7-afc2-414f-bcd3-c197ffb96641 => generated 1513 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:28:47.674388 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-eb9318e2-c16b-4479-ba22-3c7f7e0619b5 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:47.675086 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-eb9318e2-c16b-4479-ba22-3c7f7e0619b5 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] [instance: 510f02a7-afc2-414f-bcd3-c197ffb96641] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:47.681694 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-eb9318e2-c16b-4479-ba22-3c7f7e0619b5 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:47.682502 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-eb9318e2-c16b-4479-ba22-3c7f7e0619b5 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:47.683453 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-eb9318e2-c16b-4479-ba22-3c7f7e0619b5 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:47.683884 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-eb9318e2-c16b-4479-ba22-3c7f7e0619b5 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:48.173315 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-eb9318e2-c16b-4479-ba22-3c7f7e0619b5 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ae826a812b44328c48b82e9498ad8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bb4af78c1d4589b1d3cc90d5e6be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:48.186101 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-eb9318e2-c16b-4479-ba22-3c7f7e0619b5 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] 10.222.0.69 "GET /compute/v2.1/servers/510f02a7-afc2-414f-bcd3-c197ffb96641" status: 200 len: 1513 microversion: 2.1 time: 0.515377 Jul 20 19:28:48.187057 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 268/525] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:47 2022] GET /compute/v2.1/servers/510f02a7-afc2-414f-bcd3-c197ffb96641 => generated 1513 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:49.205826 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-95f96f50-20a9-4ffe-a0b4-c9f359aad3a0 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:49.206584 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-95f96f50-20a9-4ffe-a0b4-c9f359aad3a0 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] [instance: 510f02a7-afc2-414f-bcd3-c197ffb96641] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:49.214286 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-95f96f50-20a9-4ffe-a0b4-c9f359aad3a0 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:49.215073 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-95f96f50-20a9-4ffe-a0b4-c9f359aad3a0 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:49.216115 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-95f96f50-20a9-4ffe-a0b4-c9f359aad3a0 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:49.216767 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-95f96f50-20a9-4ffe-a0b4-c9f359aad3a0 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:49.591411 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-95f96f50-20a9-4ffe-a0b4-c9f359aad3a0 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ae826a812b44328c48b82e9498ad8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bb4af78c1d4589b1d3cc90d5e6be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:49.605154 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-95f96f50-20a9-4ffe-a0b4-c9f359aad3a0 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] 10.222.0.69 "GET /compute/v2.1/servers/510f02a7-afc2-414f-bcd3-c197ffb96641" status: 200 len: 1513 microversion: 2.1 time: 0.403244 Jul 20 19:28:49.606354 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 258/526] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:49 2022] GET /compute/v2.1/servers/510f02a7-afc2-414f-bcd3-c197ffb96641 => generated 1513 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:50.623798 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-86cf5e34-45c5-4408-be00-b00ec2eb9bbc tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:50.625003 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-86cf5e34-45c5-4408-be00-b00ec2eb9bbc tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] [instance: 510f02a7-afc2-414f-bcd3-c197ffb96641] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:50.632151 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-86cf5e34-45c5-4408-be00-b00ec2eb9bbc tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:50.632767 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-86cf5e34-45c5-4408-be00-b00ec2eb9bbc tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:50.633962 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-86cf5e34-45c5-4408-be00-b00ec2eb9bbc tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:50.634567 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-86cf5e34-45c5-4408-be00-b00ec2eb9bbc tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:50.826338 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-86cf5e34-45c5-4408-be00-b00ec2eb9bbc tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ae826a812b44328c48b82e9498ad8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bb4af78c1d4589b1d3cc90d5e6be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:50.836950 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-86cf5e34-45c5-4408-be00-b00ec2eb9bbc tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] 10.222.0.69 "GET /compute/v2.1/servers/510f02a7-afc2-414f-bcd3-c197ffb96641" status: 200 len: 1513 microversion: 2.1 time: 0.217200 Jul 20 19:28:50.840046 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 269/527] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:50 2022] GET /compute/v2.1/servers/510f02a7-afc2-414f-bcd3-c197ffb96641 => generated 1513 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:50.964224 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [req-59e51302-a17d-4464-9e95-7a76ff9c3173 req-26950e9b-6b89-4923-88da-a12a6de3d97d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "510f02a7-afc2-414f-bcd3-c197ffb96641", "name": "network-vif-deleted", "tag": "e64bdd40-7e1f-4934-b9d4-0a7819f5121f"}]} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:28:50.984747 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-59e51302-a17d-4464-9e95-7a76ff9c3173 req-26950e9b-6b89-4923-88da-a12a6de3d97d service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:50.985983 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-59e51302-a17d-4464-9e95-7a76ff9c3173 req-26950e9b-6b89-4923-88da-a12a6de3d97d service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:51.017643 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.compute.server_external_events [req-59e51302-a17d-4464-9e95-7a76ff9c3173 req-26950e9b-6b89-4923-88da-a12a6de3d97d service nova] Creating event network-vif-deleted:e64bdd40-7e1f-4934-b9d4-0a7819f5121f for instance 510f02a7-afc2-414f-bcd3-c197ffb96641 on hv-cinder-83538 Jul 20 19:28:51.033150 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [req-59e51302-a17d-4464-9e95-7a76ff9c3173 req-26950e9b-6b89-4923-88da-a12a6de3d97d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075585 Jul 20 19:28:51.034755 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 259/528] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 19:28:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:28:51.862997 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-1ea063a5-f20c-4044-9c91-8850250a0d1c tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:51.863982 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-1ea063a5-f20c-4044-9c91-8850250a0d1c tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] [instance: 510f02a7-afc2-414f-bcd3-c197ffb96641] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:51.877548 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1ea063a5-f20c-4044-9c91-8850250a0d1c tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:51.878196 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1ea063a5-f20c-4044-9c91-8850250a0d1c tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:51.879085 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1ea063a5-f20c-4044-9c91-8850250a0d1c tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:51.879522 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1ea063a5-f20c-4044-9c91-8850250a0d1c tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:51.895541 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.wsgi [None req-1ea063a5-f20c-4044-9c91-8850250a0d1c tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] HTTP exception thrown: Instance 510f02a7-afc2-414f-bcd3-c197ffb96641 could not be found. Jul 20 19:28:51.897537 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-1ea063a5-f20c-4044-9c91-8850250a0d1c tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Request method failure captured: Jul 20 19:28:51.897537 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: request: GET /compute/v2.1/servers/510f02a7-afc2-414f-bcd3-c197ffb96641 HTTP/1.1 Jul 20 19:28:51.897537 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: Accept: application/json Jul 20 19:28:51.897537 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: Accept-Encoding: identity Jul 20 19:28:51.897537 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: Connection: close Jul 20 19:28:51.897537 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: Content-Length: 0 Jul 20 19:28:51.897537 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: Content-Type: application/json Jul 20 19:28:51.897537 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: Host: 10.222.0.69 Jul 20 19:28:51.897537 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: Openstack-System-Scope: None Jul 20 19:28:51.897537 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: User-Agent: python-urllib3/1.26.9 Jul 20 19:28:51.897537 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Auth-Token: gAAAAABi2FbvraeCBRrPE4O7lrRb8qOLZk5VEOCVBOl4zMC1gg8XMd7uuHid9RioGTRX_JruGVyWJZ88XS9h66QDLJKZqWWE0MjOusG0phS1nTYkPwx2OHkqAGkCtP2OLBH1bnn2QsTgDuvA_AZ-0_Frr--F8Gf2qGtpGL5jfce4gMVrg4Ozv-Y Jul 20 19:28:51.897537 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Domain-Id: None Jul 20 19:28:51.897537 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Domain-Name: None Jul 20 19:28:51.897537 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Identity-Status: Confirmed Jul 20 19:28:51.897537 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Is-Admin-Project: True Jul 20 19:28:51.897537 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Project-Domain-Id: default Jul 20 19:28:51.897537 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Project-Domain-Name: Default Jul 20 19:28:51.897537 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Project-Id: e0bb4af78c1d4589b1d3cc90d5e6be63 Jul 20 19:28:51.897537 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1199788649 Jul 20 19:28:51.897537 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Role: reader,member Jul 20 19:28:51.897537 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Roles: reader,member Jul 20 19:28:51.898854 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e0bb4af78c1d4589b1d3cc90d5e6be63"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e0bb4af78c1d4589b1d3cc90d5e6be63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_e0bb4af78c1d4589b1d3cc90d5e6be63", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/e0bb4af78c1d4589b1d3cc90d5e6be63"}]}] Jul 20 19:28:51.898854 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Tenant: tempest-VolumesSnapshotTestJSON-1199788649 Jul 20 19:28:51.898854 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Tenant-Id: e0bb4af78c1d4589b1d3cc90d5e6be63 Jul 20 19:28:51.898854 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1199788649 Jul 20 19:28:51.898854 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-User: tempest-VolumesSnapshotTestJSON-1199788649-project Jul 20 19:28:51.898854 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-User-Domain-Id: default Jul 20 19:28:51.898854 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-User-Domain-Name: Default Jul 20 19:28:51.898854 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-User-Id: 78ae826a812b44328c48b82e9498ad8b Jul 20 19:28:51.898854 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: X-User-Name: tempest-VolumesSnapshotTestJSON-1199788649-project Jul 20 19:28:51.898854 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: method: > Jul 20 19:28:51.898854 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: exception: Instance 510f02a7-afc2-414f-bcd3-c197ffb96641 could not be found. Jul 20 19:28:51.898854 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: action_args: {'id': '510f02a7-afc2-414f-bcd3-c197ffb96641'} Jul 20 19:28:51.899583 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:28:51.899583 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:28:51.899583 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:28:51.899583 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:28:51.899583 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:28:51.899583 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:28:51.899583 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:28:51.899583 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:28:51.899583 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:28:51.899583 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:28:51.899583 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 510f02a7-afc2-414f-bcd3-c197ffb96641 could not be found. Jul 20 19:28:51.899583 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Jul 20 19:28:51.899583 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:28:51.899583 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Jul 20 19:28:51.899583 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:28:51.899583 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:28:51.899583 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:28:51.899583 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:28:51.899583 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:28:51.899583 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:28:51.900818 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:28:51.900818 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:28:51.900818 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:28:51.900818 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:28:51.900818 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:28:51.900818 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:28:51.900818 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:28:51.900818 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 510f02a7-afc2-414f-bcd3-c197ffb96641 could not be found. Jul 20 19:28:51.900818 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Jul 20 19:28:51.900818 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:28:51.900818 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Jul 20 19:28:51.900818 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:28:51.900818 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:28:51.900818 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:28:51.900818 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:28:51.900818 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:28:51.900818 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 510f02a7-afc2-414f-bcd3-c197ffb96641 could not be found. Jul 20 19:28:51.900818 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: ERROR nova.api.openstack.wsgi Jul 20 19:28:51.907323 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-1ea063a5-f20c-4044-9c91-8850250a0d1c tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Returning 404 to user: Instance 510f02a7-afc2-414f-bcd3-c197ffb96641 could not be found. {{(pid=117762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:28:51.907323 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-1ea063a5-f20c-4044-9c91-8850250a0d1c tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] 10.222.0.69 "GET /compute/v2.1/servers/510f02a7-afc2-414f-bcd3-c197ffb96641" status: 404 len: 111 microversion: 2.1 time: 0.042238 Jul 20 19:28:51.907323 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 270/529] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:51 2022] GET /compute/v2.1/servers/510f02a7-afc2-414f-bcd3-c197ffb96641 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:28:53.290957 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-bc524671-73a7-43e7-9080-a1760f558b3b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Action: 'create', calling method: .version_select at 0x7ff60a22a9d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1245547191", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMwRV5uI0VFyjVrqB/RWoSPYtrZYufXylXNq/B4KfubIEtlKqR3LSShe33wNkKO/Zvik0coLSorCmzV8Uwv1PlL2BfjXEw8ZkIgaWGDtJlaCTeMXDNoalQ3NcIhafFzC4A=="}} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:28:53.306895 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.quota [None req-bc524671-73a7-43e7-9080-a1760f558b3b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Getting quotas for project da296fe635c84b99b1645ceaf0138b83. Resources: {'key_pairs'} {{(pid=117761) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:28:53.311017 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.quota [None req-bc524671-73a7-43e7-9080-a1760f558b3b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Getting quotas for user 4d7204f863c64eeeb7dab59a30c447b8 and project da296fe635c84b99b1645ceaf0138b83. Resources: {'key_pairs'} {{(pid=117761) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:28:53.339339 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-bc524671-73a7-43e7-9080-a1760f558b3b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.172567 Jul 20 19:28:53.339945 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 260/530] 10.222.0.69 () {60 vars in 1158 bytes} [Wed Jul 20 19:28:53 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:28:54.497547 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-c1ef35ac-4d72-4289-8f7b-22c5a205ea07 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:54.498074 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-c1ef35ac-4d72-4289-8f7b-22c5a205ea07 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:54.509190 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c1ef35ac-4d72-4289-8f7b-22c5a205ea07 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:54.509676 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c1ef35ac-4d72-4289-8f7b-22c5a205ea07 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:54.510468 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c1ef35ac-4d72-4289-8f7b-22c5a205ea07 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:54.510940 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c1ef35ac-4d72-4289-8f7b-22c5a205ea07 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:54.537395 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-c1ef35ac-4d72-4289-8f7b-22c5a205ea07 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55/ips" status: 200 len: 152 microversion: 2.20 time: 0.177979 Jul 20 19:28:54.537803 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 271/531] 10.222.0.69 () {60 vars in 1288 bytes} [Wed Jul 20 19:28:54 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55/ips => generated 152 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 19:28:57.416509 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d878bae3-2c97-43e9-a839-9b18d0c92f67 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:57.417134 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d878bae3-2c97-43e9-a839-9b18d0c92f67 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:57.423786 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d878bae3-2c97-43e9-a839-9b18d0c92f67 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:57.424235 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d878bae3-2c97-43e9-a839-9b18d0c92f67 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:57.425669 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d878bae3-2c97-43e9-a839-9b18d0c92f67 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:57.425977 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d878bae3-2c97-43e9-a839-9b18d0c92f67 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:57.449850 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d878bae3-2c97-43e9-a839-9b18d0c92f67 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a/ips" status: 200 len: 145 microversion: 2.1 time: 0.147599 Jul 20 19:28:57.450407 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 261/532] 10.222.0.69 () {58 vars in 1247 bytes} [Wed Jul 20 19:28:57 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a/ips => generated 145 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:29:01.006371 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-3e27c988-4316-49a0-8fdb-5069fb3ec817 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:29:01.006931 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-3e27c988-4316-49a0-8fdb-5069fb3ec817 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:01.013848 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3e27c988-4316-49a0-8fdb-5069fb3ec817 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:01.014301 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3e27c988-4316-49a0-8fdb-5069fb3ec817 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:01.015064 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3e27c988-4316-49a0-8fdb-5069fb3ec817 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:01.015504 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3e27c988-4316-49a0-8fdb-5069fb3ec817 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:01.038163 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.objects.instance [None req-3e27c988-4316-49a0-8fdb-5069fb3ec817 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lazy-loading 'flavor' on Instance uuid 3b2abd53-4758-462c-b36a-0d1bf0b66a55 {{(pid=117762) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:29:01.306270 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-3e27c988-4316-49a0-8fdb-5069fb3ec817 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "POST /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55/action" status: 202 len: 0 microversion: 2.20 time: 0.303641 Jul 20 19:29:01.306906 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 272/533] 10.222.0.69 () {62 vars in 1318 bytes} [Wed Jul 20 19:29:01 2022] POST /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55/action => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 19:29:01.318526 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-8a22c7ca-ca83-4034-9344-71192972c82f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:01.318906 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-8a22c7ca-ca83-4034-9344-71192972c82f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:01.334580 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8a22c7ca-ca83-4034-9344-71192972c82f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:01.335446 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8a22c7ca-ca83-4034-9344-71192972c82f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:01.336767 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8a22c7ca-ca83-4034-9344-71192972c82f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:01.341794 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8a22c7ca-ca83-4034-9344-71192972c82f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:01.479900 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8a22c7ca-ca83-4034-9344-71192972c82f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:01.488275 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8a22c7ca-ca83-4034-9344-71192972c82f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:01.489761 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8a22c7ca-ca83-4034-9344-71192972c82f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:01.490917 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-8a22c7ca-ca83-4034-9344-71192972c82f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1722 microversion: 2.20 time: 0.179469 Jul 20 19:29:01.491471 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 262/534] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:01 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:02.510452 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-9cccf010-f5f4-45e1-afc7-848ddad716f2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:02.511243 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-9cccf010-f5f4-45e1-afc7-848ddad716f2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:02.517423 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9cccf010-f5f4-45e1-afc7-848ddad716f2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:02.517894 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9cccf010-f5f4-45e1-afc7-848ddad716f2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:02.518667 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9cccf010-f5f4-45e1-afc7-848ddad716f2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:02.519097 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9cccf010-f5f4-45e1-afc7-848ddad716f2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:02.656050 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-9cccf010-f5f4-45e1-afc7-848ddad716f2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:02.664545 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-9cccf010-f5f4-45e1-afc7-848ddad716f2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:02.666084 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-9cccf010-f5f4-45e1-afc7-848ddad716f2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:02.667236 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-9cccf010-f5f4-45e1-afc7-848ddad716f2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1722 microversion: 2.20 time: 0.161711 Jul 20 19:29:02.667796 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 273/535] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:02 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:03.032904 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-267bf789-b6fe-4839-a9dd-dfc4dddf217d tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6649e176-aa9f-4321-a737-fbc7fefd194b"}} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:29:03.034037 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-267bf789-b6fe-4839-a9dd-dfc4dddf217d tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:03.041324 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-267bf789-b6fe-4839-a9dd-dfc4dddf217d tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:03.041809 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-267bf789-b6fe-4839-a9dd-dfc4dddf217d tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:03.042600 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-267bf789-b6fe-4839-a9dd-dfc4dddf217d tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:03.043038 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-267bf789-b6fe-4839-a9dd-dfc4dddf217d tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:03.295294 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-267bf789-b6fe-4839-a9dd-dfc4dddf217d tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "POST /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.266155 Jul 20 19:29:03.295942 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 263/536] 10.222.0.69 () {60 vars in 1322 bytes} [Wed Jul 20 19:29:03 2022] POST /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a/os-volume_attachments => generated 194 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:29:03.686204 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-d8b56919-d3c8-4a30-a824-1d98d0c4c3ed tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:03.686827 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-d8b56919-d3c8-4a30-a824-1d98d0c4c3ed tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:03.693264 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d8b56919-d3c8-4a30-a824-1d98d0c4c3ed tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:03.693697 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d8b56919-d3c8-4a30-a824-1d98d0c4c3ed tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:03.694459 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d8b56919-d3c8-4a30-a824-1d98d0c4c3ed tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:03.694892 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d8b56919-d3c8-4a30-a824-1d98d0c4c3ed tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:03.824343 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-d8b56919-d3c8-4a30-a824-1d98d0c4c3ed tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:03.832249 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-d8b56919-d3c8-4a30-a824-1d98d0c4c3ed tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:03.833771 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-d8b56919-d3c8-4a30-a824-1d98d0c4c3ed tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:03.834913 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-d8b56919-d3c8-4a30-a824-1d98d0c4c3ed tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1722 microversion: 2.20 time: 0.152592 Jul 20 19:29:03.836060 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 274/537] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:03 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:04.851714 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell0:SELECT=4 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:04.856065 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-6811796f-3b08-4539-8f09-b977598e3aeb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:04.856749 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-6811796f-3b08-4539-8f09-b977598e3aeb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:04.863332 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6811796f-3b08-4539-8f09-b977598e3aeb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:04.863786 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6811796f-3b08-4539-8f09-b977598e3aeb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:04.864556 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6811796f-3b08-4539-8f09-b977598e3aeb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:04.864993 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6811796f-3b08-4539-8f09-b977598e3aeb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:04.999409 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6811796f-3b08-4539-8f09-b977598e3aeb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:05.007289 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6811796f-3b08-4539-8f09-b977598e3aeb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:05.009692 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6811796f-3b08-4539-8f09-b977598e3aeb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:05.010841 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-6811796f-3b08-4539-8f09-b977598e3aeb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1722 microversion: 2.20 time: 0.160754 Jul 20 19:29:05.011402 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 264/538] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:04 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:06.028166 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-ec25cc68-a9c7-4b7e-817a-f0a8e5eb051c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:06.028772 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-ec25cc68-a9c7-4b7e-817a-f0a8e5eb051c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:06.035459 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-ec25cc68-a9c7-4b7e-817a-f0a8e5eb051c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:06.035908 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-ec25cc68-a9c7-4b7e-817a-f0a8e5eb051c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:06.036664 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-ec25cc68-a9c7-4b7e-817a-f0a8e5eb051c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:06.037097 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-ec25cc68-a9c7-4b7e-817a-f0a8e5eb051c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:06.175732 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-ec25cc68-a9c7-4b7e-817a-f0a8e5eb051c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:06.184097 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-ec25cc68-a9c7-4b7e-817a-f0a8e5eb051c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:06.185687 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-ec25cc68-a9c7-4b7e-817a-f0a8e5eb051c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:06.186812 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-ec25cc68-a9c7-4b7e-817a-f0a8e5eb051c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1722 microversion: 2.20 time: 0.162501 Jul 20 19:29:06.187350 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 275/539] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:06 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:07.204842 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-9b298037-14ff-4f2c-b7b5-f251b2f54069 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:07.205463 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-9b298037-14ff-4f2c-b7b5-f251b2f54069 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:07.211819 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9b298037-14ff-4f2c-b7b5-f251b2f54069 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:07.212310 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9b298037-14ff-4f2c-b7b5-f251b2f54069 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:07.213696 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9b298037-14ff-4f2c-b7b5-f251b2f54069 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:07.214127 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9b298037-14ff-4f2c-b7b5-f251b2f54069 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:07.349775 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-9b298037-14ff-4f2c-b7b5-f251b2f54069 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:07.357761 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-9b298037-14ff-4f2c-b7b5-f251b2f54069 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:07.359236 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-9b298037-14ff-4f2c-b7b5-f251b2f54069 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:07.360363 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-9b298037-14ff-4f2c-b7b5-f251b2f54069 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1722 microversion: 2.20 time: 0.159409 Jul 20 19:29:07.360907 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 265/540] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:07 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:08.378402 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-621421f0-7671-4a5b-9d73-aea2e510ab46 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:08.379004 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-621421f0-7671-4a5b-9d73-aea2e510ab46 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:08.385464 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-621421f0-7671-4a5b-9d73-aea2e510ab46 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:08.385948 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-621421f0-7671-4a5b-9d73-aea2e510ab46 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:08.386712 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-621421f0-7671-4a5b-9d73-aea2e510ab46 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:08.387752 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-621421f0-7671-4a5b-9d73-aea2e510ab46 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:08.514837 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-621421f0-7671-4a5b-9d73-aea2e510ab46 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:08.522778 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-621421f0-7671-4a5b-9d73-aea2e510ab46 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:08.524296 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-621421f0-7671-4a5b-9d73-aea2e510ab46 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:08.525447 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-621421f0-7671-4a5b-9d73-aea2e510ab46 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1722 microversion: 2.20 time: 0.150934 Jul 20 19:29:08.526033 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 276/541] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:08 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:09.545026 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-78f0e3d8-9d12-47e4-83f4-adb483eb9f53 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:09.545655 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-78f0e3d8-9d12-47e4-83f4-adb483eb9f53 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:09.552238 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-78f0e3d8-9d12-47e4-83f4-adb483eb9f53 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:09.552707 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-78f0e3d8-9d12-47e4-83f4-adb483eb9f53 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:09.553469 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-78f0e3d8-9d12-47e4-83f4-adb483eb9f53 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:09.553917 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-78f0e3d8-9d12-47e4-83f4-adb483eb9f53 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:09.683220 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-78f0e3d8-9d12-47e4-83f4-adb483eb9f53 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:09.692783 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-78f0e3d8-9d12-47e4-83f4-adb483eb9f53 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:09.694784 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-78f0e3d8-9d12-47e4-83f4-adb483eb9f53 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:09.696470 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-78f0e3d8-9d12-47e4-83f4-adb483eb9f53 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1722 microversion: 2.20 time: 0.155850 Jul 20 19:29:09.701981 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 266/542] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:09 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:10.198763 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-0710637a-907d-4a10-b498-37d43595cc2d tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-450237632", "imageRef": "59575804-e013-4dec-af24-b6c2dbbce73a", "flavorRef": "452", "networks": [{"uuid": "3876f343-881d-4a45-a291-349275ccea28"}]}} {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:29:10.256327 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.network.neutron [None req-0710637a-907d-4a10-b498-37d43595cc2d tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] validate_networks() for [('3876f343-881d-4a45-a291-349275ccea28', None, None, None, None, None)] {{(pid=117762) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 19:29:10.659940 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.virt.hardware [None req-0710637a-907d-4a10-b498-37d43595cc2d tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Flavor limits 0:0:0 {{(pid=117762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 19:29:10.660362 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.virt.hardware [None req-0710637a-907d-4a10-b498-37d43595cc2d tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Image limits 0:0:0 {{(pid=117762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 19:29:10.660837 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.virt.hardware [None req-0710637a-907d-4a10-b498-37d43595cc2d tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Flavor pref 0:0:0 {{(pid=117762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 19:29:10.661241 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.virt.hardware [None req-0710637a-907d-4a10-b498-37d43595cc2d tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Image pref 0:0:0 {{(pid=117762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 19:29:10.661702 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.virt.hardware [None req-0710637a-907d-4a10-b498-37d43595cc2d tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 19:29:10.671360 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-0710637a-907d-4a10-b498-37d43595cc2d tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:10.671807 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-0710637a-907d-4a10-b498-37d43595cc2d tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:10.672603 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-0710637a-907d-4a10-b498-37d43595cc2d tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:10.673038 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-0710637a-907d-4a10-b498-37d43595cc2d tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:10.690008 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.quota [None req-0710637a-907d-4a10-b498-37d43595cc2d tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Getting quotas for project e0bb4af78c1d4589b1d3cc90d5e6be63. Resources: {'cores', 'ram', 'instances'} {{(pid=117762) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:29:10.694006 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.quota [None req-0710637a-907d-4a10-b498-37d43595cc2d tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Getting quotas for user 78ae826a812b44328c48b82e9498ad8b and project e0bb4af78c1d4589b1d3cc90d5e6be63. Resources: {'cores', 'ram', 'instances'} {{(pid=117762) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:29:10.705983 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-0710637a-907d-4a10-b498-37d43595cc2d tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Going to run 1 instances... {{(pid=117762) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 19:29:10.708225 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-0710637a-907d-4a10-b498-37d43595cc2d tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] [instance: 43fe56ab-bf09-4ec0-84d5-306f16cb9d5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='59575804-e013-4dec-af24-b6c2dbbce73a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117762) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 19:29:10.715245 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-70440cd8-a41a-43bb-b1c7-c98aecafda2a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:10.716366 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-70440cd8-a41a-43bb-b1c7-c98aecafda2a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:10.723704 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-70440cd8-a41a-43bb-b1c7-c98aecafda2a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:10.724251 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-70440cd8-a41a-43bb-b1c7-c98aecafda2a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:10.725107 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-70440cd8-a41a-43bb-b1c7-c98aecafda2a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:10.725645 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-70440cd8-a41a-43bb-b1c7-c98aecafda2a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:10.762942 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-0710637a-907d-4a10-b498-37d43595cc2d tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.567204 Jul 20 19:29:10.763698 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 277/543] 10.222.0.69 () {60 vars in 1146 bytes} [Wed Jul 20 19:29:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 19:29:10.774682 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-671e0674-a8f1-4d52-b76a-cc79a45bf74d tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:10.775297 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-671e0674-a8f1-4d52-b76a-cc79a45bf74d tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] [instance: 43fe56ab-bf09-4ec0-84d5-306f16cb9d5a] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:10.836068 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-671e0674-a8f1-4d52-b76a-cc79a45bf74d tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ae826a812b44328c48b82e9498ad8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bb4af78c1d4589b1d3cc90d5e6be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:10.846898 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-671e0674-a8f1-4d52-b76a-cc79a45bf74d tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] 10.222.0.69 "GET /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a" status: 200 len: 1218 microversion: 2.1 time: 0.074948 Jul 20 19:29:10.846898 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 278/544] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:10 2022] GET /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a => generated 1218 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:29:10.881349 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-70440cd8-a41a-43bb-b1c7-c98aecafda2a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:10.889547 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-70440cd8-a41a-43bb-b1c7-c98aecafda2a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:10.891118 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-70440cd8-a41a-43bb-b1c7-c98aecafda2a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:10.892360 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-70440cd8-a41a-43bb-b1c7-c98aecafda2a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1722 microversion: 2.20 time: 0.181895 Jul 20 19:29:10.892981 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 267/545] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:10 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:11.862758 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-e4c59319-1a0a-4589-8943-e66f8b0345ab tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:11.863358 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-e4c59319-1a0a-4589-8943-e66f8b0345ab tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] [instance: 43fe56ab-bf09-4ec0-84d5-306f16cb9d5a] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:11.869794 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e4c59319-1a0a-4589-8943-e66f8b0345ab tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:11.870240 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e4c59319-1a0a-4589-8943-e66f8b0345ab tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:11.870997 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e4c59319-1a0a-4589-8943-e66f8b0345ab tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:11.871474 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e4c59319-1a0a-4589-8943-e66f8b0345ab tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:11.911006 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-24347a18-5b16-469a-97cb-c858a06a40eb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:11.911614 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-24347a18-5b16-469a-97cb-c858a06a40eb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:11.918048 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-24347a18-5b16-469a-97cb-c858a06a40eb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:11.918490 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-24347a18-5b16-469a-97cb-c858a06a40eb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:11.919260 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-24347a18-5b16-469a-97cb-c858a06a40eb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:11.920255 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-24347a18-5b16-469a-97cb-c858a06a40eb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:11.938288 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-e4c59319-1a0a-4589-8943-e66f8b0345ab tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ae826a812b44328c48b82e9498ad8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bb4af78c1d4589b1d3cc90d5e6be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:11.945619 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-e4c59319-1a0a-4589-8943-e66f8b0345ab tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] 10.222.0.69 "GET /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a" status: 200 len: 1270 microversion: 2.1 time: 0.086815 Jul 20 19:29:11.946171 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 279/546] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:11 2022] GET /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a => generated 1270 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:12.062678 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-24347a18-5b16-469a-97cb-c858a06a40eb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:12.073060 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-24347a18-5b16-469a-97cb-c858a06a40eb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:12.075076 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-24347a18-5b16-469a-97cb-c858a06a40eb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:12.077557 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-24347a18-5b16-469a-97cb-c858a06a40eb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1722 microversion: 2.20 time: 0.170005 Jul 20 19:29:12.078195 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 268/547] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:11 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:29:12.490150 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-e29b402b-0215-4885-894d-1b37367bd257 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-955100882", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-495469876", "security_groups": [{"name": "tempest-secgroup-smoke-219114629"}], "block_device_mapping_v2": [{"uuid": "ff75a2d7-4681-43f2-81be-d09c75cdd3fc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c39a0d69-310f-4397-8229-c22c13e640e5"}]}} {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:29:12.624334 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.network.neutron [None req-e29b402b-0215-4885-894d-1b37367bd257 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] validate_networks() for [('c39a0d69-310f-4397-8229-c22c13e640e5', None, None, None, None, None)] {{(pid=117762) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 19:29:12.963715 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d4f683dc-ef15-402a-9ffb-763a57bed2a5 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:12.964321 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d4f683dc-ef15-402a-9ffb-763a57bed2a5 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] [instance: 43fe56ab-bf09-4ec0-84d5-306f16cb9d5a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:12.971750 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d4f683dc-ef15-402a-9ffb-763a57bed2a5 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:12.972192 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d4f683dc-ef15-402a-9ffb-763a57bed2a5 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:12.972965 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d4f683dc-ef15-402a-9ffb-763a57bed2a5 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:12.973394 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d4f683dc-ef15-402a-9ffb-763a57bed2a5 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:13.102186 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.virt.hardware [None req-e29b402b-0215-4885-894d-1b37367bd257 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Flavor limits 0:0:0 {{(pid=117762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 19:29:13.102678 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.virt.hardware [None req-e29b402b-0215-4885-894d-1b37367bd257 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Image limits 0:0:0 {{(pid=117762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 19:29:13.103211 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.virt.hardware [None req-e29b402b-0215-4885-894d-1b37367bd257 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Flavor pref 0:0:0 {{(pid=117762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 19:29:13.103716 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.virt.hardware [None req-e29b402b-0215-4885-894d-1b37367bd257 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Image pref 0:0:0 {{(pid=117762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 19:29:13.104216 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.virt.hardware [None req-e29b402b-0215-4885-894d-1b37367bd257 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 19:29:13.114295 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e29b402b-0215-4885-894d-1b37367bd257 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:13.114827 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e29b402b-0215-4885-894d-1b37367bd257 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:13.115766 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e29b402b-0215-4885-894d-1b37367bd257 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:13.116267 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e29b402b-0215-4885-894d-1b37367bd257 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:13.134186 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.quota [None req-e29b402b-0215-4885-894d-1b37367bd257 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Getting quotas for project 8064950f9a1942149aa8d6c08c206850. Resources: {'cores', 'ram', 'instances'} {{(pid=117762) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:29:13.139310 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.quota [None req-e29b402b-0215-4885-894d-1b37367bd257 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Getting quotas for user 8c67fe170c60476d88610d85f2528c52 and project 8064950f9a1942149aa8d6c08c206850. Resources: {'cores', 'ram', 'instances'} {{(pid=117762) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:29:13.199728 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-e29b402b-0215-4885-894d-1b37367bd257 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Going to run 1 instances... {{(pid=117762) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 19:29:13.202350 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-e29b402b-0215-4885-894d-1b37367bd257 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ff75a2d7-4681-43f2-81be-d09c75cdd3fc',volume_size=None,volume_type=None)] {{(pid=117762) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 19:29:13.251636 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d4f683dc-ef15-402a-9ffb-763a57bed2a5 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ae826a812b44328c48b82e9498ad8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bb4af78c1d4589b1d3cc90d5e6be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:13.259146 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d4f683dc-ef15-402a-9ffb-763a57bed2a5 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] 10.222.0.69 "GET /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a" status: 200 len: 1318 microversion: 2.1 time: 0.300024 Jul 20 19:29:13.259483 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 269/548] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:12 2022] GET /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a => generated 1318 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:13.271046 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-9d3d8aa5-7343-4ae1-8c4a-1d69c7a3196d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:13.271651 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-9d3d8aa5-7343-4ae1-8c4a-1d69c7a3196d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:13.278296 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9d3d8aa5-7343-4ae1-8c4a-1d69c7a3196d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:13.278749 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9d3d8aa5-7343-4ae1-8c4a-1d69c7a3196d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:13.280101 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9d3d8aa5-7343-4ae1-8c4a-1d69c7a3196d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:13.280749 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9d3d8aa5-7343-4ae1-8c4a-1d69c7a3196d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:13.362749 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-e29b402b-0215-4885-894d-1b37367bd257 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.876710 Jul 20 19:29:13.363382 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 280/549] 10.222.0.69 () {60 vars in 1146 bytes} [Wed Jul 20 19:29:12 2022] POST /compute/v2.1/servers => generated 405 bytes in 878 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 19:29:13.374673 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-dc1e1098-3be1-40ab-81c5-443662f86f61 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:13.375295 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-dc1e1098-3be1-40ab-81c5-443662f86f61 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:13.438788 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-dc1e1098-3be1-40ab-81c5-443662f86f61 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:13.446175 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-dc1e1098-3be1-40ab-81c5-443662f86f61 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1093 microversion: 2.1 time: 0.075450 Jul 20 19:29:13.446928 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 281/550] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:13 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1093 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:13.540516 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-9d3d8aa5-7343-4ae1-8c4a-1d69c7a3196d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:13.542811 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:13.551750 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-9d3d8aa5-7343-4ae1-8c4a-1d69c7a3196d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:13.553263 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-9d3d8aa5-7343-4ae1-8c4a-1d69c7a3196d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:13.554465 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-9d3d8aa5-7343-4ae1-8c4a-1d69c7a3196d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1722 microversion: 2.20 time: 0.294064 Jul 20 19:29:13.555033 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 270/551] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:13 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1722 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:13.826442 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [req-e686ca21-1d2c-4e5e-95f5-fc4063723971 req-e657c94f-0e96-4f36-98cf-bb1d37d859e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43fe56ab-bf09-4ec0-84d5-306f16cb9d5a", "tag": "4d776a97-1613-4d92-893b-9c96e6a8a268"}]} {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:29:13.834519 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [req-e686ca21-1d2c-4e5e-95f5-fc4063723971 req-e657c94f-0e96-4f36-98cf-bb1d37d859e0 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:13.834960 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [req-e686ca21-1d2c-4e5e-95f5-fc4063723971 req-e657c94f-0e96-4f36-98cf-bb1d37d859e0 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:13.846430 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.compute.server_external_events [req-e686ca21-1d2c-4e5e-95f5-fc4063723971 req-e657c94f-0e96-4f36-98cf-bb1d37d859e0 service nova] Creating event network-changed:4d776a97-1613-4d92-893b-9c96e6a8a268 for instance 43fe56ab-bf09-4ec0-84d5-306f16cb9d5a on hv-cinder-83538 Jul 20 19:29:13.851392 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [req-e686ca21-1d2c-4e5e-95f5-fc4063723971 req-e657c94f-0e96-4f36-98cf-bb1d37d859e0 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088788 Jul 20 19:29:13.851955 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 282/552] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 19:29:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:29:14.276707 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-5574fe96-de55-4f01-b884-70e223ad4285 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:14.277606 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-5574fe96-de55-4f01-b884-70e223ad4285 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] [instance: 43fe56ab-bf09-4ec0-84d5-306f16cb9d5a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:14.284689 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:14.294812 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5574fe96-de55-4f01-b884-70e223ad4285 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:14.295497 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5574fe96-de55-4f01-b884-70e223ad4285 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:14.296594 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5574fe96-de55-4f01-b884-70e223ad4285 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:14.297107 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5574fe96-de55-4f01-b884-70e223ad4285 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:14.444050 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-5574fe96-de55-4f01-b884-70e223ad4285 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ae826a812b44328c48b82e9498ad8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bb4af78c1d4589b1d3cc90d5e6be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:14.452129 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-5574fe96-de55-4f01-b884-70e223ad4285 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] 10.222.0.69 "GET /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a" status: 200 len: 1318 microversion: 2.1 time: 0.179703 Jul 20 19:29:14.452697 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 271/553] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:14 2022] GET /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:29:14.464790 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-9083706f-4b6a-4950-adc8-3e41e09e122a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:14.465472 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-9083706f-4b6a-4950-adc8-3e41e09e122a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:14.471754 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9083706f-4b6a-4950-adc8-3e41e09e122a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:14.472132 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9083706f-4b6a-4950-adc8-3e41e09e122a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:14.472879 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9083706f-4b6a-4950-adc8-3e41e09e122a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:14.473312 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9083706f-4b6a-4950-adc8-3e41e09e122a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:14.536283 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-9083706f-4b6a-4950-adc8-3e41e09e122a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:14.543740 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-9083706f-4b6a-4950-adc8-3e41e09e122a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1191 microversion: 2.1 time: 0.083719 Jul 20 19:29:14.544329 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 283/554] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:14 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1191 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:14.572441 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-31dec7b4-fd96-4be9-9945-f454d95f9a02 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:14.573041 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-31dec7b4-fd96-4be9-9945-f454d95f9a02 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:14.579329 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-31dec7b4-fd96-4be9-9945-f454d95f9a02 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:14.579772 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-31dec7b4-fd96-4be9-9945-f454d95f9a02 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:14.580531 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-31dec7b4-fd96-4be9-9945-f454d95f9a02 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:14.580988 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-31dec7b4-fd96-4be9-9945-f454d95f9a02 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:14.709867 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-31dec7b4-fd96-4be9-9945-f454d95f9a02 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:14.722389 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-31dec7b4-fd96-4be9-9945-f454d95f9a02 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:14.723825 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-31dec7b4-fd96-4be9-9945-f454d95f9a02 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:14.725003 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-31dec7b4-fd96-4be9-9945-f454d95f9a02 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1722 microversion: 2.20 time: 0.156481 Jul 20 19:29:14.725616 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 272/555] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:14 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:15.470653 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-61e4daf8-36fa-44c4-a4ad-d73e0bf4137f tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:15.471429 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-61e4daf8-36fa-44c4-a4ad-d73e0bf4137f tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] [instance: 43fe56ab-bf09-4ec0-84d5-306f16cb9d5a] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:15.479686 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-61e4daf8-36fa-44c4-a4ad-d73e0bf4137f tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:15.480917 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-61e4daf8-36fa-44c4-a4ad-d73e0bf4137f tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:15.482692 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-61e4daf8-36fa-44c4-a4ad-d73e0bf4137f tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:15.483269 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-61e4daf8-36fa-44c4-a4ad-d73e0bf4137f tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:15.562306 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-9389c96d-b8c1-4ee3-95b1-59c683709632 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:15.563097 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-9389c96d-b8c1-4ee3-95b1-59c683709632 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:15.569995 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9389c96d-b8c1-4ee3-95b1-59c683709632 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:15.570479 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9389c96d-b8c1-4ee3-95b1-59c683709632 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:15.576395 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9389c96d-b8c1-4ee3-95b1-59c683709632 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:15.577225 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9389c96d-b8c1-4ee3-95b1-59c683709632 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:15.627534 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-61e4daf8-36fa-44c4-a4ad-d73e0bf4137f tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ae826a812b44328c48b82e9498ad8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bb4af78c1d4589b1d3cc90d5e6be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:15.631351 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:15.636635 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-61e4daf8-36fa-44c4-a4ad-d73e0bf4137f tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] 10.222.0.69 "GET /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a" status: 200 len: 1318 microversion: 2.1 time: 0.171881 Jul 20 19:29:15.637229 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 284/556] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:15 2022] GET /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:15.652472 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-9389c96d-b8c1-4ee3-95b1-59c683709632 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:15.660420 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-9389c96d-b8c1-4ee3-95b1-59c683709632 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1209 microversion: 2.1 time: 0.102759 Jul 20 19:29:15.660991 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 273/557] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:15 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1209 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:29:15.743524 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-44172b37-8ecc-4377-a426-c7c32a0c3302 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:15.744129 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-44172b37-8ecc-4377-a426-c7c32a0c3302 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:15.752137 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-44172b37-8ecc-4377-a426-c7c32a0c3302 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:15.752591 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-44172b37-8ecc-4377-a426-c7c32a0c3302 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:15.753642 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-44172b37-8ecc-4377-a426-c7c32a0c3302 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:15.754148 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-44172b37-8ecc-4377-a426-c7c32a0c3302 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:15.894724 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-44172b37-8ecc-4377-a426-c7c32a0c3302 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:15.902992 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-44172b37-8ecc-4377-a426-c7c32a0c3302 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:15.905197 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-44172b37-8ecc-4377-a426-c7c32a0c3302 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:15.906386 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-44172b37-8ecc-4377-a426-c7c32a0c3302 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1722 microversion: 2.20 time: 0.167203 Jul 20 19:29:15.906937 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 285/558] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:15 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:16.653864 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-cc33bc01-556d-4337-aa6f-8cdc7cfdeb50 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:16.654472 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-cc33bc01-556d-4337-aa6f-8cdc7cfdeb50 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] [instance: 43fe56ab-bf09-4ec0-84d5-306f16cb9d5a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:16.663717 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cc33bc01-556d-4337-aa6f-8cdc7cfdeb50 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:16.664099 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cc33bc01-556d-4337-aa6f-8cdc7cfdeb50 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:16.664864 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cc33bc01-556d-4337-aa6f-8cdc7cfdeb50 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:16.665291 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cc33bc01-556d-4337-aa6f-8cdc7cfdeb50 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:16.678117 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-05878dbf-e5de-40af-805f-155750d3833d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:16.678773 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-05878dbf-e5de-40af-805f-155750d3833d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:16.681087 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:16.689845 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-05878dbf-e5de-40af-805f-155750d3833d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:16.690521 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-05878dbf-e5de-40af-805f-155750d3833d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:16.691303 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-05878dbf-e5de-40af-805f-155750d3833d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:16.691906 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-05878dbf-e5de-40af-805f-155750d3833d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:16.836831 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-05878dbf-e5de-40af-805f-155750d3833d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:16.846717 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-05878dbf-e5de-40af-805f-155750d3833d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1276 microversion: 2.1 time: 0.173115 Jul 20 19:29:16.847303 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 286/559] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:16 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1276 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:16.908698 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-cc33bc01-556d-4337-aa6f-8cdc7cfdeb50 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ae826a812b44328c48b82e9498ad8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bb4af78c1d4589b1d3cc90d5e6be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:16.916038 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-cc33bc01-556d-4337-aa6f-8cdc7cfdeb50 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] 10.222.0.69 "GET /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a" status: 200 len: 1318 microversion: 2.1 time: 0.266092 Jul 20 19:29:16.916599 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 274/560] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:16 2022] GET /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a => generated 1318 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:16.926560 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-21d40cbe-da39-4b93-aafe-58019798d810 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:16.927282 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-21d40cbe-da39-4b93-aafe-58019798d810 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:16.936693 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-21d40cbe-da39-4b93-aafe-58019798d810 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:16.937237 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-21d40cbe-da39-4b93-aafe-58019798d810 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:16.938055 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-21d40cbe-da39-4b93-aafe-58019798d810 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:16.938552 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-21d40cbe-da39-4b93-aafe-58019798d810 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:17.088467 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-21d40cbe-da39-4b93-aafe-58019798d810 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:17.107145 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-21d40cbe-da39-4b93-aafe-58019798d810 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:17.108890 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-21d40cbe-da39-4b93-aafe-58019798d810 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:17.113497 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-21d40cbe-da39-4b93-aafe-58019798d810 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1722 microversion: 2.20 time: 0.192297 Jul 20 19:29:17.115185 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 287/561] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:16 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:17.327924 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [req-d439b1dc-036b-41d7-b6e4-c5de0d1eecaa req-47620f41-3d1f-4202-98af-1cc565f5ba4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0aee5176-53ab-4288-91da-4284ac2e443e", "tag": "37f1f157-d172-4459-b70e-8eeade5eea75"}]} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:29:17.339926 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-d439b1dc-036b-41d7-b6e4-c5de0d1eecaa req-47620f41-3d1f-4202-98af-1cc565f5ba4f service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:17.340497 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-d439b1dc-036b-41d7-b6e4-c5de0d1eecaa req-47620f41-3d1f-4202-98af-1cc565f5ba4f service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:17.354247 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.compute.server_external_events [req-d439b1dc-036b-41d7-b6e4-c5de0d1eecaa req-47620f41-3d1f-4202-98af-1cc565f5ba4f service nova] Creating event network-changed:37f1f157-d172-4459-b70e-8eeade5eea75 for instance 0aee5176-53ab-4288-91da-4284ac2e443e on hv-cinder-83538 Jul 20 19:29:17.360307 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [req-d439b1dc-036b-41d7-b6e4-c5de0d1eecaa req-47620f41-3d1f-4202-98af-1cc565f5ba4f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040818 Jul 20 19:29:17.361147 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 275/562] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 19:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:29:17.863458 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-1fb7e5db-fece-450d-a62d-ec09340b06e7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:17.864064 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-1fb7e5db-fece-450d-a62d-ec09340b06e7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:17.870843 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1fb7e5db-fece-450d-a62d-ec09340b06e7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:17.871285 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1fb7e5db-fece-450d-a62d-ec09340b06e7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:17.872037 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1fb7e5db-fece-450d-a62d-ec09340b06e7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:17.872525 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1fb7e5db-fece-450d-a62d-ec09340b06e7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:17.934400 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-688e8598-0f52-410d-ae5f-556969a7f611 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:17.936000 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-688e8598-0f52-410d-ae5f-556969a7f611 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] [instance: 43fe56ab-bf09-4ec0-84d5-306f16cb9d5a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:17.942277 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-688e8598-0f52-410d-ae5f-556969a7f611 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:17.942719 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-688e8598-0f52-410d-ae5f-556969a7f611 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:17.943478 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-688e8598-0f52-410d-ae5f-556969a7f611 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:17.943907 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-688e8598-0f52-410d-ae5f-556969a7f611 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:18.006071 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-1fb7e5db-fece-450d-a62d-ec09340b06e7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:18.013938 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-1fb7e5db-fece-450d-a62d-ec09340b06e7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1276 microversion: 2.1 time: 0.153790 Jul 20 19:29:18.014611 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 288/563] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:17 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1276 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:18.075215 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-688e8598-0f52-410d-ae5f-556969a7f611 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ae826a812b44328c48b82e9498ad8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bb4af78c1d4589b1d3cc90d5e6be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:18.083588 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-688e8598-0f52-410d-ae5f-556969a7f611 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] 10.222.0.69 "GET /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a" status: 200 len: 1318 microversion: 2.1 time: 0.153760 Jul 20 19:29:18.084163 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 276/564] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:17 2022] GET /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:29:18.134550 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-8abe56ae-94ee-47a0-9f99-cefd0834eb6d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:18.135068 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-8abe56ae-94ee-47a0-9f99-cefd0834eb6d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:18.141772 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8abe56ae-94ee-47a0-9f99-cefd0834eb6d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:18.142221 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8abe56ae-94ee-47a0-9f99-cefd0834eb6d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:18.142972 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8abe56ae-94ee-47a0-9f99-cefd0834eb6d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:18.143401 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8abe56ae-94ee-47a0-9f99-cefd0834eb6d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:18.280096 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-8abe56ae-94ee-47a0-9f99-cefd0834eb6d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:18.288011 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-8abe56ae-94ee-47a0-9f99-cefd0834eb6d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:18.289536 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-8abe56ae-94ee-47a0-9f99-cefd0834eb6d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:18.290696 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-8abe56ae-94ee-47a0-9f99-cefd0834eb6d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1722 microversion: 2.20 time: 0.160240 Jul 20 19:29:18.291255 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 289/565] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:18 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:29:19.031118 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a489738a-e80f-49f3-bc5a-2527c46f294b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:19.031716 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a489738a-e80f-49f3-bc5a-2527c46f294b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:19.038182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a489738a-e80f-49f3-bc5a-2527c46f294b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:19.038622 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a489738a-e80f-49f3-bc5a-2527c46f294b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:19.039373 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a489738a-e80f-49f3-bc5a-2527c46f294b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:19.039798 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a489738a-e80f-49f3-bc5a-2527c46f294b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:19.100987 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-e339b10e-c0ee-4f64-b515-92fc3cdc89f9 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:19.101534 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-e339b10e-c0ee-4f64-b515-92fc3cdc89f9 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] [instance: 43fe56ab-bf09-4ec0-84d5-306f16cb9d5a] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:19.107852 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e339b10e-c0ee-4f64-b515-92fc3cdc89f9 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:19.108388 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e339b10e-c0ee-4f64-b515-92fc3cdc89f9 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:19.109212 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e339b10e-c0ee-4f64-b515-92fc3cdc89f9 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:19.109736 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e339b10e-c0ee-4f64-b515-92fc3cdc89f9 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:19.176595 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a489738a-e80f-49f3-bc5a-2527c46f294b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:19.184152 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a489738a-e80f-49f3-bc5a-2527c46f294b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1276 microversion: 2.1 time: 0.156988 Jul 20 19:29:19.184723 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 277/566] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:19 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1276 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:19.239886 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-e339b10e-c0ee-4f64-b515-92fc3cdc89f9 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ae826a812b44328c48b82e9498ad8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bb4af78c1d4589b1d3cc90d5e6be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:19.247165 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-e339b10e-c0ee-4f64-b515-92fc3cdc89f9 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] 10.222.0.69 "GET /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a" status: 200 len: 1318 microversion: 2.1 time: 0.150253 Jul 20 19:29:19.248482 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 290/567] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:19 2022] GET /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:29:19.307967 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-3fd55310-b05d-42c4-accf-5522261e6604 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:19.308566 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-3fd55310-b05d-42c4-accf-5522261e6604 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:19.315340 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3fd55310-b05d-42c4-accf-5522261e6604 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:19.315783 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3fd55310-b05d-42c4-accf-5522261e6604 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:19.316544 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3fd55310-b05d-42c4-accf-5522261e6604 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:19.316971 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3fd55310-b05d-42c4-accf-5522261e6604 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:19.449906 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3fd55310-b05d-42c4-accf-5522261e6604 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:19.458375 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3fd55310-b05d-42c4-accf-5522261e6604 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:19.459897 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3fd55310-b05d-42c4-accf-5522261e6604 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:19.461037 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-3fd55310-b05d-42c4-accf-5522261e6604 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1722 microversion: 2.20 time: 0.156900 Jul 20 19:29:19.461610 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 278/568] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:19 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:20.201525 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-f4ffb2bb-bc95-40e4-9fb1-a0cc64629b3f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:20.202128 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-f4ffb2bb-bc95-40e4-9fb1-a0cc64629b3f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:20.209005 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f4ffb2bb-bc95-40e4-9fb1-a0cc64629b3f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:20.209452 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f4ffb2bb-bc95-40e4-9fb1-a0cc64629b3f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:20.210239 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f4ffb2bb-bc95-40e4-9fb1-a0cc64629b3f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:20.210669 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f4ffb2bb-bc95-40e4-9fb1-a0cc64629b3f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:20.264271 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-82feae1c-f9a9-41ba-9d59-bfb0f02bdb5d tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:20.264815 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-82feae1c-f9a9-41ba-9d59-bfb0f02bdb5d tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] [instance: 43fe56ab-bf09-4ec0-84d5-306f16cb9d5a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:20.271462 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-82feae1c-f9a9-41ba-9d59-bfb0f02bdb5d tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:20.271909 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-82feae1c-f9a9-41ba-9d59-bfb0f02bdb5d tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:20.272800 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-82feae1c-f9a9-41ba-9d59-bfb0f02bdb5d tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:20.273088 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-82feae1c-f9a9-41ba-9d59-bfb0f02bdb5d tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:20.364728 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-f4ffb2bb-bc95-40e4-9fb1-a0cc64629b3f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:20.372292 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-f4ffb2bb-bc95-40e4-9fb1-a0cc64629b3f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1276 microversion: 2.1 time: 0.174748 Jul 20 19:29:20.372978 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 291/569] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:20 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1276 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:20.407975 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-82feae1c-f9a9-41ba-9d59-bfb0f02bdb5d tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ae826a812b44328c48b82e9498ad8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bb4af78c1d4589b1d3cc90d5e6be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:20.415493 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-82feae1c-f9a9-41ba-9d59-bfb0f02bdb5d tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] 10.222.0.69 "GET /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a" status: 200 len: 1318 microversion: 2.1 time: 0.155164 Jul 20 19:29:20.416057 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 279/570] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:20 2022] GET /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:29:20.480644 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-db75dd53-2c53-417b-a243-08a5cae1146c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:20.481276 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-db75dd53-2c53-417b-a243-08a5cae1146c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:20.488000 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-db75dd53-2c53-417b-a243-08a5cae1146c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:20.488446 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-db75dd53-2c53-417b-a243-08a5cae1146c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:20.489202 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-db75dd53-2c53-417b-a243-08a5cae1146c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:20.489666 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-db75dd53-2c53-417b-a243-08a5cae1146c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:20.618916 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-db75dd53-2c53-417b-a243-08a5cae1146c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:20.626832 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-db75dd53-2c53-417b-a243-08a5cae1146c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:20.628325 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-db75dd53-2c53-417b-a243-08a5cae1146c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:20.629458 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-db75dd53-2c53-417b-a243-08a5cae1146c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1722 microversion: 2.20 time: 0.152974 Jul 20 19:29:20.630032 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 292/571] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:20 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:21.390024 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-5a82dc14-5932-40a7-bf6e-c111960d6cc6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:21.390623 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-5a82dc14-5932-40a7-bf6e-c111960d6cc6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:21.397096 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5a82dc14-5932-40a7-bf6e-c111960d6cc6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:21.397585 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5a82dc14-5932-40a7-bf6e-c111960d6cc6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:21.398330 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5a82dc14-5932-40a7-bf6e-c111960d6cc6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:21.398761 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5a82dc14-5932-40a7-bf6e-c111960d6cc6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:21.431983 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-b1a1ec6f-0a5d-4f07-b9ec-d339adc00672 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:21.432737 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-b1a1ec6f-0a5d-4f07-b9ec-d339adc00672 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] [instance: 43fe56ab-bf09-4ec0-84d5-306f16cb9d5a] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:21.439462 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b1a1ec6f-0a5d-4f07-b9ec-d339adc00672 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:21.439910 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b1a1ec6f-0a5d-4f07-b9ec-d339adc00672 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:21.440679 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b1a1ec6f-0a5d-4f07-b9ec-d339adc00672 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:21.441108 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b1a1ec6f-0a5d-4f07-b9ec-d339adc00672 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:21.536763 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-5a82dc14-5932-40a7-bf6e-c111960d6cc6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:21.544238 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-5a82dc14-5932-40a7-bf6e-c111960d6cc6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1276 microversion: 2.1 time: 0.158766 Jul 20 19:29:21.544857 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 280/572] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:21 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1276 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:21.573044 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-b1a1ec6f-0a5d-4f07-b9ec-d339adc00672 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ae826a812b44328c48b82e9498ad8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bb4af78c1d4589b1d3cc90d5e6be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:21.581104 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-b1a1ec6f-0a5d-4f07-b9ec-d339adc00672 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] 10.222.0.69 "GET /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a" status: 200 len: 1318 microversion: 2.1 time: 0.152889 Jul 20 19:29:21.581731 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 293/573] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:21 2022] GET /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:29:21.646767 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4287dc5d-0b68-4fa1-839d-451aee8ac6d3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:21.647287 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-4287dc5d-0b68-4fa1-839d-451aee8ac6d3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:21.653189 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4287dc5d-0b68-4fa1-839d-451aee8ac6d3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:21.653673 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4287dc5d-0b68-4fa1-839d-451aee8ac6d3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:21.655008 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4287dc5d-0b68-4fa1-839d-451aee8ac6d3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:21.655437 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4287dc5d-0b68-4fa1-839d-451aee8ac6d3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:21.784586 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-4287dc5d-0b68-4fa1-839d-451aee8ac6d3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:21.792523 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-4287dc5d-0b68-4fa1-839d-451aee8ac6d3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:21.794040 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-4287dc5d-0b68-4fa1-839d-451aee8ac6d3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:21.795498 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-4287dc5d-0b68-4fa1-839d-451aee8ac6d3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1722 microversion: 2.20 time: 0.152378 Jul 20 19:29:21.796076 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 281/574] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:21 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:29:22.561063 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-f3446934-94bc-4292-9b91-d605bc016d65 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:22.561625 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-f3446934-94bc-4292-9b91-d605bc016d65 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:22.568050 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f3446934-94bc-4292-9b91-d605bc016d65 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:22.568493 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f3446934-94bc-4292-9b91-d605bc016d65 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:22.569245 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f3446934-94bc-4292-9b91-d605bc016d65 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:22.569727 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f3446934-94bc-4292-9b91-d605bc016d65 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:22.598755 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-1d6c3470-cf4d-4194-94ab-99a39a13c09a tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:22.599367 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-1d6c3470-cf4d-4194-94ab-99a39a13c09a tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] [instance: 43fe56ab-bf09-4ec0-84d5-306f16cb9d5a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:22.605986 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1d6c3470-cf4d-4194-94ab-99a39a13c09a tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:22.606434 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1d6c3470-cf4d-4194-94ab-99a39a13c09a tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:22.607330 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1d6c3470-cf4d-4194-94ab-99a39a13c09a tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:22.608490 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1d6c3470-cf4d-4194-94ab-99a39a13c09a tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:22.705595 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-f3446934-94bc-4292-9b91-d605bc016d65 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:22.713560 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-f3446934-94bc-4292-9b91-d605bc016d65 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1276 microversion: 2.1 time: 0.156438 Jul 20 19:29:22.714137 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 294/575] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:22 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1276 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:22.738694 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1d6c3470-cf4d-4194-94ab-99a39a13c09a tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ae826a812b44328c48b82e9498ad8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bb4af78c1d4589b1d3cc90d5e6be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:22.745958 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-1d6c3470-cf4d-4194-94ab-99a39a13c09a tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] 10.222.0.69 "GET /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a" status: 200 len: 1318 microversion: 2.1 time: 0.150977 Jul 20 19:29:22.746521 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 282/576] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:22 2022] GET /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:29:22.813918 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-44cb5c79-a84f-4b1e-b152-196e88676df6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:22.814433 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-44cb5c79-a84f-4b1e-b152-196e88676df6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:22.820439 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-44cb5c79-a84f-4b1e-b152-196e88676df6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:22.820883 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-44cb5c79-a84f-4b1e-b152-196e88676df6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:22.821664 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-44cb5c79-a84f-4b1e-b152-196e88676df6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:22.822099 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-44cb5c79-a84f-4b1e-b152-196e88676df6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:22.961330 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-44cb5c79-a84f-4b1e-b152-196e88676df6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:22.969723 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-44cb5c79-a84f-4b1e-b152-196e88676df6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:22.971355 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-44cb5c79-a84f-4b1e-b152-196e88676df6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:22.972496 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-44cb5c79-a84f-4b1e-b152-196e88676df6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1722 microversion: 2.20 time: 0.162836 Jul 20 19:29:22.973042 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 295/577] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:22 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:23.581438 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-f21ba336-6b5f-4b96-91ef-2328261b11a1 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:29:23.587648 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f21ba336-6b5f-4b96-91ef-2328261b11a1 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:23.588422 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f21ba336-6b5f-4b96-91ef-2328261b11a1 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:23.652952 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-f21ba336-6b5f-4b96-91ef-2328261b11a1 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Going to try to stop instance {{(pid=117761) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 19:29:23.700447 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-f21ba336-6b5f-4b96-91ef-2328261b11a1 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "POST /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a/action" status: 202 len: 0 microversion: 2.1 time: 0.123413 Jul 20 19:29:23.704607 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 283/578] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Jul 20 19:29:23 2022] POST /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 19:29:23.710558 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-fc1f374b-4ab7-4139-92ad-c6ed70d802ce tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:23.711221 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-fc1f374b-4ab7-4139-92ad-c6ed70d802ce tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:23.714811 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_cell0:SELECT=4 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:23.715701 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_cell0:SELECT=16 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:23.720500 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-fc1f374b-4ab7-4139-92ad-c6ed70d802ce tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:23.720928 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-fc1f374b-4ab7-4139-92ad-c6ed70d802ce tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:23.721756 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-fc1f374b-4ab7-4139-92ad-c6ed70d802ce tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:23.722269 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-fc1f374b-4ab7-4139-92ad-c6ed70d802ce tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:23.733411 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-b59896e5-c92b-4b96-a714-733bdd716fd3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:23.734319 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-b59896e5-c92b-4b96-a714-733bdd716fd3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:23.740893 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b59896e5-c92b-4b96-a714-733bdd716fd3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:23.741386 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b59896e5-c92b-4b96-a714-733bdd716fd3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:23.742482 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b59896e5-c92b-4b96-a714-733bdd716fd3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:23.743147 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b59896e5-c92b-4b96-a714-733bdd716fd3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:23.934842 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-b59896e5-c92b-4b96-a714-733bdd716fd3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:23.947527 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-b59896e5-c92b-4b96-a714-733bdd716fd3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1276 microversion: 2.1 time: 0.219743 Jul 20 19:29:23.948121 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 284/579] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:23 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1276 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:29:23.953283 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-60dbd79e-08d4-4c85-855c-c1dd96824e2d tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:23.954202 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-60dbd79e-08d4-4c85-855c-c1dd96824e2d tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] [instance: 43fe56ab-bf09-4ec0-84d5-306f16cb9d5a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:23.961382 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-60dbd79e-08d4-4c85-855c-c1dd96824e2d tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:23.961873 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-60dbd79e-08d4-4c85-855c-c1dd96824e2d tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:23.962663 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-60dbd79e-08d4-4c85-855c-c1dd96824e2d tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:23.963365 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-60dbd79e-08d4-4c85-855c-c1dd96824e2d tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:24.123136 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-60dbd79e-08d4-4c85-855c-c1dd96824e2d tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ae826a812b44328c48b82e9498ad8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bb4af78c1d4589b1d3cc90d5e6be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:24.131341 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-60dbd79e-08d4-4c85-855c-c1dd96824e2d tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] 10.222.0.69 "GET /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a" status: 200 len: 1318 microversion: 2.1 time: 0.182013 Jul 20 19:29:24.132361 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 285/580] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:23 2022] GET /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:24.143236 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-fc1f374b-4ab7-4139-92ad-c6ed70d802ce tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:24.146789 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a27d752e-bce3-44fe-ba03-9e7c9920aba0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:24.147313 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a27d752e-bce3-44fe-ba03-9e7c9920aba0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:24.153374 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-fc1f374b-4ab7-4139-92ad-c6ed70d802ce tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a" status: 200 len: 1724 microversion: 2.1 time: 0.447151 Jul 20 19:29:24.153777 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a27d752e-bce3-44fe-ba03-9e7c9920aba0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:24.154731 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 296/581] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:23 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a => generated 1724 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:24.154916 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a27d752e-bce3-44fe-ba03-9e7c9920aba0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:24.155875 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a27d752e-bce3-44fe-ba03-9e7c9920aba0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:24.156486 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a27d752e-bce3-44fe-ba03-9e7c9920aba0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:24.293610 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a27d752e-bce3-44fe-ba03-9e7c9920aba0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:24.302327 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a27d752e-bce3-44fe-ba03-9e7c9920aba0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:24.303814 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a27d752e-bce3-44fe-ba03-9e7c9920aba0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:24.304957 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a27d752e-bce3-44fe-ba03-9e7c9920aba0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1722 microversion: 2.20 time: 0.162061 Jul 20 19:29:24.305746 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 286/582] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:24 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:24.964921 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-afec0ec7-c4f9-4364-a9bc-69f3bc543a8d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:24.965543 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-afec0ec7-c4f9-4364-a9bc-69f3bc543a8d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:24.972188 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-afec0ec7-c4f9-4364-a9bc-69f3bc543a8d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:24.972637 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-afec0ec7-c4f9-4364-a9bc-69f3bc543a8d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:24.973392 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-afec0ec7-c4f9-4364-a9bc-69f3bc543a8d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:24.973858 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-afec0ec7-c4f9-4364-a9bc-69f3bc543a8d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:25.106548 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-afec0ec7-c4f9-4364-a9bc-69f3bc543a8d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:25.114319 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-afec0ec7-c4f9-4364-a9bc-69f3bc543a8d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1264 microversion: 2.1 time: 0.153550 Jul 20 19:29:25.114883 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 297/583] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:24 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:25.148194 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-f6d950aa-79d3-4e97-ae0b-66895ff38b6e tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:25.148805 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-f6d950aa-79d3-4e97-ae0b-66895ff38b6e tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] [instance: 43fe56ab-bf09-4ec0-84d5-306f16cb9d5a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:25.155841 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f6d950aa-79d3-4e97-ae0b-66895ff38b6e tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:25.156298 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f6d950aa-79d3-4e97-ae0b-66895ff38b6e tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:25.157064 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f6d950aa-79d3-4e97-ae0b-66895ff38b6e tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:25.157500 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f6d950aa-79d3-4e97-ae0b-66895ff38b6e tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:25.160235 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:25.172251 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-df7013c0-9550-4ba4-99f0-f207f642eb5f tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:25.172939 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-df7013c0-9550-4ba4-99f0-f207f642eb5f tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:25.179357 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-df7013c0-9550-4ba4-99f0-f207f642eb5f tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:25.179878 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-df7013c0-9550-4ba4-99f0-f207f642eb5f tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:25.180640 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-df7013c0-9550-4ba4-99f0-f207f642eb5f tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:25.181066 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-df7013c0-9550-4ba4-99f0-f207f642eb5f tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:25.292638 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-f6d950aa-79d3-4e97-ae0b-66895ff38b6e tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ae826a812b44328c48b82e9498ad8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bb4af78c1d4589b1d3cc90d5e6be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:25.300212 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-f6d950aa-79d3-4e97-ae0b-66895ff38b6e tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] 10.222.0.69 "GET /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a" status: 200 len: 1318 microversion: 2.1 time: 0.155801 Jul 20 19:29:25.300770 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 287/584] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:25 2022] GET /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:25.316083 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-df7013c0-9550-4ba4-99f0-f207f642eb5f tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:25.324412 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-5408eea3-1d1b-41bf-8f08-92faeb3541c3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:25.325004 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-df7013c0-9550-4ba4-99f0-f207f642eb5f tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a" status: 200 len: 1724 microversion: 2.1 time: 0.157234 Jul 20 19:29:25.325135 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-5408eea3-1d1b-41bf-8f08-92faeb3541c3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:25.325597 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 298/585] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:25 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:29:25.332423 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5408eea3-1d1b-41bf-8f08-92faeb3541c3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:25.332423 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5408eea3-1d1b-41bf-8f08-92faeb3541c3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:25.333307 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5408eea3-1d1b-41bf-8f08-92faeb3541c3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:25.333904 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5408eea3-1d1b-41bf-8f08-92faeb3541c3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:25.463510 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-5408eea3-1d1b-41bf-8f08-92faeb3541c3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:25.472389 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-5408eea3-1d1b-41bf-8f08-92faeb3541c3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:25.473955 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-5408eea3-1d1b-41bf-8f08-92faeb3541c3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:25.475119 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-5408eea3-1d1b-41bf-8f08-92faeb3541c3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1722 microversion: 2.20 time: 0.155183 Jul 20 19:29:25.475675 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 288/586] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:25 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:26.132316 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-572bb909-6b78-4574-9d55-2cd5ef8df8b2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:26.132914 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-572bb909-6b78-4574-9d55-2cd5ef8df8b2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:26.139568 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-572bb909-6b78-4574-9d55-2cd5ef8df8b2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:26.140003 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-572bb909-6b78-4574-9d55-2cd5ef8df8b2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:26.140758 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-572bb909-6b78-4574-9d55-2cd5ef8df8b2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:26.141187 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-572bb909-6b78-4574-9d55-2cd5ef8df8b2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:26.274756 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-572bb909-6b78-4574-9d55-2cd5ef8df8b2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:26.283509 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-572bb909-6b78-4574-9d55-2cd5ef8df8b2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1264 microversion: 2.1 time: 0.154975 Jul 20 19:29:26.284081 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 299/587] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:26 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:26.317529 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-6e1e9339-a551-4fb0-abee-0dd6f3ee7647 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:26.318300 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-6e1e9339-a551-4fb0-abee-0dd6f3ee7647 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] [instance: 43fe56ab-bf09-4ec0-84d5-306f16cb9d5a] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:26.324754 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-6e1e9339-a551-4fb0-abee-0dd6f3ee7647 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:26.325440 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-6e1e9339-a551-4fb0-abee-0dd6f3ee7647 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:26.326896 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-6e1e9339-a551-4fb0-abee-0dd6f3ee7647 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:26.327402 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-6e1e9339-a551-4fb0-abee-0dd6f3ee7647 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:26.390304 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [req-e9555c28-fbf4-478a-98ef-2e145b6c6b3e req-5951c95a-ed3b-4653-b75d-6775f4ac16d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43fe56ab-bf09-4ec0-84d5-306f16cb9d5a", "name": "network-vif-plugged", "status": "completed", "tag": "4d776a97-1613-4d92-893b-9c96e6a8a268"}]} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:29:26.399235 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-e9555c28-fbf4-478a-98ef-2e145b6c6b3e req-5951c95a-ed3b-4653-b75d-6775f4ac16d8 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:26.399685 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-e9555c28-fbf4-478a-98ef-2e145b6c6b3e req-5951c95a-ed3b-4653-b75d-6775f4ac16d8 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:26.411941 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.compute.server_external_events [req-e9555c28-fbf4-478a-98ef-2e145b6c6b3e req-5951c95a-ed3b-4653-b75d-6775f4ac16d8 service nova] Creating event network-vif-plugged:4d776a97-1613-4d92-893b-9c96e6a8a268 for instance 43fe56ab-bf09-4ec0-84d5-306f16cb9d5a on hv-cinder-83538 Jul 20 19:29:26.417033 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [req-e9555c28-fbf4-478a-98ef-2e145b6c6b3e req-5951c95a-ed3b-4653-b75d-6775f4ac16d8 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104908 Jul 20 19:29:26.417679 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 289/588] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 19:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:29:26.425098 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-7a729fe5-5e28-4186-a789-76096f6a9152 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:26.425897 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-7a729fe5-5e28-4186-a789-76096f6a9152 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:26.432924 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7a729fe5-5e28-4186-a789-76096f6a9152 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:26.433436 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7a729fe5-5e28-4186-a789-76096f6a9152 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:26.434244 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7a729fe5-5e28-4186-a789-76096f6a9152 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:26.434747 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7a729fe5-5e28-4186-a789-76096f6a9152 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:26.471369 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-6e1e9339-a551-4fb0-abee-0dd6f3ee7647 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ae826a812b44328c48b82e9498ad8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bb4af78c1d4589b1d3cc90d5e6be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:26.479125 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-6e1e9339-a551-4fb0-abee-0dd6f3ee7647 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] 10.222.0.69 "GET /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a" status: 200 len: 1318 microversion: 2.1 time: 0.165398 Jul 20 19:29:26.479701 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 300/589] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:26 2022] GET /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:29:26.493543 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-2ea5ee88-6061-4de4-88d7-82ef717cb1fb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:26.494260 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-2ea5ee88-6061-4de4-88d7-82ef717cb1fb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:26.501007 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2ea5ee88-6061-4de4-88d7-82ef717cb1fb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:26.501590 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2ea5ee88-6061-4de4-88d7-82ef717cb1fb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:26.502424 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2ea5ee88-6061-4de4-88d7-82ef717cb1fb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:26.502944 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2ea5ee88-6061-4de4-88d7-82ef717cb1fb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:26.521714 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_cell1:SELECT=100 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:26.582179 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-7a729fe5-5e28-4186-a789-76096f6a9152 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:26.590416 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-7a729fe5-5e28-4186-a789-76096f6a9152 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a" status: 200 len: 1724 microversion: 2.1 time: 0.170791 Jul 20 19:29:26.590993 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 290/590] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:26 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:26.641446 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-2ea5ee88-6061-4de4-88d7-82ef717cb1fb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:26.649817 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-2ea5ee88-6061-4de4-88d7-82ef717cb1fb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:26.651368 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-2ea5ee88-6061-4de4-88d7-82ef717cb1fb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:26.652529 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-2ea5ee88-6061-4de4-88d7-82ef717cb1fb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1722 microversion: 2.20 time: 0.162911 Jul 20 19:29:26.653085 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 301/591] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:26 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:29:27.300219 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-2423328d-3c23-4716-b275-2be103e7261f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:27.300838 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-2423328d-3c23-4716-b275-2be103e7261f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:27.306854 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2423328d-3c23-4716-b275-2be103e7261f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:27.307304 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2423328d-3c23-4716-b275-2be103e7261f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:27.308096 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2423328d-3c23-4716-b275-2be103e7261f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:27.308526 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2423328d-3c23-4716-b275-2be103e7261f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:27.443556 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-2423328d-3c23-4716-b275-2be103e7261f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:27.451396 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-2423328d-3c23-4716-b275-2be103e7261f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1264 microversion: 2.1 time: 0.154969 Jul 20 19:29:27.451965 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 291/592] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:27 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:27.499063 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-4d37087b-bba2-46f0-8e9f-9f5b31f408d7 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:27.499657 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-4d37087b-bba2-46f0-8e9f-9f5b31f408d7 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] [instance: 43fe56ab-bf09-4ec0-84d5-306f16cb9d5a] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:27.506354 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4d37087b-bba2-46f0-8e9f-9f5b31f408d7 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:27.506792 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4d37087b-bba2-46f0-8e9f-9f5b31f408d7 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:27.507537 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4d37087b-bba2-46f0-8e9f-9f5b31f408d7 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:27.507959 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4d37087b-bba2-46f0-8e9f-9f5b31f408d7 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:27.610120 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-fb5fe996-de70-44e4-aa3d-96187b31c74f tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:27.610758 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-fb5fe996-de70-44e4-aa3d-96187b31c74f tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:27.616667 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fb5fe996-de70-44e4-aa3d-96187b31c74f tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:27.617109 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fb5fe996-de70-44e4-aa3d-96187b31c74f tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:27.618162 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fb5fe996-de70-44e4-aa3d-96187b31c74f tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:27.618482 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fb5fe996-de70-44e4-aa3d-96187b31c74f tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:27.639303 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-4d37087b-bba2-46f0-8e9f-9f5b31f408d7 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ae826a812b44328c48b82e9498ad8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bb4af78c1d4589b1d3cc90d5e6be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:27.646994 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-4d37087b-bba2-46f0-8e9f-9f5b31f408d7 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] 10.222.0.69 "GET /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a" status: 200 len: 1318 microversion: 2.1 time: 0.152582 Jul 20 19:29:27.647814 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 302/593] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:27 2022] GET /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:27.671698 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-eadf41d3-f5ef-477e-8491-89af5476a9e2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:27.672410 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-eadf41d3-f5ef-477e-8491-89af5476a9e2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:27.691251 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-eadf41d3-f5ef-477e-8491-89af5476a9e2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:27.691725 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-eadf41d3-f5ef-477e-8491-89af5476a9e2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:27.694574 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-eadf41d3-f5ef-477e-8491-89af5476a9e2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:27.694574 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-eadf41d3-f5ef-477e-8491-89af5476a9e2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:27.778283 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-fb5fe996-de70-44e4-aa3d-96187b31c74f tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:27.789011 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-fb5fe996-de70-44e4-aa3d-96187b31c74f tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a" status: 200 len: 1724 microversion: 2.1 time: 0.183915 Jul 20 19:29:27.789958 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 292/594] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:27 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:29:27.835205 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-eadf41d3-f5ef-477e-8491-89af5476a9e2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:27.844370 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-eadf41d3-f5ef-477e-8491-89af5476a9e2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:27.845844 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-eadf41d3-f5ef-477e-8491-89af5476a9e2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:27.847030 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-eadf41d3-f5ef-477e-8491-89af5476a9e2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1722 microversion: 2.20 time: 0.180037 Jul 20 19:29:27.847586 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 303/595] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:27 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:29:28.468562 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-0b0a90f2-a52d-4d35-b7e2-5ed20673042d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:28.469229 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-0b0a90f2-a52d-4d35-b7e2-5ed20673042d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:28.475546 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0b0a90f2-a52d-4d35-b7e2-5ed20673042d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:28.475987 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0b0a90f2-a52d-4d35-b7e2-5ed20673042d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:28.476732 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0b0a90f2-a52d-4d35-b7e2-5ed20673042d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:28.477200 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0b0a90f2-a52d-4d35-b7e2-5ed20673042d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:28.611569 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0b0a90f2-a52d-4d35-b7e2-5ed20673042d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:28.619947 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-0b0a90f2-a52d-4d35-b7e2-5ed20673042d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1264 microversion: 2.1 time: 0.156228 Jul 20 19:29:28.620600 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 293/596] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:28 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:28.664153 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-547bfd42-075b-43de-83bc-93e36a5411b6 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:28.664749 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-547bfd42-075b-43de-83bc-93e36a5411b6 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] [instance: 43fe56ab-bf09-4ec0-84d5-306f16cb9d5a] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:28.671327 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-547bfd42-075b-43de-83bc-93e36a5411b6 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:28.671763 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-547bfd42-075b-43de-83bc-93e36a5411b6 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:28.672507 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-547bfd42-075b-43de-83bc-93e36a5411b6 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:28.672933 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-547bfd42-075b-43de-83bc-93e36a5411b6 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:28.806658 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-547bfd42-075b-43de-83bc-93e36a5411b6 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ae826a812b44328c48b82e9498ad8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bb4af78c1d4589b1d3cc90d5e6be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:28.807247 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-821dbcd3-f9f5-4a7f-a416-b8a57f294189 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:28.807856 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-821dbcd3-f9f5-4a7f-a416-b8a57f294189 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:28.814397 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-821dbcd3-f9f5-4a7f-a416-b8a57f294189 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:28.814786 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-547bfd42-075b-43de-83bc-93e36a5411b6 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] 10.222.0.69 "GET /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a" status: 200 len: 1318 microversion: 2.1 time: 0.154561 Jul 20 19:29:28.814944 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-821dbcd3-f9f5-4a7f-a416-b8a57f294189 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:28.815619 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-821dbcd3-f9f5-4a7f-a416-b8a57f294189 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:28.815739 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 304/597] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:28 2022] GET /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:28.816048 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-821dbcd3-f9f5-4a7f-a416-b8a57f294189 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:28.865317 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-b8869e6e-fe86-4f74-a15b-299d2d7ef178 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:28.866302 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-b8869e6e-fe86-4f74-a15b-299d2d7ef178 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:28.872621 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b8869e6e-fe86-4f74-a15b-299d2d7ef178 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:28.873070 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b8869e6e-fe86-4f74-a15b-299d2d7ef178 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:28.874712 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b8869e6e-fe86-4f74-a15b-299d2d7ef178 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:28.875227 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b8869e6e-fe86-4f74-a15b-299d2d7ef178 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:28.952835 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-821dbcd3-f9f5-4a7f-a416-b8a57f294189 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:28.962304 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-821dbcd3-f9f5-4a7f-a416-b8a57f294189 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a" status: 200 len: 1724 microversion: 2.1 time: 0.159173 Jul 20 19:29:28.963659 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 294/598] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:28 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:29:29.016275 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-b8869e6e-fe86-4f74-a15b-299d2d7ef178 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:29.024764 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-b8869e6e-fe86-4f74-a15b-299d2d7ef178 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:29.026335 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-b8869e6e-fe86-4f74-a15b-299d2d7ef178 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:29.027494 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-b8869e6e-fe86-4f74-a15b-299d2d7ef178 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1722 microversion: 2.20 time: 0.166136 Jul 20 19:29:29.028051 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 305/599] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:28 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:29:29.637238 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-60464ee7-9bfc-4cb7-b1c8-b43a07f2ad47 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:29.637807 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-60464ee7-9bfc-4cb7-b1c8-b43a07f2ad47 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:29.645259 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-60464ee7-9bfc-4cb7-b1c8-b43a07f2ad47 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:29.645748 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-60464ee7-9bfc-4cb7-b1c8-b43a07f2ad47 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:29.646516 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-60464ee7-9bfc-4cb7-b1c8-b43a07f2ad47 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:29.646974 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-60464ee7-9bfc-4cb7-b1c8-b43a07f2ad47 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:29.779670 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-60464ee7-9bfc-4cb7-b1c8-b43a07f2ad47 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:29.788485 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-60464ee7-9bfc-4cb7-b1c8-b43a07f2ad47 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1264 microversion: 2.1 time: 0.155243 Jul 20 19:29:29.789066 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 295/600] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:29 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:29.834154 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-ff1e35b4-5b46-4103-a905-f7502d238d04 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:29.834765 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-ff1e35b4-5b46-4103-a905-f7502d238d04 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] [instance: 43fe56ab-bf09-4ec0-84d5-306f16cb9d5a] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:29.841684 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-ff1e35b4-5b46-4103-a905-f7502d238d04 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:29.842135 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-ff1e35b4-5b46-4103-a905-f7502d238d04 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:29.843516 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-ff1e35b4-5b46-4103-a905-f7502d238d04 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:29.844056 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-ff1e35b4-5b46-4103-a905-f7502d238d04 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:29.971710 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-ff1e35b4-5b46-4103-a905-f7502d238d04 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ae826a812b44328c48b82e9498ad8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bb4af78c1d4589b1d3cc90d5e6be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:29.979213 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-ff1e35b4-5b46-4103-a905-f7502d238d04 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] 10.222.0.69 "GET /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a" status: 200 len: 1318 microversion: 2.1 time: 0.148823 Jul 20 19:29:29.979779 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 306/601] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:29 2022] GET /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:29:29.980058 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-add6c297-ea38-4c57-bbba-a7bcd5093662 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:29.980693 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-add6c297-ea38-4c57-bbba-a7bcd5093662 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:29.987569 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-add6c297-ea38-4c57-bbba-a7bcd5093662 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:29.988010 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-add6c297-ea38-4c57-bbba-a7bcd5093662 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:29.988763 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-add6c297-ea38-4c57-bbba-a7bcd5093662 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:29.989195 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-add6c297-ea38-4c57-bbba-a7bcd5093662 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:30.046555 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-043fb436-7cb3-44ab-8ac7-a90ac86fa6d6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:30.047352 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-043fb436-7cb3-44ab-8ac7-a90ac86fa6d6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:30.053425 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-043fb436-7cb3-44ab-8ac7-a90ac86fa6d6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:30.053908 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-043fb436-7cb3-44ab-8ac7-a90ac86fa6d6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:30.054670 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-043fb436-7cb3-44ab-8ac7-a90ac86fa6d6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:30.055105 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-043fb436-7cb3-44ab-8ac7-a90ac86fa6d6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:30.125868 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-add6c297-ea38-4c57-bbba-a7bcd5093662 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:30.133978 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-add6c297-ea38-4c57-bbba-a7bcd5093662 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a" status: 200 len: 1724 microversion: 2.1 time: 0.157698 Jul 20 19:29:30.134549 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 296/602] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:29 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:29:30.184114 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-043fb436-7cb3-44ab-8ac7-a90ac86fa6d6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:30.192280 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-043fb436-7cb3-44ab-8ac7-a90ac86fa6d6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:30.193810 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-043fb436-7cb3-44ab-8ac7-a90ac86fa6d6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:30.194953 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-043fb436-7cb3-44ab-8ac7-a90ac86fa6d6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1722 microversion: 2.20 time: 0.153067 Jul 20 19:29:30.195507 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 307/603] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:30 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:29:30.805472 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-3c1727d2-bf19-4cb8-862c-a395681b29f5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:30.806103 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-3c1727d2-bf19-4cb8-862c-a395681b29f5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:30.813203 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3c1727d2-bf19-4cb8-862c-a395681b29f5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:30.813691 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3c1727d2-bf19-4cb8-862c-a395681b29f5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:30.814473 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3c1727d2-bf19-4cb8-862c-a395681b29f5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:30.814939 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3c1727d2-bf19-4cb8-862c-a395681b29f5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:30.950445 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3c1727d2-bf19-4cb8-862c-a395681b29f5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:30.958098 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-3c1727d2-bf19-4cb8-862c-a395681b29f5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1264 microversion: 2.1 time: 0.156515 Jul 20 19:29:30.958676 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 297/604] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:30 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:30.995813 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-a6574488-5753-4557-b3e0-fb0793e4b986 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:30.996423 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-a6574488-5753-4557-b3e0-fb0793e4b986 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] [instance: 43fe56ab-bf09-4ec0-84d5-306f16cb9d5a] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:31.003138 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a6574488-5753-4557-b3e0-fb0793e4b986 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:31.003586 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a6574488-5753-4557-b3e0-fb0793e4b986 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:31.004346 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a6574488-5753-4557-b3e0-fb0793e4b986 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:31.004792 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a6574488-5753-4557-b3e0-fb0793e4b986 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:31.136863 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-a6574488-5753-4557-b3e0-fb0793e4b986 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ae826a812b44328c48b82e9498ad8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bb4af78c1d4589b1d3cc90d5e6be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:31.146028 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-a6574488-5753-4557-b3e0-fb0793e4b986 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] 10.222.0.69 "GET /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a" status: 200 len: 1318 microversion: 2.1 time: 0.154283 Jul 20 19:29:31.146850 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 308/605] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:30 2022] GET /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:31.151970 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-f29bc292-d968-4422-8a0f-3faff03b6b47 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:31.152591 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-f29bc292-d968-4422-8a0f-3faff03b6b47 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:31.161942 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f29bc292-d968-4422-8a0f-3faff03b6b47 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:31.162397 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f29bc292-d968-4422-8a0f-3faff03b6b47 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:31.163480 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f29bc292-d968-4422-8a0f-3faff03b6b47 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:31.164035 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f29bc292-d968-4422-8a0f-3faff03b6b47 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:31.214378 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-4b4e36e3-0508-4f83-acb7-09ac91bfedca tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:31.214978 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-4b4e36e3-0508-4f83-acb7-09ac91bfedca tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:31.221803 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4b4e36e3-0508-4f83-acb7-09ac91bfedca tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:31.222253 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4b4e36e3-0508-4f83-acb7-09ac91bfedca tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:31.223051 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4b4e36e3-0508-4f83-acb7-09ac91bfedca tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:31.223487 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4b4e36e3-0508-4f83-acb7-09ac91bfedca tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:31.301696 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-f29bc292-d968-4422-8a0f-3faff03b6b47 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:31.310017 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-f29bc292-d968-4422-8a0f-3faff03b6b47 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a" status: 200 len: 1724 microversion: 2.1 time: 0.162059 Jul 20 19:29:31.310590 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 298/606] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:31 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:29:31.354993 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-4b4e36e3-0508-4f83-acb7-09ac91bfedca tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:31.363043 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-4b4e36e3-0508-4f83-acb7-09ac91bfedca tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:31.364552 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-4b4e36e3-0508-4f83-acb7-09ac91bfedca tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:31.365740 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-4b4e36e3-0508-4f83-acb7-09ac91bfedca tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1722 microversion: 2.20 time: 0.156049 Jul 20 19:29:31.366297 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 309/607] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:31 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:29:31.975781 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-59de0f50-44e5-421f-a41d-c879fefcd43d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:31.976412 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-59de0f50-44e5-421f-a41d-c879fefcd43d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:31.982932 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-59de0f50-44e5-421f-a41d-c879fefcd43d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:31.983374 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-59de0f50-44e5-421f-a41d-c879fefcd43d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:31.984131 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-59de0f50-44e5-421f-a41d-c879fefcd43d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:31.985271 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-59de0f50-44e5-421f-a41d-c879fefcd43d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:32.117819 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-59de0f50-44e5-421f-a41d-c879fefcd43d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:32.125329 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-59de0f50-44e5-421f-a41d-c879fefcd43d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1264 microversion: 2.1 time: 0.153238 Jul 20 19:29:32.126478 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 299/608] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:31 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:32.162719 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-3cdd77b4-5093-431a-805a-d57dd38ed79c tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:32.163324 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-3cdd77b4-5093-431a-805a-d57dd38ed79c tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] [instance: 43fe56ab-bf09-4ec0-84d5-306f16cb9d5a] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:32.169847 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3cdd77b4-5093-431a-805a-d57dd38ed79c tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:32.170295 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3cdd77b4-5093-431a-805a-d57dd38ed79c tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:32.171047 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3cdd77b4-5093-431a-805a-d57dd38ed79c tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:32.171481 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3cdd77b4-5093-431a-805a-d57dd38ed79c tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:32.307605 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-3cdd77b4-5093-431a-805a-d57dd38ed79c tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ae826a812b44328c48b82e9498ad8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bb4af78c1d4589b1d3cc90d5e6be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:32.316020 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-3cdd77b4-5093-431a-805a-d57dd38ed79c tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] 10.222.0.69 "GET /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a" status: 200 len: 1318 microversion: 2.1 time: 0.157115 Jul 20 19:29:32.316687 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 310/609] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:32 2022] GET /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:32.327628 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-7d1b2f20-1de3-4203-a77d-c18fdab9b1ab tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:32.328235 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-7d1b2f20-1de3-4203-a77d-c18fdab9b1ab tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:32.334869 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7d1b2f20-1de3-4203-a77d-c18fdab9b1ab tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:32.335320 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7d1b2f20-1de3-4203-a77d-c18fdab9b1ab tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:32.336080 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7d1b2f20-1de3-4203-a77d-c18fdab9b1ab tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:32.336527 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7d1b2f20-1de3-4203-a77d-c18fdab9b1ab tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:32.383504 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-f6ca05ea-4ed9-4713-9066-090433842666 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:32.384105 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-f6ca05ea-4ed9-4713-9066-090433842666 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:32.390249 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f6ca05ea-4ed9-4713-9066-090433842666 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:32.390695 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f6ca05ea-4ed9-4713-9066-090433842666 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:32.392090 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f6ca05ea-4ed9-4713-9066-090433842666 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:32.392520 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f6ca05ea-4ed9-4713-9066-090433842666 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:32.470304 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-7d1b2f20-1de3-4203-a77d-c18fdab9b1ab tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:32.478350 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-7d1b2f20-1de3-4203-a77d-c18fdab9b1ab tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a" status: 200 len: 1724 microversion: 2.1 time: 0.154582 Jul 20 19:29:32.478924 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 300/610] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:32 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:32.527650 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-f6ca05ea-4ed9-4713-9066-090433842666 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:32.535630 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-f6ca05ea-4ed9-4713-9066-090433842666 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:32.537142 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-f6ca05ea-4ed9-4713-9066-090433842666 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:32.538311 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-f6ca05ea-4ed9-4713-9066-090433842666 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1743 microversion: 2.20 time: 0.158792 Jul 20 19:29:32.538879 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 311/611] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:32 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1743 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:29:33.144162 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d847db7e-117d-4674-afc1-83c31028154c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:33.145164 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d847db7e-117d-4674-afc1-83c31028154c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:33.151678 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d847db7e-117d-4674-afc1-83c31028154c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:33.152160 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d847db7e-117d-4674-afc1-83c31028154c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:33.152929 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d847db7e-117d-4674-afc1-83c31028154c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:33.153369 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d847db7e-117d-4674-afc1-83c31028154c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:33.295967 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d847db7e-117d-4674-afc1-83c31028154c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:33.303409 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d847db7e-117d-4674-afc1-83c31028154c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1264 microversion: 2.1 time: 0.164113 Jul 20 19:29:33.303967 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 301/612] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:33 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:33.332850 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-fe999e6e-a1fc-45a0-96e5-98506731f108 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:33.333494 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-fe999e6e-a1fc-45a0-96e5-98506731f108 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] [instance: 43fe56ab-bf09-4ec0-84d5-306f16cb9d5a] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:33.340389 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-fe999e6e-a1fc-45a0-96e5-98506731f108 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:33.340839 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-fe999e6e-a1fc-45a0-96e5-98506731f108 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:33.341621 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-fe999e6e-a1fc-45a0-96e5-98506731f108 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:33.342059 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-fe999e6e-a1fc-45a0-96e5-98506731f108 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:33.473747 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-fe999e6e-a1fc-45a0-96e5-98506731f108 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ae826a812b44328c48b82e9498ad8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bb4af78c1d4589b1d3cc90d5e6be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:33.481204 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-fe999e6e-a1fc-45a0-96e5-98506731f108 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] 10.222.0.69 "GET /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a" status: 200 len: 1507 microversion: 2.1 time: 0.152933 Jul 20 19:29:33.481814 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 312/613] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:33 2022] GET /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:33.496302 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-52024b06-3521-4790-b41b-9479590a53a8 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:33.496905 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-52024b06-3521-4790-b41b-9479590a53a8 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:33.498641 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-20efd09f-39e7-4314-9471-44ecc5c60f50 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "314fa7fd-d882-4be3-a319-c7a44c9d8bba", "device": "/dev/sdb"}} {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:29:33.500920 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-20efd09f-39e7-4314-9471-44ecc5c60f50 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] [instance: 43fe56ab-bf09-4ec0-84d5-306f16cb9d5a] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:33.504349 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-52024b06-3521-4790-b41b-9479590a53a8 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:33.504791 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-52024b06-3521-4790-b41b-9479590a53a8 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:33.505572 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-52024b06-3521-4790-b41b-9479590a53a8 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:33.506001 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-52024b06-3521-4790-b41b-9479590a53a8 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:33.507091 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-20efd09f-39e7-4314-9471-44ecc5c60f50 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:33.507531 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-20efd09f-39e7-4314-9471-44ecc5c60f50 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:33.508276 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-20efd09f-39e7-4314-9471-44ecc5c60f50 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:33.508751 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-20efd09f-39e7-4314-9471-44ecc5c60f50 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:33.640076 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-52024b06-3521-4790-b41b-9479590a53a8 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:33.648369 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-52024b06-3521-4790-b41b-9479590a53a8 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a" status: 200 len: 1724 microversion: 2.1 time: 0.156524 Jul 20 19:29:33.648932 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 302/614] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:33 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:33.653600 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-b79fa276-93a0-47a8-9b03-97d00cedb818 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:33.654219 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-b79fa276-93a0-47a8-9b03-97d00cedb818 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:33.660145 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b79fa276-93a0-47a8-9b03-97d00cedb818 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:33.660518 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b79fa276-93a0-47a8-9b03-97d00cedb818 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:33.661265 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b79fa276-93a0-47a8-9b03-97d00cedb818 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:33.661728 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b79fa276-93a0-47a8-9b03-97d00cedb818 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:33.799956 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-b79fa276-93a0-47a8-9b03-97d00cedb818 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:33.808177 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-b79fa276-93a0-47a8-9b03-97d00cedb818 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:33.809790 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-b79fa276-93a0-47a8-9b03-97d00cedb818 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:33.811066 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-b79fa276-93a0-47a8-9b03-97d00cedb818 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1743 microversion: 2.20 time: 0.161191 Jul 20 19:29:33.811702 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 303/615] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:33 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1743 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:34.043469 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-70f1100d-0b41-4aa8-95f5-799e27a5da2e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1328241586", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1245547191", "security_groups": [{"name": "tempest-secgroup-smoke-808235579"}], "networks": [{"uuid": "b7e436a7-95a3-4e1b-a61b-934fed4b0d92"}], "block_device_mapping_v2": [{"uuid": "0aabe444-b0ff-42b1-9a95-76cfe20edd49", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:29:34.153435 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.network.neutron [None req-70f1100d-0b41-4aa8-95f5-799e27a5da2e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] validate_networks() for [('b7e436a7-95a3-4e1b-a61b-934fed4b0d92', None, None, None, None, None)] {{(pid=117761) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 19:29:34.581105 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.virt.hardware [None req-70f1100d-0b41-4aa8-95f5-799e27a5da2e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Flavor limits 0:0:0 {{(pid=117761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 19:29:34.581537 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.virt.hardware [None req-70f1100d-0b41-4aa8-95f5-799e27a5da2e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Image limits 0:0:0 {{(pid=117761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 19:29:34.582012 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.virt.hardware [None req-70f1100d-0b41-4aa8-95f5-799e27a5da2e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Flavor pref 0:0:0 {{(pid=117761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 19:29:34.582478 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.virt.hardware [None req-70f1100d-0b41-4aa8-95f5-799e27a5da2e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Image pref 0:0:0 {{(pid=117761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 19:29:34.582888 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.virt.hardware [None req-70f1100d-0b41-4aa8-95f5-799e27a5da2e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 19:29:34.592546 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-70f1100d-0b41-4aa8-95f5-799e27a5da2e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:34.592984 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-70f1100d-0b41-4aa8-95f5-799e27a5da2e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:34.593827 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-70f1100d-0b41-4aa8-95f5-799e27a5da2e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:34.594555 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-70f1100d-0b41-4aa8-95f5-799e27a5da2e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:34.611540 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.quota [None req-70f1100d-0b41-4aa8-95f5-799e27a5da2e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Getting quotas for project da296fe635c84b99b1645ceaf0138b83. Resources: {'cores', 'ram', 'instances'} {{(pid=117761) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:29:34.615517 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.quota [None req-70f1100d-0b41-4aa8-95f5-799e27a5da2e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Getting quotas for user 4d7204f863c64eeeb7dab59a30c447b8 and project da296fe635c84b99b1645ceaf0138b83. Resources: {'cores', 'ram', 'instances'} {{(pid=117761) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:29:34.673203 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-70f1100d-0b41-4aa8-95f5-799e27a5da2e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Going to run 1 instances... {{(pid=117761) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 19:29:34.675358 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-70f1100d-0b41-4aa8-95f5-799e27a5da2e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0aabe444-b0ff-42b1-9a95-76cfe20edd49',volume_size=None,volume_type=None)] {{(pid=117761) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 19:29:34.808708 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-70f1100d-0b41-4aa8-95f5-799e27a5da2e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.768928 Jul 20 19:29:34.809364 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 304/616] 10.222.0.69 () {60 vars in 1146 bytes} [Wed Jul 20 19:29:34 2022] POST /compute/v2.1/servers => generated 405 bytes in 770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 19:29:34.818988 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-cf316560-3f53-4227-8803-a626608fe9e3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:34.819608 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-cf316560-3f53-4227-8803-a626608fe9e3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:34.830196 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cf316560-3f53-4227-8803-a626608fe9e3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:34.830689 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cf316560-3f53-4227-8803-a626608fe9e3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:34.831779 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cf316560-3f53-4227-8803-a626608fe9e3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:34.832220 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cf316560-3f53-4227-8803-a626608fe9e3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:34.835412 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:34.969068 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-cf316560-3f53-4227-8803-a626608fe9e3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:34.978025 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-cf316560-3f53-4227-8803-a626608fe9e3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1264 microversion: 2.1 time: 0.167527 Jul 20 19:29:34.987952 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 305/617] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:34 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:34.987952 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-1136ce92-5c6e-4ace-bfb7-bd893e8f2c06 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:34.987952 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-1136ce92-5c6e-4ace-bfb7-bd893e8f2c06 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:34.991032 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1136ce92-5c6e-4ace-bfb7-bd893e8f2c06 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:34.991484 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1136ce92-5c6e-4ace-bfb7-bd893e8f2c06 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:34.993415 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1136ce92-5c6e-4ace-bfb7-bd893e8f2c06 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:34.993921 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1136ce92-5c6e-4ace-bfb7-bd893e8f2c06 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:35.136637 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1136ce92-5c6e-4ace-bfb7-bd893e8f2c06 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:35.145228 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-1136ce92-5c6e-4ace-bfb7-bd893e8f2c06 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a" status: 200 len: 1724 microversion: 2.1 time: 0.165426 Jul 20 19:29:35.145836 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 306/618] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:34 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:35.158929 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-beb8b2e9-3157-466d-93ca-a02ae8272e48 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:35.159689 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-beb8b2e9-3157-466d-93ca-a02ae8272e48 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:35.215623 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-beb8b2e9-3157-466d-93ca-a02ae8272e48 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:35.222746 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-beb8b2e9-3157-466d-93ca-a02ae8272e48 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1089 microversion: 2.1 time: 0.075964 Jul 20 19:29:35.223323 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 307/619] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:35 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1089 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:35.227869 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c149f7db-3165-41f1-98f2-c8812b1288c1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:35.228461 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c149f7db-3165-41f1-98f2-c8812b1288c1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:35.234048 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c149f7db-3165-41f1-98f2-c8812b1288c1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:35.235169 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c149f7db-3165-41f1-98f2-c8812b1288c1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:35.236341 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c149f7db-3165-41f1-98f2-c8812b1288c1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:35.236779 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c149f7db-3165-41f1-98f2-c8812b1288c1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:35.369140 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c149f7db-3165-41f1-98f2-c8812b1288c1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:35.377341 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c149f7db-3165-41f1-98f2-c8812b1288c1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:35.378889 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c149f7db-3165-41f1-98f2-c8812b1288c1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:35.380114 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c149f7db-3165-41f1-98f2-c8812b1288c1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1743 microversion: 2.20 time: 0.155872 Jul 20 19:29:35.380674 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 308/620] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:35 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1743 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:35.996359 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e4405f6c-5cef-489d-a82d-1b31c255e601 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:35.997390 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e4405f6c-5cef-489d-a82d-1b31c255e601 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:36.005043 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e4405f6c-5cef-489d-a82d-1b31c255e601 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:36.005499 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e4405f6c-5cef-489d-a82d-1b31c255e601 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:36.006303 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e4405f6c-5cef-489d-a82d-1b31c255e601 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:36.006738 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e4405f6c-5cef-489d-a82d-1b31c255e601 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:36.100686 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-20efd09f-39e7-4314-9471-44ecc5c60f50 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] 10.222.0.69 "POST /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.605773 Jul 20 19:29:36.101836 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 313/621] 10.222.0.69 () {60 vars in 1322 bytes} [Wed Jul 20 19:29:33 2022] POST /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a/os-volume_attachments => generated 194 bytes in 2608 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:29:36.164993 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-ac92d73e-1aef-47f0-a31a-2e35aec1eb72 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:36.166219 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-ac92d73e-1aef-47f0-a31a-2e35aec1eb72 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:36.174874 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-ac92d73e-1aef-47f0-a31a-2e35aec1eb72 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:36.175376 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-ac92d73e-1aef-47f0-a31a-2e35aec1eb72 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:36.176166 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-ac92d73e-1aef-47f0-a31a-2e35aec1eb72 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:36.176756 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-ac92d73e-1aef-47f0-a31a-2e35aec1eb72 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:36.179350 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e4405f6c-5cef-489d-a82d-1b31c255e601 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:36.190573 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e4405f6c-5cef-489d-a82d-1b31c255e601 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1264 microversion: 2.1 time: 0.198377 Jul 20 19:29:36.191896 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 309/622] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:35 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1264 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:29:36.241280 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d55dc0f3-79db-451a-a4af-f6be944e971d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:36.242248 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d55dc0f3-79db-451a-a4af-f6be944e971d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:36.248302 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d55dc0f3-79db-451a-a4af-f6be944e971d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:36.248864 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d55dc0f3-79db-451a-a4af-f6be944e971d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:36.249744 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d55dc0f3-79db-451a-a4af-f6be944e971d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:36.250884 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d55dc0f3-79db-451a-a4af-f6be944e971d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:36.315898 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d55dc0f3-79db-451a-a4af-f6be944e971d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:36.324802 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d55dc0f3-79db-451a-a4af-f6be944e971d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1187 microversion: 2.1 time: 0.087953 Jul 20 19:29:36.325570 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 310/623] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:36 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1187 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:36.329694 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-ac92d73e-1aef-47f0-a31a-2e35aec1eb72 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:36.336532 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-ac92d73e-1aef-47f0-a31a-2e35aec1eb72 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a" status: 200 len: 1724 microversion: 2.1 time: 0.176243 Jul 20 19:29:36.337116 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 314/624] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:36 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:36.397865 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-1a5b131a-5c2a-4fb2-88a0-0d1f5b78e626 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:36.398473 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-1a5b131a-5c2a-4fb2-88a0-0d1f5b78e626 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:36.404529 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1a5b131a-5c2a-4fb2-88a0-0d1f5b78e626 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:36.405053 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1a5b131a-5c2a-4fb2-88a0-0d1f5b78e626 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:36.405916 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1a5b131a-5c2a-4fb2-88a0-0d1f5b78e626 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:36.407078 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1a5b131a-5c2a-4fb2-88a0-0d1f5b78e626 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:36.527700 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [req-fee9f852-068f-4241-9f63-93733989eea5 req-4e731b35-d507-433e-9ee7-0f08e624963f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b2abd53-4758-462c-b36a-0d1bf0b66a55", "name": "network-vif-plugged", "status": "completed", "tag": "3232872d-df06-40e7-a7c3-7cc3babe684d"}]} {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:29:36.542693 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1a5b131a-5c2a-4fb2-88a0-0d1f5b78e626 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:36.543271 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [req-fee9f852-068f-4241-9f63-93733989eea5 req-4e731b35-d507-433e-9ee7-0f08e624963f service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:36.544558 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [req-fee9f852-068f-4241-9f63-93733989eea5 req-4e731b35-d507-433e-9ee7-0f08e624963f service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:36.551009 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1a5b131a-5c2a-4fb2-88a0-0d1f5b78e626 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:36.552767 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1a5b131a-5c2a-4fb2-88a0-0d1f5b78e626 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:36.554168 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-1a5b131a-5c2a-4fb2-88a0-0d1f5b78e626 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1743 microversion: 2.20 time: 0.160243 Jul 20 19:29:36.556880 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.compute.server_external_events [req-fee9f852-068f-4241-9f63-93733989eea5 req-4e731b35-d507-433e-9ee7-0f08e624963f service nova] Creating event network-vif-plugged:3232872d-df06-40e7-a7c3-7cc3babe684d for instance 3b2abd53-4758-462c-b36a-0d1bf0b66a55 on hv-cinder-83538 Jul 20 19:29:36.562889 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [req-fee9f852-068f-4241-9f63-93733989eea5 req-4e731b35-d507-433e-9ee7-0f08e624963f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042061 Jul 20 19:29:36.563703 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 315/625] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 19:29:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:29:36.565769 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 311/626] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:36 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1743 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:37.209382 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-917f9bf0-1ebe-43f8-8296-2d8bbe1094b9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:37.211210 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-917f9bf0-1ebe-43f8-8296-2d8bbe1094b9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:37.219334 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-917f9bf0-1ebe-43f8-8296-2d8bbe1094b9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:37.220018 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-917f9bf0-1ebe-43f8-8296-2d8bbe1094b9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:37.220949 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-917f9bf0-1ebe-43f8-8296-2d8bbe1094b9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:37.221534 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-917f9bf0-1ebe-43f8-8296-2d8bbe1094b9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:37.346481 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-1c204a6b-07d8-44cc-8760-c27ab23fed5f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:37.347714 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-1c204a6b-07d8-44cc-8760-c27ab23fed5f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:37.350770 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:37.358377 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1c204a6b-07d8-44cc-8760-c27ab23fed5f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:37.359224 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1c204a6b-07d8-44cc-8760-c27ab23fed5f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:37.360404 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1c204a6b-07d8-44cc-8760-c27ab23fed5f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:37.360927 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1c204a6b-07d8-44cc-8760-c27ab23fed5f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:37.373120 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-917f9bf0-1ebe-43f8-8296-2d8bbe1094b9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:37.384757 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-917f9bf0-1ebe-43f8-8296-2d8bbe1094b9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1264 microversion: 2.1 time: 0.179662 Jul 20 19:29:37.387017 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 316/627] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:37 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1264 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:37.395938 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-4309d23e-0290-4f96-aebe-32887490dec4 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:37.398186 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-4309d23e-0290-4f96-aebe-32887490dec4 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:37.405019 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4309d23e-0290-4f96-aebe-32887490dec4 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:37.405470 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4309d23e-0290-4f96-aebe-32887490dec4 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:37.406897 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4309d23e-0290-4f96-aebe-32887490dec4 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:37.407543 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4309d23e-0290-4f96-aebe-32887490dec4 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:37.430406 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:37.572114 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-4309d23e-0290-4f96-aebe-32887490dec4 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:37.583498 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-4309d23e-0290-4f96-aebe-32887490dec4 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a" status: 200 len: 1724 microversion: 2.1 time: 0.194908 Jul 20 19:29:37.591415 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 317/628] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:37 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a => generated 1724 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:37.591415 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-4bd5abad-04ec-4934-af11-638d06807126 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:37.591415 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-4bd5abad-04ec-4934-af11-638d06807126 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:37.596731 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4bd5abad-04ec-4934-af11-638d06807126 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:37.597473 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4bd5abad-04ec-4934-af11-638d06807126 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:37.598888 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4bd5abad-04ec-4934-af11-638d06807126 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:37.599496 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4bd5abad-04ec-4934-af11-638d06807126 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:37.673622 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1c204a6b-07d8-44cc-8760-c27ab23fed5f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:37.683488 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-1c204a6b-07d8-44cc-8760-c27ab23fed5f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1272 microversion: 2.1 time: 0.343849 Jul 20 19:29:37.697412 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 312/629] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:37 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1272 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:37.751960 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-4bd5abad-04ec-4934-af11-638d06807126 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:37.764437 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-4bd5abad-04ec-4934-af11-638d06807126 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:37.766313 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-4bd5abad-04ec-4934-af11-638d06807126 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:37.767628 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-4bd5abad-04ec-4934-af11-638d06807126 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1743 microversion: 2.20 time: 0.182750 Jul 20 19:29:37.779019 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 318/630] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:37 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1743 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:38.280462 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [req-6449af2b-728e-47d1-beaa-cfdbbf92d64c req-1ff0872a-45a0-4fd4-926f-c0810decdfd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "239cb0b6-54d7-4cc2-945a-1f026a015992", "tag": "761fbace-90da-4e61-bc51-77b19745762a"}]} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:29:38.295776 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-6449af2b-728e-47d1-beaa-cfdbbf92d64c req-1ff0872a-45a0-4fd4-926f-c0810decdfd4 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:38.296229 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-6449af2b-728e-47d1-beaa-cfdbbf92d64c req-1ff0872a-45a0-4fd4-926f-c0810decdfd4 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:38.315607 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.compute.server_external_events [req-6449af2b-728e-47d1-beaa-cfdbbf92d64c req-1ff0872a-45a0-4fd4-926f-c0810decdfd4 service nova] Creating event network-changed:761fbace-90da-4e61-bc51-77b19745762a for instance 239cb0b6-54d7-4cc2-945a-1f026a015992 on hv-cinder-83538 Jul 20 19:29:38.323597 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [req-6449af2b-728e-47d1-beaa-cfdbbf92d64c req-1ff0872a-45a0-4fd4-926f-c0810decdfd4 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052629 Jul 20 19:29:38.324675 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 313/631] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 19:29:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:29:38.401788 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-3ef1acfc-4274-45b1-a7f7-64786dde427e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:38.402518 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-3ef1acfc-4274-45b1-a7f7-64786dde427e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:38.409568 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3ef1acfc-4274-45b1-a7f7-64786dde427e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:38.410268 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3ef1acfc-4274-45b1-a7f7-64786dde427e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:38.411224 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3ef1acfc-4274-45b1-a7f7-64786dde427e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:38.411820 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3ef1acfc-4274-45b1-a7f7-64786dde427e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:38.552262 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-3ef1acfc-4274-45b1-a7f7-64786dde427e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:38.559753 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-3ef1acfc-4274-45b1-a7f7-64786dde427e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1264 microversion: 2.1 time: 0.162257 Jul 20 19:29:38.560335 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 319/632] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:38 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:29:38.602298 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-cca04c16-6ce9-44f6-9314-c01850c4fd15 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:38.602992 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-cca04c16-6ce9-44f6-9314-c01850c4fd15 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:38.611329 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cca04c16-6ce9-44f6-9314-c01850c4fd15 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:38.611790 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cca04c16-6ce9-44f6-9314-c01850c4fd15 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:38.612575 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cca04c16-6ce9-44f6-9314-c01850c4fd15 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:38.613007 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cca04c16-6ce9-44f6-9314-c01850c4fd15 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:38.703949 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-3608838d-6fab-4890-b9cd-59d7b576ac98 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:38.704555 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-3608838d-6fab-4890-b9cd-59d7b576ac98 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:38.711006 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3608838d-6fab-4890-b9cd-59d7b576ac98 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:38.711450 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3608838d-6fab-4890-b9cd-59d7b576ac98 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:38.712220 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3608838d-6fab-4890-b9cd-59d7b576ac98 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:38.712920 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3608838d-6fab-4890-b9cd-59d7b576ac98 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:38.853158 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-3608838d-6fab-4890-b9cd-59d7b576ac98 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:38.860832 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-3608838d-6fab-4890-b9cd-59d7b576ac98 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1272 microversion: 2.1 time: 0.160745 Jul 20 19:29:38.861412 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 320/633] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:38 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1272 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:29:38.866048 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-2c17245f-2cb3-4a0c-a14b-201182ddc9ab tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:38.866642 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-2c17245f-2cb3-4a0c-a14b-201182ddc9ab tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:38.872723 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2c17245f-2cb3-4a0c-a14b-201182ddc9ab tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:38.873172 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2c17245f-2cb3-4a0c-a14b-201182ddc9ab tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:38.873963 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2c17245f-2cb3-4a0c-a14b-201182ddc9ab tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:38.874400 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2c17245f-2cb3-4a0c-a14b-201182ddc9ab tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:39.019788 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-2c17245f-2cb3-4a0c-a14b-201182ddc9ab tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:39.028278 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-2c17245f-2cb3-4a0c-a14b-201182ddc9ab tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:39.029932 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-2c17245f-2cb3-4a0c-a14b-201182ddc9ab tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:39.031714 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-2c17245f-2cb3-4a0c-a14b-201182ddc9ab tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1743 microversion: 2.20 time: 0.168818 Jul 20 19:29:39.032351 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 321/634] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:38 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1743 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:39.069750 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-cca04c16-6ce9-44f6-9314-c01850c4fd15 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:39.077457 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-cca04c16-6ce9-44f6-9314-c01850c4fd15 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a" status: 200 len: 1724 microversion: 2.1 time: 0.479929 Jul 20 19:29:39.078078 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 314/635] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:38 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a => generated 1724 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:39.577786 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-eb0b0c5f-e249-4b19-926f-236bb163e6e1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:39.578417 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-eb0b0c5f-e249-4b19-926f-236bb163e6e1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:39.584827 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-eb0b0c5f-e249-4b19-926f-236bb163e6e1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:39.585269 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-eb0b0c5f-e249-4b19-926f-236bb163e6e1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:39.586054 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-eb0b0c5f-e249-4b19-926f-236bb163e6e1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:39.586488 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-eb0b0c5f-e249-4b19-926f-236bb163e6e1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:39.729466 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-eb0b0c5f-e249-4b19-926f-236bb163e6e1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:39.737577 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-eb0b0c5f-e249-4b19-926f-236bb163e6e1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1264 microversion: 2.1 time: 0.163909 Jul 20 19:29:39.738147 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 322/636] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:39 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:39.878210 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-0b26e726-8113-4247-bb16-7b2eb07f00b8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:39.878815 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-0b26e726-8113-4247-bb16-7b2eb07f00b8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:39.886006 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0b26e726-8113-4247-bb16-7b2eb07f00b8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:39.886457 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0b26e726-8113-4247-bb16-7b2eb07f00b8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:39.887281 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0b26e726-8113-4247-bb16-7b2eb07f00b8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:39.887721 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0b26e726-8113-4247-bb16-7b2eb07f00b8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:39.938617 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [req-53707fd9-51ce-45fc-ac64-c0056ec0a9f4 req-d86c70e5-5c63-41fc-a89f-aa609ce1e29c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0aee5176-53ab-4288-91da-4284ac2e443e", "name": "network-vif-plugged", "status": "completed", "tag": "37f1f157-d172-4459-b70e-8eeade5eea75"}]} {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:29:39.947249 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [req-53707fd9-51ce-45fc-ac64-c0056ec0a9f4 req-d86c70e5-5c63-41fc-a89f-aa609ce1e29c service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:39.947792 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [req-53707fd9-51ce-45fc-ac64-c0056ec0a9f4 req-d86c70e5-5c63-41fc-a89f-aa609ce1e29c service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:39.959608 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.compute.server_external_events [req-53707fd9-51ce-45fc-ac64-c0056ec0a9f4 req-d86c70e5-5c63-41fc-a89f-aa609ce1e29c service nova] Creating event network-vif-plugged:37f1f157-d172-4459-b70e-8eeade5eea75 for instance 0aee5176-53ab-4288-91da-4284ac2e443e on hv-cinder-83538 Jul 20 19:29:39.964966 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [req-53707fd9-51ce-45fc-ac64-c0056ec0a9f4 req-d86c70e5-5c63-41fc-a89f-aa609ce1e29c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030506 Jul 20 19:29:39.965671 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 323/637] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 19:29:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:29:40.050279 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-b0d6e200-0fae-41a9-a12f-3bf3388d2799 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:40.050973 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-b0d6e200-0fae-41a9-a12f-3bf3388d2799 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:40.057950 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b0d6e200-0fae-41a9-a12f-3bf3388d2799 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:40.058388 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b0d6e200-0fae-41a9-a12f-3bf3388d2799 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:40.060506 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b0d6e200-0fae-41a9-a12f-3bf3388d2799 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:40.060933 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b0d6e200-0fae-41a9-a12f-3bf3388d2799 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:40.063474 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0b26e726-8113-4247-bb16-7b2eb07f00b8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:40.071044 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-0b26e726-8113-4247-bb16-7b2eb07f00b8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1272 microversion: 2.1 time: 0.197031 Jul 20 19:29:40.071615 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 315/638] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:39 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1272 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:40.095429 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-7bb35f87-07e4-4ea0-b811-147c57a7546f tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:40.096061 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-7bb35f87-07e4-4ea0-b811-147c57a7546f tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:40.102203 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7bb35f87-07e4-4ea0-b811-147c57a7546f tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:40.102592 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7bb35f87-07e4-4ea0-b811-147c57a7546f tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:40.103367 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7bb35f87-07e4-4ea0-b811-147c57a7546f tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:40.103799 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7bb35f87-07e4-4ea0-b811-147c57a7546f tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:40.204161 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-b0d6e200-0fae-41a9-a12f-3bf3388d2799 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:40.213060 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-b0d6e200-0fae-41a9-a12f-3bf3388d2799 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:40.214622 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-b0d6e200-0fae-41a9-a12f-3bf3388d2799 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:40.215778 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-b0d6e200-0fae-41a9-a12f-3bf3388d2799 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1743 microversion: 2.20 time: 0.170594 Jul 20 19:29:40.216538 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 324/639] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:40 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1743 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:29:40.402229 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-7bb35f87-07e4-4ea0-b811-147c57a7546f tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:40.411006 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-7bb35f87-07e4-4ea0-b811-147c57a7546f tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a" status: 200 len: 1724 microversion: 2.1 time: 0.320039 Jul 20 19:29:40.411651 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 316/640] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:40 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a => generated 1724 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:29:40.754858 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-29d2369c-4f9d-4223-9c62-062663e1b87a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:40.755465 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-29d2369c-4f9d-4223-9c62-062663e1b87a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:40.762275 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-29d2369c-4f9d-4223-9c62-062663e1b87a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:40.762723 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-29d2369c-4f9d-4223-9c62-062663e1b87a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:40.763484 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-29d2369c-4f9d-4223-9c62-062663e1b87a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:40.763935 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-29d2369c-4f9d-4223-9c62-062663e1b87a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:40.898709 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-29d2369c-4f9d-4223-9c62-062663e1b87a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:40.906175 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-29d2369c-4f9d-4223-9c62-062663e1b87a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1264 microversion: 2.1 time: 0.155052 Jul 20 19:29:40.906978 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 325/641] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:40 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:41.089197 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-82843f63-3c18-49b4-975f-8562067a621a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:41.089823 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-82843f63-3c18-49b4-975f-8562067a621a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:41.097314 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-82843f63-3c18-49b4-975f-8562067a621a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:41.098159 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-82843f63-3c18-49b4-975f-8562067a621a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:41.098952 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-82843f63-3c18-49b4-975f-8562067a621a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:41.099514 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-82843f63-3c18-49b4-975f-8562067a621a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:41.232732 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-82843f63-3c18-49b4-975f-8562067a621a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:41.235465 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-f7f0006a-4207-4ca8-b05e-5fb2e933e441 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:41.236108 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-f7f0006a-4207-4ca8-b05e-5fb2e933e441 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:41.240833 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-82843f63-3c18-49b4-975f-8562067a621a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1272 microversion: 2.1 time: 0.155890 Jul 20 19:29:41.241399 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 317/642] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:41 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1272 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:41.242404 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f7f0006a-4207-4ca8-b05e-5fb2e933e441 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:41.242940 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f7f0006a-4207-4ca8-b05e-5fb2e933e441 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:41.243781 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f7f0006a-4207-4ca8-b05e-5fb2e933e441 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:41.244273 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f7f0006a-4207-4ca8-b05e-5fb2e933e441 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:41.375252 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-f7f0006a-4207-4ca8-b05e-5fb2e933e441 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:41.383268 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-f7f0006a-4207-4ca8-b05e-5fb2e933e441 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:41.384777 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-f7f0006a-4207-4ca8-b05e-5fb2e933e441 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:41.385955 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-f7f0006a-4207-4ca8-b05e-5fb2e933e441 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1743 microversion: 2.20 time: 0.155106 Jul 20 19:29:41.386514 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 326/643] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:41 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1743 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:29:41.430440 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d24beb14-54af-4ce4-a9ac-c53fcdfe5665 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:41.431038 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d24beb14-54af-4ce4-a9ac-c53fcdfe5665 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:41.438022 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d24beb14-54af-4ce4-a9ac-c53fcdfe5665 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:41.438469 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d24beb14-54af-4ce4-a9ac-c53fcdfe5665 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:41.439239 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d24beb14-54af-4ce4-a9ac-c53fcdfe5665 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:41.439665 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d24beb14-54af-4ce4-a9ac-c53fcdfe5665 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:41.569348 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d24beb14-54af-4ce4-a9ac-c53fcdfe5665 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:41.577400 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d24beb14-54af-4ce4-a9ac-c53fcdfe5665 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a" status: 200 len: 1701 microversion: 2.1 time: 0.151974 Jul 20 19:29:41.578084 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 318/644] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:41 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a => generated 1701 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:41.594632 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-c7d74e92-9d2d-4904-abe3-670db4db7cda tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:29:41.600717 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c7d74e92-9d2d-4904-abe3-670db4db7cda tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:41.601191 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c7d74e92-9d2d-4904-abe3-670db4db7cda tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:41.662761 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-c7d74e92-9d2d-4904-abe3-670db4db7cda tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Going to try to start instance {{(pid=117762) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 20 19:29:41.705306 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-c7d74e92-9d2d-4904-abe3-670db4db7cda tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "POST /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a/action" status: 202 len: 0 microversion: 2.1 time: 0.114400 Jul 20 19:29:41.705944 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 327/645] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Jul 20 19:29:41 2022] POST /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 19:29:41.714159 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4eece785-d3d5-4ebb-8985-428ffb34e05d tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:41.714763 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-4eece785-d3d5-4ebb-8985-428ffb34e05d tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:41.721058 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4eece785-d3d5-4ebb-8985-428ffb34e05d tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:41.721583 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4eece785-d3d5-4ebb-8985-428ffb34e05d tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:41.722390 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4eece785-d3d5-4ebb-8985-428ffb34e05d tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:41.722826 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4eece785-d3d5-4ebb-8985-428ffb34e05d tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:41.854090 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-4eece785-d3d5-4ebb-8985-428ffb34e05d tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:41.862670 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-4eece785-d3d5-4ebb-8985-428ffb34e05d tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a" status: 200 len: 1710 microversion: 2.1 time: 0.152559 Jul 20 19:29:41.863231 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 319/646] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:41 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a => generated 1710 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:41.925119 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-5797e935-38e1-48b2-bd3c-4cb0ea6b58d9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:41.925840 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-5797e935-38e1-48b2-bd3c-4cb0ea6b58d9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:41.932035 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-5797e935-38e1-48b2-bd3c-4cb0ea6b58d9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:41.932483 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-5797e935-38e1-48b2-bd3c-4cb0ea6b58d9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:41.933245 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-5797e935-38e1-48b2-bd3c-4cb0ea6b58d9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:41.933709 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-5797e935-38e1-48b2-bd3c-4cb0ea6b58d9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:42.064499 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-5797e935-38e1-48b2-bd3c-4cb0ea6b58d9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:42.071928 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-5797e935-38e1-48b2-bd3c-4cb0ea6b58d9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1264 microversion: 2.1 time: 0.152152 Jul 20 19:29:42.072492 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 328/647] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:41 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:42.257493 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-f5f3f271-89b9-4ba3-bfb2-e873e154517e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:42.258147 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-f5f3f271-89b9-4ba3-bfb2-e873e154517e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:42.264527 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f5f3f271-89b9-4ba3-bfb2-e873e154517e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:42.264968 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f5f3f271-89b9-4ba3-bfb2-e873e154517e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:42.265859 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f5f3f271-89b9-4ba3-bfb2-e873e154517e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:42.266296 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f5f3f271-89b9-4ba3-bfb2-e873e154517e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:42.403851 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-f5f3f271-89b9-4ba3-bfb2-e873e154517e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:42.404306 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-84c54dd6-201f-4f59-86d5-d6c3bcc0b537 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:42.404913 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-84c54dd6-201f-4f59-86d5-d6c3bcc0b537 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:42.411545 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-84c54dd6-201f-4f59-86d5-d6c3bcc0b537 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:42.411998 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-84c54dd6-201f-4f59-86d5-d6c3bcc0b537 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:42.412131 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-f5f3f271-89b9-4ba3-bfb2-e873e154517e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1272 microversion: 2.1 time: 0.158504 Jul 20 19:29:42.412692 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 320/648] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:42 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1272 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:42.412806 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-84c54dd6-201f-4f59-86d5-d6c3bcc0b537 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:42.413175 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-84c54dd6-201f-4f59-86d5-d6c3bcc0b537 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:42.549207 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-84c54dd6-201f-4f59-86d5-d6c3bcc0b537 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:42.557018 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-84c54dd6-201f-4f59-86d5-d6c3bcc0b537 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:42.558550 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-84c54dd6-201f-4f59-86d5-d6c3bcc0b537 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:42.559698 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-84c54dd6-201f-4f59-86d5-d6c3bcc0b537 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1738 microversion: 2.20 time: 0.159342 Jul 20 19:29:42.560250 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 329/649] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:42 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1738 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:29:42.880673 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-2f470224-2b60-4373-a8d4-a62291529b5e tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:42.881190 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-2f470224-2b60-4373-a8d4-a62291529b5e tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:42.887290 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2f470224-2b60-4373-a8d4-a62291529b5e tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:42.887829 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2f470224-2b60-4373-a8d4-a62291529b5e tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:42.888597 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2f470224-2b60-4373-a8d4-a62291529b5e tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:42.889028 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2f470224-2b60-4373-a8d4-a62291529b5e tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:43.020636 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-2f470224-2b60-4373-a8d4-a62291529b5e tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:43.028509 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-2f470224-2b60-4373-a8d4-a62291529b5e tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a" status: 200 len: 1710 microversion: 2.1 time: 0.151789 Jul 20 19:29:43.029073 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 321/650] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:42 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a => generated 1710 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:43.089182 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-04678d3a-19dd-4701-a44e-3fb8fa3dd633 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:43.089837 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-04678d3a-19dd-4701-a44e-3fb8fa3dd633 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:43.096409 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-04678d3a-19dd-4701-a44e-3fb8fa3dd633 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:43.096855 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-04678d3a-19dd-4701-a44e-3fb8fa3dd633 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:43.097644 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-04678d3a-19dd-4701-a44e-3fb8fa3dd633 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:43.098083 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-04678d3a-19dd-4701-a44e-3fb8fa3dd633 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:43.229357 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-04678d3a-19dd-4701-a44e-3fb8fa3dd633 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:43.237454 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-04678d3a-19dd-4701-a44e-3fb8fa3dd633 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1451 microversion: 2.1 time: 0.152789 Jul 20 19:29:43.238055 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 330/651] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:43 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:29:43.253288 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a9f9069c-f9a7-49f5-9e26-4eb1121ec800 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:43.253929 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a9f9069c-f9a7-49f5-9e26-4eb1121ec800 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:43.259841 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a9f9069c-f9a7-49f5-9e26-4eb1121ec800 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:43.260391 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a9f9069c-f9a7-49f5-9e26-4eb1121ec800 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:43.261036 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a9f9069c-f9a7-49f5-9e26-4eb1121ec800 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:43.261466 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a9f9069c-f9a7-49f5-9e26-4eb1121ec800 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:43.396704 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a9f9069c-f9a7-49f5-9e26-4eb1121ec800 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:43.404187 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a9f9069c-f9a7-49f5-9e26-4eb1121ec800 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1451 microversion: 2.1 time: 0.154841 Jul 20 19:29:43.404916 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 322/652] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:43 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1451 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:43.428085 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-6c1b4465-ec43-4cc5-8a86-ad8c39cc6100 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:43.428691 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-6c1b4465-ec43-4cc5-8a86-ad8c39cc6100 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:43.435003 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-6c1b4465-ec43-4cc5-8a86-ad8c39cc6100 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:43.435607 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-6c1b4465-ec43-4cc5-8a86-ad8c39cc6100 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:43.436335 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-6c1b4465-ec43-4cc5-8a86-ad8c39cc6100 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:43.436864 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-6c1b4465-ec43-4cc5-8a86-ad8c39cc6100 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:43.578971 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-7ed0c52d-ac19-4f1d-a257-0780bb14c368 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:43.579759 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-7ed0c52d-ac19-4f1d-a257-0780bb14c368 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:43.590605 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7ed0c52d-ac19-4f1d-a257-0780bb14c368 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:43.591057 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7ed0c52d-ac19-4f1d-a257-0780bb14c368 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:43.592213 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7ed0c52d-ac19-4f1d-a257-0780bb14c368 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:43.592450 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7ed0c52d-ac19-4f1d-a257-0780bb14c368 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:43.608367 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-6c1b4465-ec43-4cc5-8a86-ad8c39cc6100 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:43.610238 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:43.620536 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-6c1b4465-ec43-4cc5-8a86-ad8c39cc6100 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1272 microversion: 2.1 time: 0.195587 Jul 20 19:29:43.621617 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 331/653] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:43 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1272 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:43.812477 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-7ed0c52d-ac19-4f1d-a257-0780bb14c368 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:43.820484 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-7ed0c52d-ac19-4f1d-a257-0780bb14c368 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:43.821993 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-7ed0c52d-ac19-4f1d-a257-0780bb14c368 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:43.823141 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-7ed0c52d-ac19-4f1d-a257-0780bb14c368 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1738 microversion: 2.20 time: 0.248932 Jul 20 19:29:43.823694 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 323/654] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:43 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1738 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:29:44.046380 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-9d1efcbf-8070-4c06-8d0a-206092f55184 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:44.047517 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-9d1efcbf-8070-4c06-8d0a-206092f55184 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:44.053842 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9d1efcbf-8070-4c06-8d0a-206092f55184 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:44.054293 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9d1efcbf-8070-4c06-8d0a-206092f55184 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:44.055067 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9d1efcbf-8070-4c06-8d0a-206092f55184 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:44.055574 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9d1efcbf-8070-4c06-8d0a-206092f55184 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:44.184936 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-9d1efcbf-8070-4c06-8d0a-206092f55184 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:44.193951 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-9d1efcbf-8070-4c06-8d0a-206092f55184 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a" status: 200 len: 1710 microversion: 2.1 time: 0.151528 Jul 20 19:29:44.194525 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 332/655] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:44 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a => generated 1710 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:44.638094 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-42d44fe8-9ef7-4a12-83d7-eaaec8d19d6f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:44.638707 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-42d44fe8-9ef7-4a12-83d7-eaaec8d19d6f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:44.641277 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell0:SELECT=2 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:44.646943 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-42d44fe8-9ef7-4a12-83d7-eaaec8d19d6f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:44.647391 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-42d44fe8-9ef7-4a12-83d7-eaaec8d19d6f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:44.648316 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-42d44fe8-9ef7-4a12-83d7-eaaec8d19d6f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:44.648752 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-42d44fe8-9ef7-4a12-83d7-eaaec8d19d6f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:44.843551 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-4e895696-cf28-4c9b-8efc-60697ef1a851 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:44.844174 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-4e895696-cf28-4c9b-8efc-60697ef1a851 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:44.850245 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4e895696-cf28-4c9b-8efc-60697ef1a851 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:44.850698 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4e895696-cf28-4c9b-8efc-60697ef1a851 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:44.851518 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4e895696-cf28-4c9b-8efc-60697ef1a851 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:44.851903 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4e895696-cf28-4c9b-8efc-60697ef1a851 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:44.870019 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-42d44fe8-9ef7-4a12-83d7-eaaec8d19d6f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:44.878882 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-42d44fe8-9ef7-4a12-83d7-eaaec8d19d6f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1272 microversion: 2.1 time: 0.244995 Jul 20 19:29:44.879766 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 324/656] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:44 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1272 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:45.000636 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-4e895696-cf28-4c9b-8efc-60697ef1a851 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:45.012991 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:45.018307 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-4e895696-cf28-4c9b-8efc-60697ef1a851 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:45.021215 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-4e895696-cf28-4c9b-8efc-60697ef1a851 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:45.022607 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-4e895696-cf28-4c9b-8efc-60697ef1a851 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1738 microversion: 2.20 time: 0.183390 Jul 20 19:29:45.023165 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 333/657] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:44 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1738 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:29:45.211130 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-b901788c-151f-48a7-8886-a807b6898389 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:45.211739 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-b901788c-151f-48a7-8886-a807b6898389 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:45.219697 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b901788c-151f-48a7-8886-a807b6898389 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:45.220477 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b901788c-151f-48a7-8886-a807b6898389 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:45.221486 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b901788c-151f-48a7-8886-a807b6898389 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:45.222153 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b901788c-151f-48a7-8886-a807b6898389 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:45.222796 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell0:SELECT=8 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:45.826861 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-b901788c-151f-48a7-8886-a807b6898389 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:45.864715 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-b901788c-151f-48a7-8886-a807b6898389 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a" status: 200 len: 1710 microversion: 2.1 time: 0.654821 Jul 20 19:29:45.894009 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 325/658] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:45 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a => generated 1710 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:45.901106 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-aa4fcdfa-810b-4d1c-aa84-48e89636ffbf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:45.901750 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-aa4fcdfa-810b-4d1c-aa84-48e89636ffbf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:45.918507 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-aa4fcdfa-810b-4d1c-aa84-48e89636ffbf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:45.919243 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-aa4fcdfa-810b-4d1c-aa84-48e89636ffbf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:45.920734 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-aa4fcdfa-810b-4d1c-aa84-48e89636ffbf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:45.921467 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-aa4fcdfa-810b-4d1c-aa84-48e89636ffbf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:46.042566 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e8a69813-7893-45a4-b73c-39933724eba7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:46.043629 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e8a69813-7893-45a4-b73c-39933724eba7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:46.064293 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e8a69813-7893-45a4-b73c-39933724eba7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:46.066532 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e8a69813-7893-45a4-b73c-39933724eba7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:46.068496 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e8a69813-7893-45a4-b73c-39933724eba7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:46.069056 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e8a69813-7893-45a4-b73c-39933724eba7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:46.222343 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-aa4fcdfa-810b-4d1c-aa84-48e89636ffbf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:46.233330 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-aa4fcdfa-810b-4d1c-aa84-48e89636ffbf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1272 microversion: 2.1 time: 0.339011 Jul 20 19:29:46.244058 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 334/659] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:45 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1272 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:46.373618 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [req-706a5f56-041c-4ac4-99c1-042af06a3f1a req-020ab00d-4998-4da3-ab56-c3988aebbff9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0aee5176-53ab-4288-91da-4284ac2e443e", "tag": "37f1f157-d172-4459-b70e-8eeade5eea75"}]} {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:29:46.386017 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [req-706a5f56-041c-4ac4-99c1-042af06a3f1a req-020ab00d-4998-4da3-ab56-c3988aebbff9 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:46.386865 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [req-706a5f56-041c-4ac4-99c1-042af06a3f1a req-020ab00d-4998-4da3-ab56-c3988aebbff9 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:46.400695 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.compute.server_external_events [req-706a5f56-041c-4ac4-99c1-042af06a3f1a req-020ab00d-4998-4da3-ab56-c3988aebbff9 service nova] Creating event network-changed:37f1f157-d172-4459-b70e-8eeade5eea75 for instance 0aee5176-53ab-4288-91da-4284ac2e443e on hv-cinder-83538 Jul 20 19:29:46.408663 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [req-706a5f56-041c-4ac4-99c1-042af06a3f1a req-020ab00d-4998-4da3-ab56-c3988aebbff9 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039813 Jul 20 19:29:46.411213 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 335/660] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 19:29:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:29:46.594036 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e8a69813-7893-45a4-b73c-39933724eba7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:46.602991 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e8a69813-7893-45a4-b73c-39933724eba7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:46.606582 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e8a69813-7893-45a4-b73c-39933724eba7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:46.607883 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e8a69813-7893-45a4-b73c-39933724eba7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1738 microversion: 2.20 time: 0.570029 Jul 20 19:29:46.609546 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 326/661] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:46 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1738 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:46.911053 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-3c243c4d-609d-4039-ae1c-ddb06f7d70ae tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:46.911862 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-3c243c4d-609d-4039-ae1c-ddb06f7d70ae tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:46.918003 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_api:SELECT=100 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:46.920693 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3c243c4d-609d-4039-ae1c-ddb06f7d70ae tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:46.922419 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3c243c4d-609d-4039-ae1c-ddb06f7d70ae tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:46.923447 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3c243c4d-609d-4039-ae1c-ddb06f7d70ae tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:46.924117 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3c243c4d-609d-4039-ae1c-ddb06f7d70ae tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:47.095965 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-3c243c4d-609d-4039-ae1c-ddb06f7d70ae tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:47.106158 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-3c243c4d-609d-4039-ae1c-ddb06f7d70ae tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a" status: 200 len: 1710 microversion: 2.1 time: 0.199558 Jul 20 19:29:47.113483 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 336/662] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:46 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a => generated 1710 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:47.262755 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-5cce340c-44d9-4d02-9014-586fbf8c4e76 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:47.264134 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-5cce340c-44d9-4d02-9014-586fbf8c4e76 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:47.274173 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5cce340c-44d9-4d02-9014-586fbf8c4e76 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:47.275156 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5cce340c-44d9-4d02-9014-586fbf8c4e76 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:47.276090 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5cce340c-44d9-4d02-9014-586fbf8c4e76 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:47.276666 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5cce340c-44d9-4d02-9014-586fbf8c4e76 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:47.477527 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-5cce340c-44d9-4d02-9014-586fbf8c4e76 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:47.486973 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-5cce340c-44d9-4d02-9014-586fbf8c4e76 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1260 microversion: 2.1 time: 0.238024 Jul 20 19:29:47.497812 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 327/663] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:47 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1260 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:47.626884 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-f3305288-9422-4ea3-a645-6df0f513d629 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:47.627479 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-f3305288-9422-4ea3-a645-6df0f513d629 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:47.633716 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f3305288-9422-4ea3-a645-6df0f513d629 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:47.634157 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f3305288-9422-4ea3-a645-6df0f513d629 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:47.634908 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f3305288-9422-4ea3-a645-6df0f513d629 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:47.635335 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f3305288-9422-4ea3-a645-6df0f513d629 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:47.777664 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-f3305288-9422-4ea3-a645-6df0f513d629 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:47.786740 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-f3305288-9422-4ea3-a645-6df0f513d629 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:47.788579 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-f3305288-9422-4ea3-a645-6df0f513d629 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:47.789995 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-f3305288-9422-4ea3-a645-6df0f513d629 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1738 microversion: 2.20 time: 0.167129 Jul 20 19:29:47.800776 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 337/664] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:47 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1738 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:48.126565 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-604397e2-2d32-4376-adfc-d6cbd17f0490 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:48.127143 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-604397e2-2d32-4376-adfc-d6cbd17f0490 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:48.140101 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-604397e2-2d32-4376-adfc-d6cbd17f0490 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:48.140598 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-604397e2-2d32-4376-adfc-d6cbd17f0490 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:48.141416 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-604397e2-2d32-4376-adfc-d6cbd17f0490 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:48.141883 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-604397e2-2d32-4376-adfc-d6cbd17f0490 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:48.289137 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-604397e2-2d32-4376-adfc-d6cbd17f0490 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:48.298246 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-604397e2-2d32-4376-adfc-d6cbd17f0490 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a" status: 200 len: 1710 microversion: 2.1 time: 0.177268 Jul 20 19:29:48.299058 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 328/665] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:48 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a => generated 1710 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:48.505097 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-06a3b347-357c-43c2-b6ac-1a94fdb8e5ec tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:48.506038 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-06a3b347-357c-43c2-b6ac-1a94fdb8e5ec tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:48.513596 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-06a3b347-357c-43c2-b6ac-1a94fdb8e5ec tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:48.513970 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-06a3b347-357c-43c2-b6ac-1a94fdb8e5ec tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:48.514760 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-06a3b347-357c-43c2-b6ac-1a94fdb8e5ec tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:48.515232 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-06a3b347-357c-43c2-b6ac-1a94fdb8e5ec tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:48.675399 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-06a3b347-357c-43c2-b6ac-1a94fdb8e5ec tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:48.683354 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-06a3b347-357c-43c2-b6ac-1a94fdb8e5ec tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1260 microversion: 2.1 time: 0.182373 Jul 20 19:29:48.683927 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 338/666] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:48 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1260 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:48.807600 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-415df92d-5ec2-4c44-af5e-59b1583b7240 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:48.808695 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-415df92d-5ec2-4c44-af5e-59b1583b7240 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:48.815471 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-415df92d-5ec2-4c44-af5e-59b1583b7240 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:48.815969 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-415df92d-5ec2-4c44-af5e-59b1583b7240 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:48.816818 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-415df92d-5ec2-4c44-af5e-59b1583b7240 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:48.817285 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-415df92d-5ec2-4c44-af5e-59b1583b7240 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:48.958608 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-415df92d-5ec2-4c44-af5e-59b1583b7240 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:48.967766 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-415df92d-5ec2-4c44-af5e-59b1583b7240 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:48.970151 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-415df92d-5ec2-4c44-af5e-59b1583b7240 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:48.971422 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-415df92d-5ec2-4c44-af5e-59b1583b7240 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1738 microversion: 2.20 time: 0.167783 Jul 20 19:29:48.982685 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 329/667] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:48 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1738 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:49.316847 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-77428dbe-cf0f-4747-9feb-050b225bf26b tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:49.317749 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-77428dbe-cf0f-4747-9feb-050b225bf26b tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:49.328502 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-77428dbe-cf0f-4747-9feb-050b225bf26b tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:49.329161 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-77428dbe-cf0f-4747-9feb-050b225bf26b tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:49.329976 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-77428dbe-cf0f-4747-9feb-050b225bf26b tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:49.330443 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-77428dbe-cf0f-4747-9feb-050b225bf26b tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:49.487411 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-77428dbe-cf0f-4747-9feb-050b225bf26b tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:49.496776 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-77428dbe-cf0f-4747-9feb-050b225bf26b tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a" status: 200 len: 1710 microversion: 2.1 time: 0.184875 Jul 20 19:29:49.497719 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 339/668] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:49 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a => generated 1710 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:49.702448 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-27d304f1-b03c-4712-95ac-96fa20289ab8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:49.702448 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-27d304f1-b03c-4712-95ac-96fa20289ab8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:49.709273 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-27d304f1-b03c-4712-95ac-96fa20289ab8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:49.710124 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-27d304f1-b03c-4712-95ac-96fa20289ab8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:49.711143 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-27d304f1-b03c-4712-95ac-96fa20289ab8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:49.711814 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-27d304f1-b03c-4712-95ac-96fa20289ab8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:49.860649 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-27d304f1-b03c-4712-95ac-96fa20289ab8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:49.869994 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-27d304f1-b03c-4712-95ac-96fa20289ab8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1260 microversion: 2.1 time: 0.172928 Jul 20 19:29:49.870919 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 330/669] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:49 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1260 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:49.991323 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-f824612a-2583-41df-8620-ade79560a1a9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:49.991848 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-f824612a-2583-41df-8620-ade79560a1a9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:50.001594 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f824612a-2583-41df-8620-ade79560a1a9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:50.003112 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f824612a-2583-41df-8620-ade79560a1a9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:50.005910 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f824612a-2583-41df-8620-ade79560a1a9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:50.006694 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f824612a-2583-41df-8620-ade79560a1a9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:50.154260 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-f824612a-2583-41df-8620-ade79560a1a9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:50.163117 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-f824612a-2583-41df-8620-ade79560a1a9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:50.165220 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-f824612a-2583-41df-8620-ade79560a1a9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:50.166430 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-f824612a-2583-41df-8620-ade79560a1a9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1738 microversion: 2.20 time: 0.179108 Jul 20 19:29:50.178351 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 340/670] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:49 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1738 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:50.514708 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d1567e1d-bcc6-457f-aa82-400c5441dc8d tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:50.515915 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d1567e1d-bcc6-457f-aa82-400c5441dc8d tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:50.522042 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d1567e1d-bcc6-457f-aa82-400c5441dc8d tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:50.522487 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d1567e1d-bcc6-457f-aa82-400c5441dc8d tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:50.523445 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d1567e1d-bcc6-457f-aa82-400c5441dc8d tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:50.524052 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d1567e1d-bcc6-457f-aa82-400c5441dc8d tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:50.657503 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d1567e1d-bcc6-457f-aa82-400c5441dc8d tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:50.665789 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d1567e1d-bcc6-457f-aa82-400c5441dc8d tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a" status: 200 len: 1710 microversion: 2.1 time: 0.154986 Jul 20 19:29:50.666552 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 331/671] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:50 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a => generated 1710 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:50.887793 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-57861ff1-57fa-4609-b52b-71616f94d483 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:50.888348 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-57861ff1-57fa-4609-b52b-71616f94d483 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:50.897109 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-57861ff1-57fa-4609-b52b-71616f94d483 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:50.897583 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-57861ff1-57fa-4609-b52b-71616f94d483 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:50.898354 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-57861ff1-57fa-4609-b52b-71616f94d483 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:50.898785 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-57861ff1-57fa-4609-b52b-71616f94d483 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:51.053909 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-57861ff1-57fa-4609-b52b-71616f94d483 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:51.063062 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-57861ff1-57fa-4609-b52b-71616f94d483 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1260 microversion: 2.1 time: 0.179570 Jul 20 19:29:51.064275 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 341/672] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:50 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1260 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:51.186151 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-25432544-934c-4924-a6be-e8fcafa854db tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:51.186778 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-25432544-934c-4924-a6be-e8fcafa854db tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:51.193695 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-25432544-934c-4924-a6be-e8fcafa854db tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:51.194164 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-25432544-934c-4924-a6be-e8fcafa854db tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:51.195126 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-25432544-934c-4924-a6be-e8fcafa854db tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:51.195509 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-25432544-934c-4924-a6be-e8fcafa854db tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:51.378023 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-25432544-934c-4924-a6be-e8fcafa854db tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:51.386825 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-25432544-934c-4924-a6be-e8fcafa854db tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:51.388621 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-25432544-934c-4924-a6be-e8fcafa854db tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:51.390450 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-25432544-934c-4924-a6be-e8fcafa854db tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1738 microversion: 2.20 time: 0.208118 Jul 20 19:29:51.391411 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 332/673] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:51 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1738 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:51.683822 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-fcfb1bc1-ebad-4e34-bc44-8d84393afef1 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:51.684425 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-fcfb1bc1-ebad-4e34-bc44-8d84393afef1 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:51.691586 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-fcfb1bc1-ebad-4e34-bc44-8d84393afef1 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:51.692292 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-fcfb1bc1-ebad-4e34-bc44-8d84393afef1 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:51.693305 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-fcfb1bc1-ebad-4e34-bc44-8d84393afef1 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:51.693727 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-fcfb1bc1-ebad-4e34-bc44-8d84393afef1 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:51.840065 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-fcfb1bc1-ebad-4e34-bc44-8d84393afef1 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:51.849637 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-fcfb1bc1-ebad-4e34-bc44-8d84393afef1 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a" status: 200 len: 1710 microversion: 2.1 time: 0.169498 Jul 20 19:29:51.850571 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 342/674] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:51 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a => generated 1710 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:52.080921 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-07118aa7-2474-48ac-b0d4-69ab8ed429d4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:52.081532 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-07118aa7-2474-48ac-b0d4-69ab8ed429d4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:52.088625 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-07118aa7-2474-48ac-b0d4-69ab8ed429d4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:52.089066 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-07118aa7-2474-48ac-b0d4-69ab8ed429d4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:52.089859 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-07118aa7-2474-48ac-b0d4-69ab8ed429d4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:52.090286 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-07118aa7-2474-48ac-b0d4-69ab8ed429d4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:52.247956 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-07118aa7-2474-48ac-b0d4-69ab8ed429d4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:52.256336 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-07118aa7-2474-48ac-b0d4-69ab8ed429d4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1260 microversion: 2.1 time: 0.179657 Jul 20 19:29:52.256912 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 333/675] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:52 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1260 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:29:52.410868 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-62ed4a33-7c68-4111-96cb-c83a05dea199 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:52.412079 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-62ed4a33-7c68-4111-96cb-c83a05dea199 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:52.418924 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-62ed4a33-7c68-4111-96cb-c83a05dea199 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:52.419365 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-62ed4a33-7c68-4111-96cb-c83a05dea199 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:52.420110 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-62ed4a33-7c68-4111-96cb-c83a05dea199 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:52.420699 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-62ed4a33-7c68-4111-96cb-c83a05dea199 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:52.590911 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-62ed4a33-7c68-4111-96cb-c83a05dea199 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:52.601458 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-62ed4a33-7c68-4111-96cb-c83a05dea199 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:52.603312 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-62ed4a33-7c68-4111-96cb-c83a05dea199 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:52.604507 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-62ed4a33-7c68-4111-96cb-c83a05dea199 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1738 microversion: 2.20 time: 0.197509 Jul 20 19:29:52.605067 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 343/676] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:52 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1738 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:52.868355 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d835cbc8-d0cf-453c-af73-b12675cc5d5c tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:52.869302 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d835cbc8-d0cf-453c-af73-b12675cc5d5c tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:52.875996 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d835cbc8-d0cf-453c-af73-b12675cc5d5c tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:52.876801 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d835cbc8-d0cf-453c-af73-b12675cc5d5c tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:52.877921 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d835cbc8-d0cf-453c-af73-b12675cc5d5c tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:52.878645 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d835cbc8-d0cf-453c-af73-b12675cc5d5c tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:53.048026 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d835cbc8-d0cf-453c-af73-b12675cc5d5c tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:53.056461 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d835cbc8-d0cf-453c-af73-b12675cc5d5c tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a" status: 200 len: 1710 microversion: 2.1 time: 0.192372 Jul 20 19:29:53.057060 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 334/677] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:52 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a => generated 1710 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:53.274303 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-8d1ff56c-f182-44c0-af8a-52b921152e7d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:53.274915 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-8d1ff56c-f182-44c0-af8a-52b921152e7d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:53.284202 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8d1ff56c-f182-44c0-af8a-52b921152e7d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:53.285224 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8d1ff56c-f182-44c0-af8a-52b921152e7d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:53.286081 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8d1ff56c-f182-44c0-af8a-52b921152e7d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:53.286497 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8d1ff56c-f182-44c0-af8a-52b921152e7d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:53.452283 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-8d1ff56c-f182-44c0-af8a-52b921152e7d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:53.461112 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-8d1ff56c-f182-44c0-af8a-52b921152e7d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1260 microversion: 2.1 time: 0.190997 Jul 20 19:29:53.471315 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 344/678] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:53 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1260 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:53.624181 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ca07ae18-e705-4b5a-bf28-94cb7751174c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:53.625421 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ca07ae18-e705-4b5a-bf28-94cb7751174c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:53.633529 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ca07ae18-e705-4b5a-bf28-94cb7751174c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:53.634119 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ca07ae18-e705-4b5a-bf28-94cb7751174c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:53.634957 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ca07ae18-e705-4b5a-bf28-94cb7751174c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:53.635379 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ca07ae18-e705-4b5a-bf28-94cb7751174c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:53.778993 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ca07ae18-e705-4b5a-bf28-94cb7751174c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:53.788191 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ca07ae18-e705-4b5a-bf28-94cb7751174c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:53.789758 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ca07ae18-e705-4b5a-bf28-94cb7751174c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:53.790939 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ca07ae18-e705-4b5a-bf28-94cb7751174c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1738 microversion: 2.20 time: 0.171222 Jul 20 19:29:53.801712 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 335/679] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:53 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1738 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:29:54.074560 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-4df03b06-6574-45c6-a0a7-ff224f6f7b45 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:54.075265 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-4df03b06-6574-45c6-a0a7-ff224f6f7b45 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:54.084337 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4df03b06-6574-45c6-a0a7-ff224f6f7b45 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:54.084833 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4df03b06-6574-45c6-a0a7-ff224f6f7b45 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:54.085683 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4df03b06-6574-45c6-a0a7-ff224f6f7b45 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:54.086113 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4df03b06-6574-45c6-a0a7-ff224f6f7b45 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:54.238980 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-4df03b06-6574-45c6-a0a7-ff224f6f7b45 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:54.247116 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-4df03b06-6574-45c6-a0a7-ff224f6f7b45 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a" status: 200 len: 1710 microversion: 2.1 time: 0.176606 Jul 20 19:29:54.247951 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 345/680] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:54 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a => generated 1710 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:54.480288 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d267e1c9-6bd4-47d4-8eb5-1136e41b82d5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:54.481735 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d267e1c9-6bd4-47d4-8eb5-1136e41b82d5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:54.489795 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d267e1c9-6bd4-47d4-8eb5-1136e41b82d5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:54.490380 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d267e1c9-6bd4-47d4-8eb5-1136e41b82d5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:54.491172 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d267e1c9-6bd4-47d4-8eb5-1136e41b82d5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:54.491611 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d267e1c9-6bd4-47d4-8eb5-1136e41b82d5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:54.654926 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d267e1c9-6bd4-47d4-8eb5-1136e41b82d5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:54.664789 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d267e1c9-6bd4-47d4-8eb5-1136e41b82d5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1260 microversion: 2.1 time: 0.189552 Jul 20 19:29:54.665990 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 336/681] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:54 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1260 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:54.809229 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-234dca93-a4ca-469f-8add-0613007c44d3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:54.809936 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-234dca93-a4ca-469f-8add-0613007c44d3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:54.818076 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-234dca93-a4ca-469f-8add-0613007c44d3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:54.818777 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-234dca93-a4ca-469f-8add-0613007c44d3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:54.819546 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-234dca93-a4ca-469f-8add-0613007c44d3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:54.819977 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-234dca93-a4ca-469f-8add-0613007c44d3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:54.966657 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-234dca93-a4ca-469f-8add-0613007c44d3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:54.976102 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-234dca93-a4ca-469f-8add-0613007c44d3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:54.977649 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-234dca93-a4ca-469f-8add-0613007c44d3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:54.978816 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-234dca93-a4ca-469f-8add-0613007c44d3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1738 microversion: 2.20 time: 0.174005 Jul 20 19:29:54.979370 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 346/682] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:54 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1738 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:55.264098 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-3088e216-56be-43d8-813c-e398c59498bb tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:55.264880 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-3088e216-56be-43d8-813c-e398c59498bb tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:55.271112 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3088e216-56be-43d8-813c-e398c59498bb tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:55.271626 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3088e216-56be-43d8-813c-e398c59498bb tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:55.272323 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3088e216-56be-43d8-813c-e398c59498bb tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:55.272757 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3088e216-56be-43d8-813c-e398c59498bb tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:55.402374 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3088e216-56be-43d8-813c-e398c59498bb tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:55.410243 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-3088e216-56be-43d8-813c-e398c59498bb tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a" status: 200 len: 1710 microversion: 2.1 time: 0.149953 Jul 20 19:29:55.410811 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 337/683] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:55 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a => generated 1710 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:55.682029 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-1d33dbea-b8be-4afd-94c0-cc0170bff98d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:55.682661 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-1d33dbea-b8be-4afd-94c0-cc0170bff98d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:55.689247 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1d33dbea-b8be-4afd-94c0-cc0170bff98d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:55.689717 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1d33dbea-b8be-4afd-94c0-cc0170bff98d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:55.690480 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1d33dbea-b8be-4afd-94c0-cc0170bff98d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:55.690911 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1d33dbea-b8be-4afd-94c0-cc0170bff98d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:55.825735 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-1d33dbea-b8be-4afd-94c0-cc0170bff98d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:55.835435 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-1d33dbea-b8be-4afd-94c0-cc0170bff98d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1260 microversion: 2.1 time: 0.157233 Jul 20 19:29:55.836042 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 347/684] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:55 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:29:56.004454 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4e3544ae-b266-4f89-a07e-ccee6ae75b15 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:56.005057 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-4e3544ae-b266-4f89-a07e-ccee6ae75b15 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:56.012269 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4e3544ae-b266-4f89-a07e-ccee6ae75b15 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:56.012753 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4e3544ae-b266-4f89-a07e-ccee6ae75b15 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:56.013592 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4e3544ae-b266-4f89-a07e-ccee6ae75b15 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:56.014082 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4e3544ae-b266-4f89-a07e-ccee6ae75b15 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:56.149832 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-4e3544ae-b266-4f89-a07e-ccee6ae75b15 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:56.157596 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-4e3544ae-b266-4f89-a07e-ccee6ae75b15 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:56.159086 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-4e3544ae-b266-4f89-a07e-ccee6ae75b15 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:56.160221 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-4e3544ae-b266-4f89-a07e-ccee6ae75b15 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1738 microversion: 2.20 time: 0.160087 Jul 20 19:29:56.160773 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 338/685] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:55 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1738 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:29:56.427896 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-c7298bee-a26e-4150-9817-7b68d1936cf4 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:56.428509 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-c7298bee-a26e-4150-9817-7b68d1936cf4 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:56.434972 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c7298bee-a26e-4150-9817-7b68d1936cf4 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:56.435422 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c7298bee-a26e-4150-9817-7b68d1936cf4 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:56.436183 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c7298bee-a26e-4150-9817-7b68d1936cf4 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:56.437186 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c7298bee-a26e-4150-9817-7b68d1936cf4 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:56.570050 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-c7298bee-a26e-4150-9817-7b68d1936cf4 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:56.578530 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-c7298bee-a26e-4150-9817-7b68d1936cf4 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a" status: 200 len: 1710 microversion: 2.1 time: 0.154478 Jul 20 19:29:56.579089 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 348/686] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:56 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a => generated 1710 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:56.852778 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-be214191-3723-49e6-a21e-9c987e091f42 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:56.853443 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-be214191-3723-49e6-a21e-9c987e091f42 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:56.860334 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-be214191-3723-49e6-a21e-9c987e091f42 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:56.860787 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-be214191-3723-49e6-a21e-9c987e091f42 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:56.861583 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-be214191-3723-49e6-a21e-9c987e091f42 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:56.862017 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-be214191-3723-49e6-a21e-9c987e091f42 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:56.997331 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-be214191-3723-49e6-a21e-9c987e091f42 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:57.005423 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-be214191-3723-49e6-a21e-9c987e091f42 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1260 microversion: 2.1 time: 0.156518 Jul 20 19:29:57.006057 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 339/687] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:56 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:57.178400 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-0835a776-abc9-4f2e-8a21-0c34ea22019c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:57.179023 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-0835a776-abc9-4f2e-8a21-0c34ea22019c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:57.185528 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-0835a776-abc9-4f2e-8a21-0c34ea22019c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:57.185982 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-0835a776-abc9-4f2e-8a21-0c34ea22019c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:57.187250 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-0835a776-abc9-4f2e-8a21-0c34ea22019c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:57.187680 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-0835a776-abc9-4f2e-8a21-0c34ea22019c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:57.318594 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-0835a776-abc9-4f2e-8a21-0c34ea22019c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:57.326692 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-0835a776-abc9-4f2e-8a21-0c34ea22019c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:57.329135 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-0835a776-abc9-4f2e-8a21-0c34ea22019c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:57.330338 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-0835a776-abc9-4f2e-8a21-0c34ea22019c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1720 microversion: 2.20 time: 0.156034 Jul 20 19:29:57.330920 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 349/688] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:57 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:57.596419 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-fe3e2366-f6c5-41ac-a621-9dd49a6a9c30 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:57.597056 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-fe3e2366-f6c5-41ac-a621-9dd49a6a9c30 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:57.603612 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fe3e2366-f6c5-41ac-a621-9dd49a6a9c30 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:57.604058 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fe3e2366-f6c5-41ac-a621-9dd49a6a9c30 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:57.604823 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fe3e2366-f6c5-41ac-a621-9dd49a6a9c30 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:57.605259 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fe3e2366-f6c5-41ac-a621-9dd49a6a9c30 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:57.609820 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:57.740588 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-fe3e2366-f6c5-41ac-a621-9dd49a6a9c30 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:57.751684 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-fe3e2366-f6c5-41ac-a621-9dd49a6a9c30 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a" status: 200 len: 1714 microversion: 2.1 time: 0.159233 Jul 20 19:29:57.752631 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 340/689] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:57 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a => generated 1714 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:58.021974 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-1b417d68-d27e-4d17-adef-d516e11c22ea tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:58.022582 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-1b417d68-d27e-4d17-adef-d516e11c22ea tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:58.029276 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1b417d68-d27e-4d17-adef-d516e11c22ea tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:58.029754 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1b417d68-d27e-4d17-adef-d516e11c22ea tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:58.031070 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1b417d68-d27e-4d17-adef-d516e11c22ea tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:58.031565 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1b417d68-d27e-4d17-adef-d516e11c22ea tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:58.169625 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-1b417d68-d27e-4d17-adef-d516e11c22ea tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:58.177676 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-1b417d68-d27e-4d17-adef-d516e11c22ea tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1260 microversion: 2.1 time: 0.159479 Jul 20 19:29:58.178630 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 350/690] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:58 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:58.348839 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-93101209-b916-48cd-8f22-586dcdceef70 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:58.349441 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-93101209-b916-48cd-8f22-586dcdceef70 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:58.355486 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-93101209-b916-48cd-8f22-586dcdceef70 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:58.355929 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-93101209-b916-48cd-8f22-586dcdceef70 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:58.356676 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-93101209-b916-48cd-8f22-586dcdceef70 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:58.357103 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-93101209-b916-48cd-8f22-586dcdceef70 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:58.491126 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-93101209-b916-48cd-8f22-586dcdceef70 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:58.499574 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-93101209-b916-48cd-8f22-586dcdceef70 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:58.501236 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-93101209-b916-48cd-8f22-586dcdceef70 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:58.502415 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-93101209-b916-48cd-8f22-586dcdceef70 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1720 microversion: 2.20 time: 0.157499 Jul 20 19:29:58.502980 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 341/691] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:58 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:59.194793 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-00b1e85d-c1bb-4939-be6a-ff0ac20400ab tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:59.195404 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-00b1e85d-c1bb-4939-be6a-ff0ac20400ab tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:59.202180 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-00b1e85d-c1bb-4939-be6a-ff0ac20400ab tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:59.202754 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-00b1e85d-c1bb-4939-be6a-ff0ac20400ab tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:59.203517 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-00b1e85d-c1bb-4939-be6a-ff0ac20400ab tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:59.203956 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-00b1e85d-c1bb-4939-be6a-ff0ac20400ab tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:59.207927 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_cell1:SELECT=100 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:59.349795 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-00b1e85d-c1bb-4939-be6a-ff0ac20400ab tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:59.357307 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-00b1e85d-c1bb-4939-be6a-ff0ac20400ab tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1260 microversion: 2.1 time: 0.166482 Jul 20 19:29:59.357913 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 351/692] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:59 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:59.521250 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-8db12c20-175a-4337-86c1-77748d65e3e7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:59.521839 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-8db12c20-175a-4337-86c1-77748d65e3e7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:59.529006 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8db12c20-175a-4337-86c1-77748d65e3e7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:59.529457 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8db12c20-175a-4337-86c1-77748d65e3e7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:59.530247 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8db12c20-175a-4337-86c1-77748d65e3e7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:59.530681 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8db12c20-175a-4337-86c1-77748d65e3e7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:59.661768 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8db12c20-175a-4337-86c1-77748d65e3e7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:59.669760 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8db12c20-175a-4337-86c1-77748d65e3e7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:59.671848 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8db12c20-175a-4337-86c1-77748d65e3e7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:59.673006 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-8db12c20-175a-4337-86c1-77748d65e3e7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1723 microversion: 2.20 time: 0.155886 Jul 20 19:29:59.673580 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 342/693] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:59 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:59.691412 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-8201c6e8-95c9-434b-ac92-47e82159a7d5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f00f5654-f06c-4ad5-ad71-c1e119e5d683"}} {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:29:59.692533 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-8201c6e8-95c9-434b-ac92-47e82159a7d5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:59.698723 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8201c6e8-95c9-434b-ac92-47e82159a7d5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:59.699171 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8201c6e8-95c9-434b-ac92-47e82159a7d5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:59.699940 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8201c6e8-95c9-434b-ac92-47e82159a7d5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:59.700381 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8201c6e8-95c9-434b-ac92-47e82159a7d5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:59.962972 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [req-1053177d-ce33-464e-b219-3aa17eee2407 req-011ed4f7-f2e5-40ce-ab23-d4b521e3547c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b2abd53-4758-462c-b36a-0d1bf0b66a55", "name": "network-vif-unplugged", "status": "completed", "tag": "3232872d-df06-40e7-a7c3-7cc3babe684d"}]} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:29:59.972418 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-1053177d-ce33-464e-b219-3aa17eee2407 req-011ed4f7-f2e5-40ce-ab23-d4b521e3547c service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:59.972897 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-1053177d-ce33-464e-b219-3aa17eee2407 req-011ed4f7-f2e5-40ce-ab23-d4b521e3547c service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:59.985214 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.compute.server_external_events [req-1053177d-ce33-464e-b219-3aa17eee2407 req-011ed4f7-f2e5-40ce-ab23-d4b521e3547c service nova] Unable to find a host for instance 3b2abd53-4758-462c-b36a-0d1bf0b66a55. Dropping event network-vif-unplugged {{(pid=117761) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 20 19:29:59.986378 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [req-1053177d-ce33-464e-b219-3aa17eee2407 req-011ed4f7-f2e5-40ce-ab23-d4b521e3547c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027454 Jul 20 19:29:59.986968 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 343/694] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 19:29:59 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 20 19:30:00.009065 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-8201c6e8-95c9-434b-ac92-47e82159a7d5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "POST /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.322401 Jul 20 19:30:00.010434 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 352/695] 10.222.0.69 () {62 vars in 1363 bytes} [Wed Jul 20 19:29:59 2022] POST /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55/os-volume_attachments => generated 188 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 19:30:00.124687 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-29b0e451-932c-4a0d-bfcf-9ccf81da5856 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:30:00.125246 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-29b0e451-932c-4a0d-bfcf-9ccf81da5856 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:00.131244 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-29b0e451-932c-4a0d-bfcf-9ccf81da5856 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:00.131690 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-29b0e451-932c-4a0d-bfcf-9ccf81da5856 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:00.132445 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-29b0e451-932c-4a0d-bfcf-9ccf81da5856 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:00.132876 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-29b0e451-932c-4a0d-bfcf-9ccf81da5856 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:00.221301 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-29b0e451-932c-4a0d-bfcf-9ccf81da5856 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "POST /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55/action" status: 202 len: 0 microversion: 2.20 time: 0.100444 Jul 20 19:30:00.221932 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 344/696] 10.222.0.69 () {62 vars in 1318 bytes} [Wed Jul 20 19:30:00 2022] POST /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 19:30:00.229874 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-237c5fc5-6b16-4f51-a7cb-490b1da79080 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:00.230483 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-237c5fc5-6b16-4f51-a7cb-490b1da79080 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:00.238252 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-237c5fc5-6b16-4f51-a7cb-490b1da79080 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:00.238706 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-237c5fc5-6b16-4f51-a7cb-490b1da79080 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:00.239479 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-237c5fc5-6b16-4f51-a7cb-490b1da79080 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:00.239916 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-237c5fc5-6b16-4f51-a7cb-490b1da79080 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:00.372374 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-237c5fc5-6b16-4f51-a7cb-490b1da79080 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:00.375661 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a2d5331d-5ef3-4023-a1fb-803d1d73a7b7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:00.376274 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a2d5331d-5ef3-4023-a1fb-803d1d73a7b7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:00.382282 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a2d5331d-5ef3-4023-a1fb-803d1d73a7b7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:00.382733 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a2d5331d-5ef3-4023-a1fb-803d1d73a7b7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:00.382856 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-237c5fc5-6b16-4f51-a7cb-490b1da79080 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:00.383513 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a2d5331d-5ef3-4023-a1fb-803d1d73a7b7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:00.384051 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a2d5331d-5ef3-4023-a1fb-803d1d73a7b7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:00.384498 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-237c5fc5-6b16-4f51-a7cb-490b1da79080 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:00.385752 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-237c5fc5-6b16-4f51-a7cb-490b1da79080 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1749 microversion: 2.20 time: 0.159599 Jul 20 19:30:00.386485 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 353/697] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:00 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1749 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:30:00.528251 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a2d5331d-5ef3-4023-a1fb-803d1d73a7b7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:00.536262 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a2d5331d-5ef3-4023-a1fb-803d1d73a7b7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1260 microversion: 2.1 time: 0.165454 Jul 20 19:30:00.536824 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 345/698] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:00 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:01.404536 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-3b57a7c9-0f94-435a-8514-fd5bd2fc56fa tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:01.405258 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-3b57a7c9-0f94-435a-8514-fd5bd2fc56fa tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:01.411900 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3b57a7c9-0f94-435a-8514-fd5bd2fc56fa tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:01.412347 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3b57a7c9-0f94-435a-8514-fd5bd2fc56fa tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:01.413115 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3b57a7c9-0f94-435a-8514-fd5bd2fc56fa tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:01.413578 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3b57a7c9-0f94-435a-8514-fd5bd2fc56fa tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:01.540981 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-3b57a7c9-0f94-435a-8514-fd5bd2fc56fa tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:01.550122 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-3b57a7c9-0f94-435a-8514-fd5bd2fc56fa tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:01.551653 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-3b57a7c9-0f94-435a-8514-fd5bd2fc56fa tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:01.552818 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-3b57a7c9-0f94-435a-8514-fd5bd2fc56fa tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1749 microversion: 2.20 time: 0.152225 Jul 20 19:30:01.552937 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-9af0ff87-9067-452a-989f-6f037e1dc451 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:01.553377 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 354/699] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:01 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1749 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:30:01.553567 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-9af0ff87-9067-452a-989f-6f037e1dc451 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:01.560028 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9af0ff87-9067-452a-989f-6f037e1dc451 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:01.560467 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9af0ff87-9067-452a-989f-6f037e1dc451 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:01.561249 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9af0ff87-9067-452a-989f-6f037e1dc451 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:01.561707 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9af0ff87-9067-452a-989f-6f037e1dc451 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:01.691442 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-9af0ff87-9067-452a-989f-6f037e1dc451 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:01.698827 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-9af0ff87-9067-452a-989f-6f037e1dc451 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1260 microversion: 2.1 time: 0.149712 Jul 20 19:30:01.699389 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 346/700] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:01 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:02.571242 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-04b335ea-5e3d-422b-881c-9e3f30dbe7f5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:02.571842 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-04b335ea-5e3d-422b-881c-9e3f30dbe7f5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:02.579250 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-04b335ea-5e3d-422b-881c-9e3f30dbe7f5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:02.579631 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-04b335ea-5e3d-422b-881c-9e3f30dbe7f5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:02.580397 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-04b335ea-5e3d-422b-881c-9e3f30dbe7f5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:02.580834 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-04b335ea-5e3d-422b-881c-9e3f30dbe7f5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:02.709964 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-04b335ea-5e3d-422b-881c-9e3f30dbe7f5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:02.716104 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-868e1111-f982-4097-9fcf-aec62cfd7862 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:02.716714 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-868e1111-f982-4097-9fcf-aec62cfd7862 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:02.718865 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-04b335ea-5e3d-422b-881c-9e3f30dbe7f5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:02.720384 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-04b335ea-5e3d-422b-881c-9e3f30dbe7f5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:02.721567 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-04b335ea-5e3d-422b-881c-9e3f30dbe7f5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1749 microversion: 2.20 time: 0.154212 Jul 20 19:30:02.722327 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 355/701] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:02 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1749 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:30:02.723457 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-868e1111-f982-4097-9fcf-aec62cfd7862 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:02.723932 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-868e1111-f982-4097-9fcf-aec62cfd7862 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:02.724737 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-868e1111-f982-4097-9fcf-aec62cfd7862 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:02.725170 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-868e1111-f982-4097-9fcf-aec62cfd7862 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:02.859410 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-868e1111-f982-4097-9fcf-aec62cfd7862 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:02.866794 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-868e1111-f982-4097-9fcf-aec62cfd7862 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1260 microversion: 2.1 time: 0.154954 Jul 20 19:30:02.867356 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 347/702] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:02 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:30:03.740147 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-b556a23b-ec42-4f78-b9a0-0fd19b689f75 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:03.740752 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-b556a23b-ec42-4f78-b9a0-0fd19b689f75 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:03.747371 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b556a23b-ec42-4f78-b9a0-0fd19b689f75 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:03.747820 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b556a23b-ec42-4f78-b9a0-0fd19b689f75 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:03.748616 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b556a23b-ec42-4f78-b9a0-0fd19b689f75 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:03.749055 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b556a23b-ec42-4f78-b9a0-0fd19b689f75 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:03.880972 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-b556a23b-ec42-4f78-b9a0-0fd19b689f75 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:03.883562 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-b5716a88-15e4-4d1a-9878-59d3d4f07efe tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:03.884161 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-b5716a88-15e4-4d1a-9878-59d3d4f07efe tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:03.889889 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-b556a23b-ec42-4f78-b9a0-0fd19b689f75 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:03.890217 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b5716a88-15e4-4d1a-9878-59d3d4f07efe tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:03.890663 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b5716a88-15e4-4d1a-9878-59d3d4f07efe tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:03.891398 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-b556a23b-ec42-4f78-b9a0-0fd19b689f75 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:03.891547 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b5716a88-15e4-4d1a-9878-59d3d4f07efe tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:03.891830 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b5716a88-15e4-4d1a-9878-59d3d4f07efe tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:03.892545 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-b556a23b-ec42-4f78-b9a0-0fd19b689f75 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1749 microversion: 2.20 time: 0.156298 Jul 20 19:30:03.893102 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 356/703] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:03 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1749 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:30:04.024233 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-b5716a88-15e4-4d1a-9878-59d3d4f07efe tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:04.032183 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-b5716a88-15e4-4d1a-9878-59d3d4f07efe tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1260 microversion: 2.1 time: 0.152493 Jul 20 19:30:04.032742 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 348/704] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:03 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:30:04.910848 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-6dabafff-522d-4ffc-8ec8-7446f913c91b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:04.911466 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-6dabafff-522d-4ffc-8ec8-7446f913c91b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:04.918280 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-6dabafff-522d-4ffc-8ec8-7446f913c91b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:04.918795 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-6dabafff-522d-4ffc-8ec8-7446f913c91b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:04.919565 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-6dabafff-522d-4ffc-8ec8-7446f913c91b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:04.920031 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-6dabafff-522d-4ffc-8ec8-7446f913c91b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:05.048867 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-9d6ab20f-8a64-49c4-981c-a572d2e5bc43 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:05.049482 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-9d6ab20f-8a64-49c4-981c-a572d2e5bc43 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:05.055889 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-6dabafff-522d-4ffc-8ec8-7446f913c91b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:05.057801 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9d6ab20f-8a64-49c4-981c-a572d2e5bc43 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:05.059165 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9d6ab20f-8a64-49c4-981c-a572d2e5bc43 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:05.059950 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9d6ab20f-8a64-49c4-981c-a572d2e5bc43 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:05.060538 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9d6ab20f-8a64-49c4-981c-a572d2e5bc43 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:05.066094 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-6dabafff-522d-4ffc-8ec8-7446f913c91b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:05.067545 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-6dabafff-522d-4ffc-8ec8-7446f913c91b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:05.069164 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-6dabafff-522d-4ffc-8ec8-7446f913c91b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1749 microversion: 2.20 time: 0.162041 Jul 20 19:30:05.069960 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 357/705] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:04 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1749 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:30:05.198119 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-9d6ab20f-8a64-49c4-981c-a572d2e5bc43 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:05.205883 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-9d6ab20f-8a64-49c4-981c-a572d2e5bc43 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1260 microversion: 2.1 time: 0.161413 Jul 20 19:30:05.206456 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 349/706] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:05 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:30:06.087525 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-3a256206-63bd-4dfa-8d00-3853ef458f6c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:06.088128 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-3a256206-63bd-4dfa-8d00-3853ef458f6c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:06.094618 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3a256206-63bd-4dfa-8d00-3853ef458f6c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:06.094999 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3a256206-63bd-4dfa-8d00-3853ef458f6c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:06.095749 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3a256206-63bd-4dfa-8d00-3853ef458f6c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:06.096176 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3a256206-63bd-4dfa-8d00-3853ef458f6c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:06.222838 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-395cbb01-5cb5-4bae-af7d-d8455daf93b7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:06.223453 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-395cbb01-5cb5-4bae-af7d-d8455daf93b7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:06.224070 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-3a256206-63bd-4dfa-8d00-3853ef458f6c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:06.230051 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-395cbb01-5cb5-4bae-af7d-d8455daf93b7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:06.230499 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-395cbb01-5cb5-4bae-af7d-d8455daf93b7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:06.231270 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-395cbb01-5cb5-4bae-af7d-d8455daf93b7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:06.231705 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-395cbb01-5cb5-4bae-af7d-d8455daf93b7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:06.232419 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-3a256206-63bd-4dfa-8d00-3853ef458f6c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:06.234124 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-3a256206-63bd-4dfa-8d00-3853ef458f6c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:06.235548 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-3a256206-63bd-4dfa-8d00-3853ef458f6c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1749 microversion: 2.20 time: 0.152961 Jul 20 19:30:06.236108 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 358/707] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:06 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1749 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:30:06.371912 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-395cbb01-5cb5-4bae-af7d-d8455daf93b7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:06.380212 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-395cbb01-5cb5-4bae-af7d-d8455daf93b7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1260 microversion: 2.1 time: 0.161199 Jul 20 19:30:06.380801 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 350/708] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:06 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:30:07.253715 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-f25ac2ff-e1c7-4980-b982-ad6825c563bb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:07.254327 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-f25ac2ff-e1c7-4980-b982-ad6825c563bb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:07.260807 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f25ac2ff-e1c7-4980-b982-ad6825c563bb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:07.261251 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f25ac2ff-e1c7-4980-b982-ad6825c563bb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:07.262041 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f25ac2ff-e1c7-4980-b982-ad6825c563bb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:07.262473 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f25ac2ff-e1c7-4980-b982-ad6825c563bb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:07.393581 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-f25ac2ff-e1c7-4980-b982-ad6825c563bb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:07.396676 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-17b4091a-44b4-4e91-9052-131248a90458 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:07.397308 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-17b4091a-44b4-4e91-9052-131248a90458 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:07.399625 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_api:SELECT=80 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:07.402646 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-f25ac2ff-e1c7-4980-b982-ad6825c563bb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:07.404226 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-f25ac2ff-e1c7-4980-b982-ad6825c563bb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:07.404821 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-17b4091a-44b4-4e91-9052-131248a90458 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:07.405266 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-17b4091a-44b4-4e91-9052-131248a90458 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:07.405619 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-f25ac2ff-e1c7-4980-b982-ad6825c563bb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1749 microversion: 2.20 time: 0.155905 Jul 20 19:30:07.406780 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-17b4091a-44b4-4e91-9052-131248a90458 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:07.407342 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 359/709] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:07 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1749 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:30:07.407454 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-17b4091a-44b4-4e91-9052-131248a90458 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:07.538052 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-17b4091a-44b4-4e91-9052-131248a90458 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:07.545630 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-17b4091a-44b4-4e91-9052-131248a90458 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1260 microversion: 2.1 time: 0.152771 Jul 20 19:30:07.546192 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 351/710] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:07 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:30:08.424276 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-08fb733d-18dc-4368-b973-733d6f42b462 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:08.424871 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-08fb733d-18dc-4368-b973-733d6f42b462 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:08.431453 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-08fb733d-18dc-4368-b973-733d6f42b462 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:08.431889 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-08fb733d-18dc-4368-b973-733d6f42b462 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:08.432635 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-08fb733d-18dc-4368-b973-733d6f42b462 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:08.433062 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-08fb733d-18dc-4368-b973-733d6f42b462 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:08.561534 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-5f88ca86-d80b-4788-8baf-dbbfc18438d1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:08.562931 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-5f88ca86-d80b-4788-8baf-dbbfc18438d1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:08.570128 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5f88ca86-d80b-4788-8baf-dbbfc18438d1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:08.570376 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5f88ca86-d80b-4788-8baf-dbbfc18438d1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:08.571144 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5f88ca86-d80b-4788-8baf-dbbfc18438d1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:08.571602 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5f88ca86-d80b-4788-8baf-dbbfc18438d1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:08.572978 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-08fb733d-18dc-4368-b973-733d6f42b462 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:08.581654 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-08fb733d-18dc-4368-b973-733d6f42b462 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:08.583095 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-08fb733d-18dc-4368-b973-733d6f42b462 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:08.584527 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-08fb733d-18dc-4368-b973-733d6f42b462 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1749 microversion: 2.20 time: 0.163968 Jul 20 19:30:08.585149 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 360/711] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:08 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1749 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:30:08.709276 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-5f88ca86-d80b-4788-8baf-dbbfc18438d1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:08.717033 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-5f88ca86-d80b-4788-8baf-dbbfc18438d1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1260 microversion: 2.1 time: 0.159319 Jul 20 19:30:08.717621 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 352/712] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:08 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:30:09.603321 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-4e815ecb-27f4-4456-9b16-7d1a8176a5ad tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:09.603865 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-4e815ecb-27f4-4456-9b16-7d1a8176a5ad tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:09.611124 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4e815ecb-27f4-4456-9b16-7d1a8176a5ad tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:09.611579 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4e815ecb-27f4-4456-9b16-7d1a8176a5ad tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:09.612334 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4e815ecb-27f4-4456-9b16-7d1a8176a5ad tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:09.612768 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4e815ecb-27f4-4456-9b16-7d1a8176a5ad tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:09.734321 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-0719fa9f-3d7b-47af-9251-54bd95df91db tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:09.735115 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-0719fa9f-3d7b-47af-9251-54bd95df91db tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:09.741635 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0719fa9f-3d7b-47af-9251-54bd95df91db tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:09.742075 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0719fa9f-3d7b-47af-9251-54bd95df91db tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:09.742442 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-4e815ecb-27f4-4456-9b16-7d1a8176a5ad tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:09.742837 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0719fa9f-3d7b-47af-9251-54bd95df91db tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:09.743264 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0719fa9f-3d7b-47af-9251-54bd95df91db tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:09.752360 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-4e815ecb-27f4-4456-9b16-7d1a8176a5ad tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:09.754148 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-4e815ecb-27f4-4456-9b16-7d1a8176a5ad tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:09.755808 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-4e815ecb-27f4-4456-9b16-7d1a8176a5ad tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1749 microversion: 2.20 time: 0.156030 Jul 20 19:30:09.756665 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 361/713] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:09 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1749 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:30:09.878349 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0719fa9f-3d7b-47af-9251-54bd95df91db tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:09.885798 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-0719fa9f-3d7b-47af-9251-54bd95df91db tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1260 microversion: 2.1 time: 0.155971 Jul 20 19:30:09.886373 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 353/714] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:09 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:30:10.773712 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-b4deb140-9593-4567-9a6e-ddd757ad04d4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:10.774313 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-b4deb140-9593-4567-9a6e-ddd757ad04d4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:10.780935 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b4deb140-9593-4567-9a6e-ddd757ad04d4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:10.781371 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b4deb140-9593-4567-9a6e-ddd757ad04d4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:10.782237 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b4deb140-9593-4567-9a6e-ddd757ad04d4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:10.782675 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b4deb140-9593-4567-9a6e-ddd757ad04d4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:10.902311 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d69e2ea3-e67e-47a1-a745-3c7c13e6e231 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:10.903038 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d69e2ea3-e67e-47a1-a745-3c7c13e6e231 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:10.911106 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d69e2ea3-e67e-47a1-a745-3c7c13e6e231 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:10.911555 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d69e2ea3-e67e-47a1-a745-3c7c13e6e231 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:10.912333 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d69e2ea3-e67e-47a1-a745-3c7c13e6e231 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:10.913322 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d69e2ea3-e67e-47a1-a745-3c7c13e6e231 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:10.925874 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-b4deb140-9593-4567-9a6e-ddd757ad04d4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:10.936117 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-b4deb140-9593-4567-9a6e-ddd757ad04d4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:10.938311 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-b4deb140-9593-4567-9a6e-ddd757ad04d4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:10.939507 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-b4deb140-9593-4567-9a6e-ddd757ad04d4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1749 microversion: 2.20 time: 0.169729 Jul 20 19:30:10.940071 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 362/715] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:10 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1749 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:30:11.050785 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d69e2ea3-e67e-47a1-a745-3c7c13e6e231 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:11.058344 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d69e2ea3-e67e-47a1-a745-3c7c13e6e231 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1260 microversion: 2.1 time: 0.159896 Jul 20 19:30:11.058912 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 354/716] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:10 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:30:11.958100 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-154ec22c-e8cb-4e11-a2d6-97bbe74c0f2c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:11.958708 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-154ec22c-e8cb-4e11-a2d6-97bbe74c0f2c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:11.965478 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-154ec22c-e8cb-4e11-a2d6-97bbe74c0f2c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:11.965959 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-154ec22c-e8cb-4e11-a2d6-97bbe74c0f2c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:11.966710 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-154ec22c-e8cb-4e11-a2d6-97bbe74c0f2c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:11.967143 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-154ec22c-e8cb-4e11-a2d6-97bbe74c0f2c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:12.075854 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-5944745d-5ff1-4c32-a7fb-01456e978236 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:12.076461 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-5944745d-5ff1-4c32-a7fb-01456e978236 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:12.084066 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5944745d-5ff1-4c32-a7fb-01456e978236 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:12.084509 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5944745d-5ff1-4c32-a7fb-01456e978236 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:12.085350 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5944745d-5ff1-4c32-a7fb-01456e978236 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:12.085846 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5944745d-5ff1-4c32-a7fb-01456e978236 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:12.095605 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-154ec22c-e8cb-4e11-a2d6-97bbe74c0f2c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:12.104856 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-154ec22c-e8cb-4e11-a2d6-97bbe74c0f2c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:12.106469 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-154ec22c-e8cb-4e11-a2d6-97bbe74c0f2c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:12.107646 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-154ec22c-e8cb-4e11-a2d6-97bbe74c0f2c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1749 microversion: 2.20 time: 0.153533 Jul 20 19:30:12.108198 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 363/717] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:11 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1749 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:30:12.225000 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-5944745d-5ff1-4c32-a7fb-01456e978236 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:12.232435 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-5944745d-5ff1-4c32-a7fb-01456e978236 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1260 microversion: 2.1 time: 0.160483 Jul 20 19:30:12.232991 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 355/718] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:12 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:30:13.125407 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-23b2ebf2-e266-4111-a542-bff1633bf985 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:13.126045 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-23b2ebf2-e266-4111-a542-bff1633bf985 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:13.132538 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-23b2ebf2-e266-4111-a542-bff1633bf985 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:13.132983 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-23b2ebf2-e266-4111-a542-bff1633bf985 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:13.133772 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-23b2ebf2-e266-4111-a542-bff1633bf985 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:13.134205 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-23b2ebf2-e266-4111-a542-bff1633bf985 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:13.248714 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-95b52c46-4553-47e6-a600-f04ae9302aa2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:13.249451 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-95b52c46-4553-47e6-a600-f04ae9302aa2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:13.256188 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-95b52c46-4553-47e6-a600-f04ae9302aa2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:13.256633 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-95b52c46-4553-47e6-a600-f04ae9302aa2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:13.257402 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-95b52c46-4553-47e6-a600-f04ae9302aa2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:13.257860 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-95b52c46-4553-47e6-a600-f04ae9302aa2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:13.265392 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-23b2ebf2-e266-4111-a542-bff1633bf985 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:13.273601 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:13.274070 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-23b2ebf2-e266-4111-a542-bff1633bf985 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:13.275711 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-23b2ebf2-e266-4111-a542-bff1633bf985 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:13.276920 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-23b2ebf2-e266-4111-a542-bff1633bf985 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1749 microversion: 2.20 time: 0.155510 Jul 20 19:30:13.277682 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 364/719] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:13 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1749 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:30:13.396003 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-95b52c46-4553-47e6-a600-f04ae9302aa2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:13.403505 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-95b52c46-4553-47e6-a600-f04ae9302aa2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1260 microversion: 2.1 time: 0.158650 Jul 20 19:30:13.404077 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 356/720] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:13 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:30:14.296000 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-7efc37b7-f88d-4417-95c9-13afab06bcea tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:14.296557 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-7efc37b7-f88d-4417-95c9-13afab06bcea tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:14.303356 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-7efc37b7-f88d-4417-95c9-13afab06bcea tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:14.303801 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-7efc37b7-f88d-4417-95c9-13afab06bcea tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:14.304801 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-7efc37b7-f88d-4417-95c9-13afab06bcea tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:14.305432 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-7efc37b7-f88d-4417-95c9-13afab06bcea tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:14.309649 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:14.420214 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4ed6c4f4-58e6-453b-bc59-fe14897fadec tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:14.420825 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-4ed6c4f4-58e6-453b-bc59-fe14897fadec tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:14.427695 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4ed6c4f4-58e6-453b-bc59-fe14897fadec tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:14.428142 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4ed6c4f4-58e6-453b-bc59-fe14897fadec tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:14.428904 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4ed6c4f4-58e6-453b-bc59-fe14897fadec tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:14.429335 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4ed6c4f4-58e6-453b-bc59-fe14897fadec tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:14.442272 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-7efc37b7-f88d-4417-95c9-13afab06bcea tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:14.451003 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-7efc37b7-f88d-4417-95c9-13afab06bcea tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:14.453844 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-7efc37b7-f88d-4417-95c9-13afab06bcea tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:14.454854 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-7efc37b7-f88d-4417-95c9-13afab06bcea tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1749 microversion: 2.20 time: 0.162832 Jul 20 19:30:14.455506 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 365/721] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:14 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1749 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:30:14.572145 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-4ed6c4f4-58e6-453b-bc59-fe14897fadec tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:14.579631 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-4ed6c4f4-58e6-453b-bc59-fe14897fadec tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1260 microversion: 2.1 time: 0.163212 Jul 20 19:30:14.580203 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 357/722] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:14 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:30:15.474682 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-cfc437aa-716f-4ef3-bb29-0acf7f6ab13d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:15.475414 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-cfc437aa-716f-4ef3-bb29-0acf7f6ab13d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:15.481568 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-cfc437aa-716f-4ef3-bb29-0acf7f6ab13d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:15.482019 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-cfc437aa-716f-4ef3-bb29-0acf7f6ab13d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:15.482787 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-cfc437aa-716f-4ef3-bb29-0acf7f6ab13d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:15.483223 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-cfc437aa-716f-4ef3-bb29-0acf7f6ab13d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:15.597491 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-edd0f56d-da7e-43a4-966c-0ad41ec772f9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:15.598555 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-edd0f56d-da7e-43a4-966c-0ad41ec772f9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:15.605098 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-edd0f56d-da7e-43a4-966c-0ad41ec772f9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:15.605646 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-edd0f56d-da7e-43a4-966c-0ad41ec772f9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:15.606349 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-edd0f56d-da7e-43a4-966c-0ad41ec772f9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:15.606787 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-edd0f56d-da7e-43a4-966c-0ad41ec772f9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:15.619109 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-cfc437aa-716f-4ef3-bb29-0acf7f6ab13d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:15.628442 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-cfc437aa-716f-4ef3-bb29-0acf7f6ab13d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:15.630054 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-cfc437aa-716f-4ef3-bb29-0acf7f6ab13d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:15.631317 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-cfc437aa-716f-4ef3-bb29-0acf7f6ab13d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1749 microversion: 2.20 time: 0.161362 Jul 20 19:30:15.631954 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 366/723] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:15 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1749 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:30:15.740951 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-edd0f56d-da7e-43a4-966c-0ad41ec772f9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:15.748462 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-edd0f56d-da7e-43a4-966c-0ad41ec772f9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1260 microversion: 2.1 time: 0.155754 Jul 20 19:30:15.749990 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 358/724] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:15 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:30:16.650551 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-56791dd2-7a5a-4fb9-97ce-521997dc9069 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:16.651162 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-56791dd2-7a5a-4fb9-97ce-521997dc9069 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:16.658256 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-56791dd2-7a5a-4fb9-97ce-521997dc9069 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:16.658706 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-56791dd2-7a5a-4fb9-97ce-521997dc9069 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:16.659460 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-56791dd2-7a5a-4fb9-97ce-521997dc9069 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:16.659895 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-56791dd2-7a5a-4fb9-97ce-521997dc9069 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:16.767028 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-9925e3c8-d898-46b7-885f-5f9179e0012a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:16.767640 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-9925e3c8-d898-46b7-885f-5f9179e0012a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:16.774137 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9925e3c8-d898-46b7-885f-5f9179e0012a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:16.774582 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9925e3c8-d898-46b7-885f-5f9179e0012a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:16.775342 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9925e3c8-d898-46b7-885f-5f9179e0012a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:16.775769 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9925e3c8-d898-46b7-885f-5f9179e0012a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:16.797873 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-56791dd2-7a5a-4fb9-97ce-521997dc9069 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:16.806704 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-56791dd2-7a5a-4fb9-97ce-521997dc9069 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:16.808464 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-56791dd2-7a5a-4fb9-97ce-521997dc9069 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:16.809643 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-56791dd2-7a5a-4fb9-97ce-521997dc9069 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1749 microversion: 2.20 time: 0.163204 Jul 20 19:30:16.810695 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 367/725] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:16 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1749 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:30:16.911133 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-9925e3c8-d898-46b7-885f-5f9179e0012a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:16.918503 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-9925e3c8-d898-46b7-885f-5f9179e0012a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1260 microversion: 2.1 time: 0.156035 Jul 20 19:30:16.919067 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 359/726] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:16 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:30:17.829372 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-b139053a-26a2-4c9c-a46c-690ca8f5be6f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:17.830052 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-b139053a-26a2-4c9c-a46c-690ca8f5be6f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:17.832349 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_api:SELECT=64 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:17.837944 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b139053a-26a2-4c9c-a46c-690ca8f5be6f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:17.838392 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b139053a-26a2-4c9c-a46c-690ca8f5be6f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:17.839158 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b139053a-26a2-4c9c-a46c-690ca8f5be6f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:17.839594 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b139053a-26a2-4c9c-a46c-690ca8f5be6f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:17.935570 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c7774ea8-63cb-4850-a7fe-e3a054074990 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:17.936195 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c7774ea8-63cb-4850-a7fe-e3a054074990 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:17.943269 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c7774ea8-63cb-4850-a7fe-e3a054074990 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:17.943711 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c7774ea8-63cb-4850-a7fe-e3a054074990 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:17.944468 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c7774ea8-63cb-4850-a7fe-e3a054074990 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:17.944892 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c7774ea8-63cb-4850-a7fe-e3a054074990 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:17.972925 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-b139053a-26a2-4c9c-a46c-690ca8f5be6f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:17.982620 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-b139053a-26a2-4c9c-a46c-690ca8f5be6f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:17.984134 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-b139053a-26a2-4c9c-a46c-690ca8f5be6f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:17.985675 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-b139053a-26a2-4c9c-a46c-690ca8f5be6f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1749 microversion: 2.20 time: 0.161041 Jul 20 19:30:17.986415 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 368/727] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:17 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1749 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:30:18.075726 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c7774ea8-63cb-4850-a7fe-e3a054074990 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:18.083389 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c7774ea8-63cb-4850-a7fe-e3a054074990 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1260 microversion: 2.1 time: 0.151527 Jul 20 19:30:18.083890 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 360/728] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:17 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:30:19.004056 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-c645e6c4-2aae-48f2-8f80-4fa085125115 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:19.004650 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-c645e6c4-2aae-48f2-8f80-4fa085125115 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:19.010856 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c645e6c4-2aae-48f2-8f80-4fa085125115 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:19.011302 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c645e6c4-2aae-48f2-8f80-4fa085125115 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:19.012059 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c645e6c4-2aae-48f2-8f80-4fa085125115 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:19.012495 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c645e6c4-2aae-48f2-8f80-4fa085125115 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:19.100556 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-42081b5e-e8ed-4877-b65e-2ce8cf5136dd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:19.101290 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-42081b5e-e8ed-4877-b65e-2ce8cf5136dd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:19.107829 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-42081b5e-e8ed-4877-b65e-2ce8cf5136dd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:19.108364 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-42081b5e-e8ed-4877-b65e-2ce8cf5136dd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:19.109223 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-42081b5e-e8ed-4877-b65e-2ce8cf5136dd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:19.109685 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-42081b5e-e8ed-4877-b65e-2ce8cf5136dd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:19.147545 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-c645e6c4-2aae-48f2-8f80-4fa085125115 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:19.156890 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-c645e6c4-2aae-48f2-8f80-4fa085125115 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:19.158707 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-c645e6c4-2aae-48f2-8f80-4fa085125115 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:19.159879 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-c645e6c4-2aae-48f2-8f80-4fa085125115 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1749 microversion: 2.20 time: 0.160044 Jul 20 19:30:19.160443 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 369/729] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:18 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1749 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:30:19.247903 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-42081b5e-e8ed-4877-b65e-2ce8cf5136dd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:19.256069 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-42081b5e-e8ed-4877-b65e-2ce8cf5136dd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1260 microversion: 2.1 time: 0.159281 Jul 20 19:30:19.256577 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 361/730] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:19 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:30:20.177969 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-99ab1e62-bb0d-409b-b5a7-07fa2f2e0900 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:20.178552 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-99ab1e62-bb0d-409b-b5a7-07fa2f2e0900 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:20.184973 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-99ab1e62-bb0d-409b-b5a7-07fa2f2e0900 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:20.185442 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-99ab1e62-bb0d-409b-b5a7-07fa2f2e0900 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:20.186225 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-99ab1e62-bb0d-409b-b5a7-07fa2f2e0900 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:20.186648 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-99ab1e62-bb0d-409b-b5a7-07fa2f2e0900 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:20.272789 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a33c878c-5976-4294-bc6c-15bd3347f88e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:20.273682 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a33c878c-5976-4294-bc6c-15bd3347f88e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:20.280220 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a33c878c-5976-4294-bc6c-15bd3347f88e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:20.280741 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a33c878c-5976-4294-bc6c-15bd3347f88e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:20.281534 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a33c878c-5976-4294-bc6c-15bd3347f88e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:20.281993 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a33c878c-5976-4294-bc6c-15bd3347f88e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:20.317258 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-99ab1e62-bb0d-409b-b5a7-07fa2f2e0900 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:20.326097 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-99ab1e62-bb0d-409b-b5a7-07fa2f2e0900 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:20.327597 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-99ab1e62-bb0d-409b-b5a7-07fa2f2e0900 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:20.329547 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-99ab1e62-bb0d-409b-b5a7-07fa2f2e0900 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1749 microversion: 2.20 time: 0.155374 Jul 20 19:30:20.330107 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 370/731] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:20 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1749 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:30:20.417103 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a33c878c-5976-4294-bc6c-15bd3347f88e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:20.424720 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a33c878c-5976-4294-bc6c-15bd3347f88e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1260 microversion: 2.1 time: 0.155802 Jul 20 19:30:20.425288 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 362/732] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:20 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:30:21.347804 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-fa68226d-c833-4b24-accf-fbed6e3e56a8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:21.348400 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-fa68226d-c833-4b24-accf-fbed6e3e56a8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:21.355025 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-fa68226d-c833-4b24-accf-fbed6e3e56a8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:21.355475 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-fa68226d-c833-4b24-accf-fbed6e3e56a8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:21.356146 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-fa68226d-c833-4b24-accf-fbed6e3e56a8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:21.356571 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-fa68226d-c833-4b24-accf-fbed6e3e56a8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:21.442098 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ff5d8e64-7a43-4756-8538-f9dc4c9f0b5d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:21.443413 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ff5d8e64-7a43-4756-8538-f9dc4c9f0b5d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:21.450307 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ff5d8e64-7a43-4756-8538-f9dc4c9f0b5d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:21.451016 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ff5d8e64-7a43-4756-8538-f9dc4c9f0b5d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:21.451985 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ff5d8e64-7a43-4756-8538-f9dc4c9f0b5d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:21.452597 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ff5d8e64-7a43-4756-8538-f9dc4c9f0b5d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:21.490932 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-fa68226d-c833-4b24-accf-fbed6e3e56a8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:21.499731 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-fa68226d-c833-4b24-accf-fbed6e3e56a8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:21.501883 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-fa68226d-c833-4b24-accf-fbed6e3e56a8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:21.503044 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-fa68226d-c833-4b24-accf-fbed6e3e56a8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1749 microversion: 2.20 time: 0.159305 Jul 20 19:30:21.503611 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 371/733] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:21 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1749 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:30:21.587683 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ff5d8e64-7a43-4756-8538-f9dc4c9f0b5d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:21.595840 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ff5d8e64-7a43-4756-8538-f9dc4c9f0b5d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1260 microversion: 2.1 time: 0.158268 Jul 20 19:30:21.596408 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 363/734] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:21 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:22.521452 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-bce3c90b-facb-421b-8924-86897e55e245 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:22.522084 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-bce3c90b-facb-421b-8924-86897e55e245 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:22.528732 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-bce3c90b-facb-421b-8924-86897e55e245 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:22.529182 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-bce3c90b-facb-421b-8924-86897e55e245 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:22.529971 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-bce3c90b-facb-421b-8924-86897e55e245 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:22.530410 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-bce3c90b-facb-421b-8924-86897e55e245 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:22.612344 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-88575a35-f600-40e9-bb4e-9a858e29e717 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:22.612954 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-88575a35-f600-40e9-bb4e-9a858e29e717 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:22.619712 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-88575a35-f600-40e9-bb4e-9a858e29e717 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:22.620165 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-88575a35-f600-40e9-bb4e-9a858e29e717 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:22.620927 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-88575a35-f600-40e9-bb4e-9a858e29e717 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:22.621355 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-88575a35-f600-40e9-bb4e-9a858e29e717 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:22.664923 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-bce3c90b-facb-421b-8924-86897e55e245 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:22.674346 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-bce3c90b-facb-421b-8924-86897e55e245 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:22.675861 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-bce3c90b-facb-421b-8924-86897e55e245 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:22.677057 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-bce3c90b-facb-421b-8924-86897e55e245 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1749 microversion: 2.20 time: 0.159555 Jul 20 19:30:22.677705 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 372/735] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:22 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1749 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:30:22.756154 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-88575a35-f600-40e9-bb4e-9a858e29e717 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:22.763548 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-88575a35-f600-40e9-bb4e-9a858e29e717 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1260 microversion: 2.1 time: 0.155266 Jul 20 19:30:22.764129 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 364/736] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:22 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:30:23.694983 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-5941ca79-4e5d-415c-86b6-102f80c05f46 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:23.695895 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-5941ca79-4e5d-415c-86b6-102f80c05f46 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:23.703261 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-5941ca79-4e5d-415c-86b6-102f80c05f46 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:23.703749 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-5941ca79-4e5d-415c-86b6-102f80c05f46 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:23.704524 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-5941ca79-4e5d-415c-86b6-102f80c05f46 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:23.704960 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-5941ca79-4e5d-415c-86b6-102f80c05f46 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:23.780660 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-36ae9362-a722-4450-ba47-5db6a377a5b3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:23.781332 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-36ae9362-a722-4450-ba47-5db6a377a5b3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:23.787794 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-36ae9362-a722-4450-ba47-5db6a377a5b3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:23.788244 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-36ae9362-a722-4450-ba47-5db6a377a5b3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:23.789025 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-36ae9362-a722-4450-ba47-5db6a377a5b3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:23.789459 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-36ae9362-a722-4450-ba47-5db6a377a5b3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:23.832872 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-5941ca79-4e5d-415c-86b6-102f80c05f46 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:23.841741 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-5941ca79-4e5d-415c-86b6-102f80c05f46 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:23.843266 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-5941ca79-4e5d-415c-86b6-102f80c05f46 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:23.844492 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-5941ca79-4e5d-415c-86b6-102f80c05f46 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1749 microversion: 2.20 time: 0.153666 Jul 20 19:30:23.845051 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 373/737] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:23 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1749 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:30:23.923476 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-36ae9362-a722-4450-ba47-5db6a377a5b3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:23.930981 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-36ae9362-a722-4450-ba47-5db6a377a5b3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1260 microversion: 2.1 time: 0.154732 Jul 20 19:30:23.931551 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 365/738] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:23 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:30:24.863305 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-1e87f379-63c3-4d82-a197-b30378b9af82 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:24.863895 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-1e87f379-63c3-4d82-a197-b30378b9af82 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:24.870441 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1e87f379-63c3-4d82-a197-b30378b9af82 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:24.870883 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1e87f379-63c3-4d82-a197-b30378b9af82 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:24.871639 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1e87f379-63c3-4d82-a197-b30378b9af82 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:24.872066 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1e87f379-63c3-4d82-a197-b30378b9af82 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:24.947603 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d67ab7c4-7e25-48b2-b78c-3c1b47ee7149 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:24.948833 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d67ab7c4-7e25-48b2-b78c-3c1b47ee7149 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:24.955385 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d67ab7c4-7e25-48b2-b78c-3c1b47ee7149 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:24.955836 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d67ab7c4-7e25-48b2-b78c-3c1b47ee7149 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:24.956709 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d67ab7c4-7e25-48b2-b78c-3c1b47ee7149 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:24.957049 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d67ab7c4-7e25-48b2-b78c-3c1b47ee7149 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:25.007878 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-1e87f379-63c3-4d82-a197-b30378b9af82 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:25.017142 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-1e87f379-63c3-4d82-a197-b30378b9af82 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:25.018664 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-1e87f379-63c3-4d82-a197-b30378b9af82 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:25.019814 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-1e87f379-63c3-4d82-a197-b30378b9af82 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1749 microversion: 2.20 time: 0.161228 Jul 20 19:30:25.020370 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 374/739] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:24 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1749 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:30:25.090545 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d67ab7c4-7e25-48b2-b78c-3c1b47ee7149 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:25.098752 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d67ab7c4-7e25-48b2-b78c-3c1b47ee7149 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1260 microversion: 2.1 time: 0.154909 Jul 20 19:30:25.099319 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 366/740] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:24 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:30:26.037817 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-6f7fecb3-42f0-4b3e-87ec-84b6fb29ae9a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:26.038428 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-6f7fecb3-42f0-4b3e-87ec-84b6fb29ae9a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:26.045046 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-6f7fecb3-42f0-4b3e-87ec-84b6fb29ae9a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:26.045497 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-6f7fecb3-42f0-4b3e-87ec-84b6fb29ae9a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:26.046823 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-6f7fecb3-42f0-4b3e-87ec-84b6fb29ae9a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:26.047270 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-6f7fecb3-42f0-4b3e-87ec-84b6fb29ae9a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:26.116147 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-db1ae73b-46ed-45bc-9649-ceb6e1b734f8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:26.116696 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-db1ae73b-46ed-45bc-9649-ceb6e1b734f8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:26.123126 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-db1ae73b-46ed-45bc-9649-ceb6e1b734f8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:26.123572 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-db1ae73b-46ed-45bc-9649-ceb6e1b734f8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:26.124342 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-db1ae73b-46ed-45bc-9649-ceb6e1b734f8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:26.125401 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-db1ae73b-46ed-45bc-9649-ceb6e1b734f8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:26.181908 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-6f7fecb3-42f0-4b3e-87ec-84b6fb29ae9a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:26.190693 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-6f7fecb3-42f0-4b3e-87ec-84b6fb29ae9a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:26.192327 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-6f7fecb3-42f0-4b3e-87ec-84b6fb29ae9a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:26.193660 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-6f7fecb3-42f0-4b3e-87ec-84b6fb29ae9a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1749 microversion: 2.20 time: 0.159893 Jul 20 19:30:26.194234 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 375/741] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:26 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1749 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:30:26.264197 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-db1ae73b-46ed-45bc-9649-ceb6e1b734f8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:26.271572 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-db1ae73b-46ed-45bc-9649-ceb6e1b734f8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1260 microversion: 2.1 time: 0.159464 Jul 20 19:30:26.272157 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 367/742] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:26 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:30:27.212269 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-d11c7849-35a0-42de-a457-f9f5b767f55d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:27.212859 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-d11c7849-35a0-42de-a457-f9f5b767f55d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:27.220249 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d11c7849-35a0-42de-a457-f9f5b767f55d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:27.220700 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d11c7849-35a0-42de-a457-f9f5b767f55d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:27.221449 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d11c7849-35a0-42de-a457-f9f5b767f55d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:27.221915 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d11c7849-35a0-42de-a457-f9f5b767f55d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:27.288241 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4a0ddf34-55c8-4c8d-86f6-43f88f3d2141 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:27.288834 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-4a0ddf34-55c8-4c8d-86f6-43f88f3d2141 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:27.295343 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4a0ddf34-55c8-4c8d-86f6-43f88f3d2141 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:27.295794 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4a0ddf34-55c8-4c8d-86f6-43f88f3d2141 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:27.297124 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4a0ddf34-55c8-4c8d-86f6-43f88f3d2141 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:27.297597 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4a0ddf34-55c8-4c8d-86f6-43f88f3d2141 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:27.352666 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-d11c7849-35a0-42de-a457-f9f5b767f55d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:27.361680 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-d11c7849-35a0-42de-a457-f9f5b767f55d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:27.363292 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-d11c7849-35a0-42de-a457-f9f5b767f55d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:27.364556 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-d11c7849-35a0-42de-a457-f9f5b767f55d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1749 microversion: 2.20 time: 0.156642 Jul 20 19:30:27.365195 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 376/743] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:27 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1749 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:30:27.436510 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-4a0ddf34-55c8-4c8d-86f6-43f88f3d2141 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:27.445209 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-4a0ddf34-55c8-4c8d-86f6-43f88f3d2141 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1260 microversion: 2.1 time: 0.161025 Jul 20 19:30:27.445928 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 368/744] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:27 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:30:28.383020 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-7b125219-5717-40a0-aed0-4c9fbc7cb3cc tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:28.383628 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-7b125219-5717-40a0-aed0-4c9fbc7cb3cc tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:28.390662 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-7b125219-5717-40a0-aed0-4c9fbc7cb3cc tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:28.391108 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-7b125219-5717-40a0-aed0-4c9fbc7cb3cc tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:28.391868 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-7b125219-5717-40a0-aed0-4c9fbc7cb3cc tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:28.392302 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-7b125219-5717-40a0-aed0-4c9fbc7cb3cc tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:28.461665 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-8cff5a5e-2de5-469b-a988-c33f09e8f130 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:28.463119 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-8cff5a5e-2de5-469b-a988-c33f09e8f130 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:28.469738 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8cff5a5e-2de5-469b-a988-c33f09e8f130 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:28.470119 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8cff5a5e-2de5-469b-a988-c33f09e8f130 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:28.470897 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8cff5a5e-2de5-469b-a988-c33f09e8f130 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:28.471326 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8cff5a5e-2de5-469b-a988-c33f09e8f130 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:28.526590 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-7b125219-5717-40a0-aed0-4c9fbc7cb3cc tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:28.535277 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-7b125219-5717-40a0-aed0-4c9fbc7cb3cc tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:28.536809 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-7b125219-5717-40a0-aed0-4c9fbc7cb3cc tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:28.538031 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-7b125219-5717-40a0-aed0-4c9fbc7cb3cc tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1749 microversion: 2.20 time: 0.159176 Jul 20 19:30:28.538590 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 377/745] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:28 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1749 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:30:28.609664 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8cff5a5e-2de5-469b-a988-c33f09e8f130 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:28.617160 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-8cff5a5e-2de5-469b-a988-c33f09e8f130 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1260 microversion: 2.1 time: 0.159307 Jul 20 19:30:28.617778 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 369/746] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:28 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:29.556004 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-a6ae162b-276b-494a-9d8f-f90b163a9a10 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:29.556609 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-a6ae162b-276b-494a-9d8f-f90b163a9a10 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:29.563744 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a6ae162b-276b-494a-9d8f-f90b163a9a10 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:29.564193 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a6ae162b-276b-494a-9d8f-f90b163a9a10 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:29.564961 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a6ae162b-276b-494a-9d8f-f90b163a9a10 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:29.565399 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a6ae162b-276b-494a-9d8f-f90b163a9a10 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:29.633568 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d9cf0ae4-8f40-4078-ae83-564ad8983807 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:29.634261 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d9cf0ae4-8f40-4078-ae83-564ad8983807 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:29.641736 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d9cf0ae4-8f40-4078-ae83-564ad8983807 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:29.642186 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d9cf0ae4-8f40-4078-ae83-564ad8983807 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:29.643079 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d9cf0ae4-8f40-4078-ae83-564ad8983807 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:29.643377 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d9cf0ae4-8f40-4078-ae83-564ad8983807 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:29.696335 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-a6ae162b-276b-494a-9d8f-f90b163a9a10 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:29.704854 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-a6ae162b-276b-494a-9d8f-f90b163a9a10 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:29.706388 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-a6ae162b-276b-494a-9d8f-f90b163a9a10 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:29.707538 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-a6ae162b-276b-494a-9d8f-f90b163a9a10 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1749 microversion: 2.20 time: 0.155514 Jul 20 19:30:29.708153 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 378/747] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:29 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1749 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:30:29.775927 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d9cf0ae4-8f40-4078-ae83-564ad8983807 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:29.783671 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d9cf0ae4-8f40-4078-ae83-564ad8983807 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1260 microversion: 2.1 time: 0.154085 Jul 20 19:30:29.784235 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 370/748] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:29 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:30:30.725300 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-cf8b1295-4dd8-410f-8669-57109bfd7780 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:30.725929 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-cf8b1295-4dd8-410f-8669-57109bfd7780 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:30.732362 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-cf8b1295-4dd8-410f-8669-57109bfd7780 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:30.732804 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-cf8b1295-4dd8-410f-8669-57109bfd7780 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:30.733776 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-cf8b1295-4dd8-410f-8669-57109bfd7780 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:30.734187 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-cf8b1295-4dd8-410f-8669-57109bfd7780 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:30.802330 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-8e5ce23f-c4e5-4681-9bfa-8f07e2e893b4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:30.802965 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-8e5ce23f-c4e5-4681-9bfa-8f07e2e893b4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:30.809057 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8e5ce23f-c4e5-4681-9bfa-8f07e2e893b4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:30.809537 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8e5ce23f-c4e5-4681-9bfa-8f07e2e893b4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:30.810305 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8e5ce23f-c4e5-4681-9bfa-8f07e2e893b4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:30.810991 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8e5ce23f-c4e5-4681-9bfa-8f07e2e893b4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:30.869225 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-cf8b1295-4dd8-410f-8669-57109bfd7780 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:30.878655 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-cf8b1295-4dd8-410f-8669-57109bfd7780 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:30.880148 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-cf8b1295-4dd8-410f-8669-57109bfd7780 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:30.881294 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-cf8b1295-4dd8-410f-8669-57109bfd7780 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1749 microversion: 2.20 time: 0.159935 Jul 20 19:30:30.881954 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 379/749] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:30 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1749 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:30:30.947301 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8e5ce23f-c4e5-4681-9bfa-8f07e2e893b4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:30.955397 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-8e5ce23f-c4e5-4681-9bfa-8f07e2e893b4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1260 microversion: 2.1 time: 0.157085 Jul 20 19:30:30.955953 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 371/750] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:30 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:30:31.900298 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-2a483bd1-2a4d-4d3e-b334-0aa45fc39dd0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:31.900909 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-2a483bd1-2a4d-4d3e-b334-0aa45fc39dd0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:31.908286 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2a483bd1-2a4d-4d3e-b334-0aa45fc39dd0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:31.908732 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2a483bd1-2a4d-4d3e-b334-0aa45fc39dd0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:31.909500 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2a483bd1-2a4d-4d3e-b334-0aa45fc39dd0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:31.911092 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2a483bd1-2a4d-4d3e-b334-0aa45fc39dd0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:31.972450 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-6ea5fdb0-4e78-4153-af29-f1d545e15fd4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:31.973205 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-6ea5fdb0-4e78-4153-af29-f1d545e15fd4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:31.980399 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6ea5fdb0-4e78-4153-af29-f1d545e15fd4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:31.980576 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6ea5fdb0-4e78-4153-af29-f1d545e15fd4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:31.981238 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6ea5fdb0-4e78-4153-af29-f1d545e15fd4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:31.981764 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6ea5fdb0-4e78-4153-af29-f1d545e15fd4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:32.048667 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-2a483bd1-2a4d-4d3e-b334-0aa45fc39dd0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:32.059701 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-2a483bd1-2a4d-4d3e-b334-0aa45fc39dd0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:32.061326 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-2a483bd1-2a4d-4d3e-b334-0aa45fc39dd0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:32.063195 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-2a483bd1-2a4d-4d3e-b334-0aa45fc39dd0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1749 microversion: 2.20 time: 0.166872 Jul 20 19:30:32.064001 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 380/751] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:31 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1749 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:30:32.128774 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6ea5fdb0-4e78-4153-af29-f1d545e15fd4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:32.137759 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-6ea5fdb0-4e78-4153-af29-f1d545e15fd4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1260 microversion: 2.1 time: 0.169328 Jul 20 19:30:32.138346 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 372/752] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:31 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:30:33.081422 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-1df2bef7-2e6c-422a-94b3-b757d5bad0f1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:33.082080 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-1df2bef7-2e6c-422a-94b3-b757d5bad0f1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:33.089768 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1df2bef7-2e6c-422a-94b3-b757d5bad0f1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:33.090220 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1df2bef7-2e6c-422a-94b3-b757d5bad0f1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:33.090992 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1df2bef7-2e6c-422a-94b3-b757d5bad0f1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:33.091431 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1df2bef7-2e6c-422a-94b3-b757d5bad0f1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:33.155053 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-9e94867d-cf6e-476b-843c-8fc45b16a27e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:33.156172 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-9e94867d-cf6e-476b-843c-8fc45b16a27e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:33.164665 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9e94867d-cf6e-476b-843c-8fc45b16a27e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:33.165308 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9e94867d-cf6e-476b-843c-8fc45b16a27e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:33.166157 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9e94867d-cf6e-476b-843c-8fc45b16a27e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:33.168695 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9e94867d-cf6e-476b-843c-8fc45b16a27e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:33.173830 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:33.234580 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-1df2bef7-2e6c-422a-94b3-b757d5bad0f1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:33.238096 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_cell1:SELECT=100 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:33.245581 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-1df2bef7-2e6c-422a-94b3-b757d5bad0f1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:33.247092 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-1df2bef7-2e6c-422a-94b3-b757d5bad0f1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:33.248421 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-1df2bef7-2e6c-422a-94b3-b757d5bad0f1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1749 microversion: 2.20 time: 0.170874 Jul 20 19:30:33.249621 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 381/753] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:33 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1749 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:30:33.330723 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-9e94867d-cf6e-476b-843c-8fc45b16a27e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:33.339226 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-9e94867d-cf6e-476b-843c-8fc45b16a27e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1260 microversion: 2.1 time: 0.188030 Jul 20 19:30:33.339810 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 373/754] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:33 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1260 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:34.267700 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-a2b37919-89aa-477d-95a4-a7bf617d6929 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:34.268301 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-a2b37919-89aa-477d-95a4-a7bf617d6929 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:34.275065 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a2b37919-89aa-477d-95a4-a7bf617d6929 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:34.275530 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a2b37919-89aa-477d-95a4-a7bf617d6929 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:34.276277 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a2b37919-89aa-477d-95a4-a7bf617d6929 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:34.276709 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a2b37919-89aa-477d-95a4-a7bf617d6929 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:34.356343 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-724dddf3-735b-47b3-aa13-21e6474046a0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:34.356945 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-724dddf3-735b-47b3-aa13-21e6474046a0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:34.363871 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-724dddf3-735b-47b3-aa13-21e6474046a0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:34.364319 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-724dddf3-735b-47b3-aa13-21e6474046a0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:34.365099 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-724dddf3-735b-47b3-aa13-21e6474046a0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:34.365588 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-724dddf3-735b-47b3-aa13-21e6474046a0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:34.420417 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-a2b37919-89aa-477d-95a4-a7bf617d6929 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:34.431813 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-a2b37919-89aa-477d-95a4-a7bf617d6929 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:34.433329 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-a2b37919-89aa-477d-95a4-a7bf617d6929 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:34.435494 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-a2b37919-89aa-477d-95a4-a7bf617d6929 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1749 microversion: 2.20 time: 0.172318 Jul 20 19:30:34.436293 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 382/755] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:34 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1749 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:30:34.516333 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-724dddf3-735b-47b3-aa13-21e6474046a0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:34.524047 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-724dddf3-735b-47b3-aa13-21e6474046a0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1260 microversion: 2.1 time: 0.171795 Jul 20 19:30:34.524655 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 374/756] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:34 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:30:35.455527 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-3604bf47-1f99-4a34-9424-77cde8e337fc tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:35.456152 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-3604bf47-1f99-4a34-9424-77cde8e337fc tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:35.463402 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3604bf47-1f99-4a34-9424-77cde8e337fc tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:35.463851 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3604bf47-1f99-4a34-9424-77cde8e337fc tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:35.464611 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3604bf47-1f99-4a34-9424-77cde8e337fc tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:35.465100 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3604bf47-1f99-4a34-9424-77cde8e337fc tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:35.541499 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-8f21d9b5-4bcc-48b0-862b-3227f6f2de54 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:35.543956 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-8f21d9b5-4bcc-48b0-862b-3227f6f2de54 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:35.554339 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8f21d9b5-4bcc-48b0-862b-3227f6f2de54 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:35.554809 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8f21d9b5-4bcc-48b0-862b-3227f6f2de54 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:35.555593 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8f21d9b5-4bcc-48b0-862b-3227f6f2de54 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:35.556027 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8f21d9b5-4bcc-48b0-862b-3227f6f2de54 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:35.601242 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-3604bf47-1f99-4a34-9424-77cde8e337fc tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:35.610607 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-3604bf47-1f99-4a34-9424-77cde8e337fc tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:35.612119 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-3604bf47-1f99-4a34-9424-77cde8e337fc tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:35.613292 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-3604bf47-1f99-4a34-9424-77cde8e337fc tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1749 microversion: 2.20 time: 0.162300 Jul 20 19:30:35.614299 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 383/757] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:35 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1749 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:30:35.704619 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8f21d9b5-4bcc-48b0-862b-3227f6f2de54 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:35.712722 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-8f21d9b5-4bcc-48b0-862b-3227f6f2de54 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1260 microversion: 2.1 time: 0.175019 Jul 20 19:30:35.713296 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 375/758] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:35 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1260 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:30:36.631648 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-8bd6703f-5e8d-4ed8-bbe7-3aee2bc1876f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:36.632183 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-8bd6703f-5e8d-4ed8-bbe7-3aee2bc1876f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:36.639095 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8bd6703f-5e8d-4ed8-bbe7-3aee2bc1876f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:36.639536 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8bd6703f-5e8d-4ed8-bbe7-3aee2bc1876f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:36.640301 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8bd6703f-5e8d-4ed8-bbe7-3aee2bc1876f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:36.641314 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8bd6703f-5e8d-4ed8-bbe7-3aee2bc1876f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:36.730251 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-0b903dfc-aaa3-4a5e-a958-6360dde519c9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:36.731124 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-0b903dfc-aaa3-4a5e-a958-6360dde519c9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:36.739415 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0b903dfc-aaa3-4a5e-a958-6360dde519c9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:36.739927 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0b903dfc-aaa3-4a5e-a958-6360dde519c9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:36.740712 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0b903dfc-aaa3-4a5e-a958-6360dde519c9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:36.741148 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0b903dfc-aaa3-4a5e-a958-6360dde519c9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:36.781817 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-8bd6703f-5e8d-4ed8-bbe7-3aee2bc1876f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:36.791192 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-8bd6703f-5e8d-4ed8-bbe7-3aee2bc1876f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:36.792731 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-8bd6703f-5e8d-4ed8-bbe7-3aee2bc1876f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:36.793943 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-8bd6703f-5e8d-4ed8-bbe7-3aee2bc1876f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1749 microversion: 2.20 time: 0.166267 Jul 20 19:30:36.794784 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 384/759] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:36 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1749 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:30:36.887989 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0b903dfc-aaa3-4a5e-a958-6360dde519c9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:36.896595 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-0b903dfc-aaa3-4a5e-a958-6360dde519c9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1260 microversion: 2.1 time: 0.170199 Jul 20 19:30:36.897170 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 376/760] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:36 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:30:37.812395 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-8558e605-4d66-4a48-a06b-6ecf561443c8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:37.813121 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-8558e605-4d66-4a48-a06b-6ecf561443c8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:37.820022 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8558e605-4d66-4a48-a06b-6ecf561443c8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:37.820479 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8558e605-4d66-4a48-a06b-6ecf561443c8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:37.821247 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8558e605-4d66-4a48-a06b-6ecf561443c8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:37.821713 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8558e605-4d66-4a48-a06b-6ecf561443c8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:37.913249 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-79d145d4-5d47-427b-95b7-59ce5c16fd9e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:37.913891 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-79d145d4-5d47-427b-95b7-59ce5c16fd9e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:37.916229 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_api:SELECT=52 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:37.922104 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-79d145d4-5d47-427b-95b7-59ce5c16fd9e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:37.923097 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-79d145d4-5d47-427b-95b7-59ce5c16fd9e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:37.923930 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-79d145d4-5d47-427b-95b7-59ce5c16fd9e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:37.924483 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-79d145d4-5d47-427b-95b7-59ce5c16fd9e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:37.965157 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-8558e605-4d66-4a48-a06b-6ecf561443c8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:37.974726 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-8558e605-4d66-4a48-a06b-6ecf561443c8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:37.976212 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-8558e605-4d66-4a48-a06b-6ecf561443c8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:37.977356 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-8558e605-4d66-4a48-a06b-6ecf561443c8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1749 microversion: 2.20 time: 0.168893 Jul 20 19:30:37.978305 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 385/761] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:37 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1749 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:30:38.076315 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-79d145d4-5d47-427b-95b7-59ce5c16fd9e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:38.084537 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-79d145d4-5d47-427b-95b7-59ce5c16fd9e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1260 microversion: 2.1 time: 0.175175 Jul 20 19:30:38.085262 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 377/762] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:37 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1260 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:30:38.995607 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-bf6fc74d-d030-4faf-9821-09f4cdd6e941 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:38.996209 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-bf6fc74d-d030-4faf-9821-09f4cdd6e941 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:39.003574 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-bf6fc74d-d030-4faf-9821-09f4cdd6e941 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:39.004024 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-bf6fc74d-d030-4faf-9821-09f4cdd6e941 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:39.004903 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-bf6fc74d-d030-4faf-9821-09f4cdd6e941 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:39.005339 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-bf6fc74d-d030-4faf-9821-09f4cdd6e941 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:39.102136 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ac74c95b-9fc6-48a4-8d9f-df59cd75a513 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:39.102744 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ac74c95b-9fc6-48a4-8d9f-df59cd75a513 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:39.109405 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ac74c95b-9fc6-48a4-8d9f-df59cd75a513 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:39.110514 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ac74c95b-9fc6-48a4-8d9f-df59cd75a513 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:39.111320 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ac74c95b-9fc6-48a4-8d9f-df59cd75a513 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:39.111791 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ac74c95b-9fc6-48a4-8d9f-df59cd75a513 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:39.139996 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-bf6fc74d-d030-4faf-9821-09f4cdd6e941 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:39.148969 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-bf6fc74d-d030-4faf-9821-09f4cdd6e941 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:39.150513 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-bf6fc74d-d030-4faf-9821-09f4cdd6e941 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:39.151681 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-bf6fc74d-d030-4faf-9821-09f4cdd6e941 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1749 microversion: 2.20 time: 0.160013 Jul 20 19:30:39.152241 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 386/763] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:38 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1749 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:30:39.243664 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ac74c95b-9fc6-48a4-8d9f-df59cd75a513 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:39.251580 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ac74c95b-9fc6-48a4-8d9f-df59cd75a513 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1260 microversion: 2.1 time: 0.152828 Jul 20 19:30:39.252143 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 378/764] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:39 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:30:40.174646 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-673340cd-75d0-43db-83c1-64b4f4e626de tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:40.175348 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-673340cd-75d0-43db-83c1-64b4f4e626de tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:40.182528 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-673340cd-75d0-43db-83c1-64b4f4e626de tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:40.182969 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-673340cd-75d0-43db-83c1-64b4f4e626de tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:40.183763 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-673340cd-75d0-43db-83c1-64b4f4e626de tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:40.184193 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-673340cd-75d0-43db-83c1-64b4f4e626de tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:40.269329 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-996f1da2-892d-4553-a90a-0df3d0c49d9c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:40.269990 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-996f1da2-892d-4553-a90a-0df3d0c49d9c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:40.277981 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-996f1da2-892d-4553-a90a-0df3d0c49d9c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:40.278592 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-996f1da2-892d-4553-a90a-0df3d0c49d9c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:40.279370 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-996f1da2-892d-4553-a90a-0df3d0c49d9c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:40.279801 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-996f1da2-892d-4553-a90a-0df3d0c49d9c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:40.330496 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-673340cd-75d0-43db-83c1-64b4f4e626de tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:40.340025 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-673340cd-75d0-43db-83c1-64b4f4e626de tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:40.341614 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-673340cd-75d0-43db-83c1-64b4f4e626de tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:40.342753 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-673340cd-75d0-43db-83c1-64b4f4e626de tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1749 microversion: 2.20 time: 0.174858 Jul 20 19:30:40.343314 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 387/765] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:40 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1749 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:30:40.432114 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-996f1da2-892d-4553-a90a-0df3d0c49d9c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:40.440055 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-996f1da2-892d-4553-a90a-0df3d0c49d9c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1260 microversion: 2.1 time: 0.175685 Jul 20 19:30:40.440615 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 379/766] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:40 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1260 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:30:41.362335 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-19d784ba-c679-4a29-b32b-c565ff4a7384 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:41.362926 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-19d784ba-c679-4a29-b32b-c565ff4a7384 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:41.369439 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-19d784ba-c679-4a29-b32b-c565ff4a7384 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:41.369906 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-19d784ba-c679-4a29-b32b-c565ff4a7384 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:41.370650 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-19d784ba-c679-4a29-b32b-c565ff4a7384 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:41.371075 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-19d784ba-c679-4a29-b32b-c565ff4a7384 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:41.456264 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4d9edb96-48f0-4e93-8b8a-904cbfbca01e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:41.456865 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-4d9edb96-48f0-4e93-8b8a-904cbfbca01e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:41.463448 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4d9edb96-48f0-4e93-8b8a-904cbfbca01e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:41.463897 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4d9edb96-48f0-4e93-8b8a-904cbfbca01e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:41.464666 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4d9edb96-48f0-4e93-8b8a-904cbfbca01e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:41.465099 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4d9edb96-48f0-4e93-8b8a-904cbfbca01e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:41.502341 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-19d784ba-c679-4a29-b32b-c565ff4a7384 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:41.511040 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-19d784ba-c679-4a29-b32b-c565ff4a7384 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:41.512600 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-19d784ba-c679-4a29-b32b-c565ff4a7384 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:41.513950 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-19d784ba-c679-4a29-b32b-c565ff4a7384 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1749 microversion: 2.20 time: 0.156209 Jul 20 19:30:41.514519 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 388/767] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:41 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1749 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:30:41.605648 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-4d9edb96-48f0-4e93-8b8a-904cbfbca01e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:41.613812 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-4d9edb96-48f0-4e93-8b8a-904cbfbca01e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1260 microversion: 2.1 time: 0.161383 Jul 20 19:30:41.614386 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 380/768] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:41 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:30:42.537590 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-1c0cfceb-792a-45d3-92d7-5e6dc4a40df4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:42.538176 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-1c0cfceb-792a-45d3-92d7-5e6dc4a40df4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:42.544628 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1c0cfceb-792a-45d3-92d7-5e6dc4a40df4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:42.545075 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1c0cfceb-792a-45d3-92d7-5e6dc4a40df4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:42.545855 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1c0cfceb-792a-45d3-92d7-5e6dc4a40df4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:42.546285 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1c0cfceb-792a-45d3-92d7-5e6dc4a40df4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:42.630202 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-fc4b4d1f-f6c5-418a-b7b5-3a8386d218cc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:42.630816 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-fc4b4d1f-f6c5-418a-b7b5-3a8386d218cc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:42.637396 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fc4b4d1f-f6c5-418a-b7b5-3a8386d218cc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:42.637892 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fc4b4d1f-f6c5-418a-b7b5-3a8386d218cc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:42.638695 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fc4b4d1f-f6c5-418a-b7b5-3a8386d218cc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:42.639127 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fc4b4d1f-f6c5-418a-b7b5-3a8386d218cc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:42.684186 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-1c0cfceb-792a-45d3-92d7-5e6dc4a40df4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:42.693568 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-1c0cfceb-792a-45d3-92d7-5e6dc4a40df4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:42.695099 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-1c0cfceb-792a-45d3-92d7-5e6dc4a40df4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:42.696264 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-1c0cfceb-792a-45d3-92d7-5e6dc4a40df4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1749 microversion: 2.20 time: 0.162677 Jul 20 19:30:42.696834 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 389/769] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:42 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1749 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:30:42.782351 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-fc4b4d1f-f6c5-418a-b7b5-3a8386d218cc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:42.790964 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-fc4b4d1f-f6c5-418a-b7b5-3a8386d218cc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1260 microversion: 2.1 time: 0.164183 Jul 20 19:30:42.790964 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 381/770] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:42 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:30:43.716545 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-5733da85-c308-4d1f-90c0-6fa1be4bcc4f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:43.717217 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-5733da85-c308-4d1f-90c0-6fa1be4bcc4f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:43.724249 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-5733da85-c308-4d1f-90c0-6fa1be4bcc4f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:43.724811 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-5733da85-c308-4d1f-90c0-6fa1be4bcc4f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:43.725699 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-5733da85-c308-4d1f-90c0-6fa1be4bcc4f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:43.726127 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-5733da85-c308-4d1f-90c0-6fa1be4bcc4f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:43.808092 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-af0eaf69-ee3c-4a3d-b302-8a00c436c5bf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:43.808697 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-af0eaf69-ee3c-4a3d-b302-8a00c436c5bf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:43.815296 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-af0eaf69-ee3c-4a3d-b302-8a00c436c5bf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:43.815771 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-af0eaf69-ee3c-4a3d-b302-8a00c436c5bf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:43.816542 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-af0eaf69-ee3c-4a3d-b302-8a00c436c5bf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:43.816974 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-af0eaf69-ee3c-4a3d-b302-8a00c436c5bf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:43.858048 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-5733da85-c308-4d1f-90c0-6fa1be4bcc4f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:43.867091 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-5733da85-c308-4d1f-90c0-6fa1be4bcc4f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:43.868623 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-5733da85-c308-4d1f-90c0-6fa1be4bcc4f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:43.869811 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-5733da85-c308-4d1f-90c0-6fa1be4bcc4f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1749 microversion: 2.20 time: 0.157128 Jul 20 19:30:43.870530 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 390/771] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:43 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1749 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:30:43.949402 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-af0eaf69-ee3c-4a3d-b302-8a00c436c5bf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:43.957369 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-af0eaf69-ee3c-4a3d-b302-8a00c436c5bf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1260 microversion: 2.1 time: 0.153361 Jul 20 19:30:43.957972 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 382/772] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:43 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:30:44.888183 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-586d82b9-02a6-455a-8a2d-3e5b9c13b50c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:44.888759 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-586d82b9-02a6-455a-8a2d-3e5b9c13b50c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:44.895459 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-586d82b9-02a6-455a-8a2d-3e5b9c13b50c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:44.895904 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-586d82b9-02a6-455a-8a2d-3e5b9c13b50c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:44.896653 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-586d82b9-02a6-455a-8a2d-3e5b9c13b50c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:44.897078 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-586d82b9-02a6-455a-8a2d-3e5b9c13b50c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:44.975169 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-2c5ee8f8-5695-4f07-b271-fa93fb47cbec tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:44.975791 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-2c5ee8f8-5695-4f07-b271-fa93fb47cbec tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:44.982387 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2c5ee8f8-5695-4f07-b271-fa93fb47cbec tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:44.982838 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2c5ee8f8-5695-4f07-b271-fa93fb47cbec tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:44.983655 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2c5ee8f8-5695-4f07-b271-fa93fb47cbec tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:44.984209 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2c5ee8f8-5695-4f07-b271-fa93fb47cbec tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:45.028822 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-586d82b9-02a6-455a-8a2d-3e5b9c13b50c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:45.038331 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-586d82b9-02a6-455a-8a2d-3e5b9c13b50c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:45.039860 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-586d82b9-02a6-455a-8a2d-3e5b9c13b50c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:45.041018 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-586d82b9-02a6-455a-8a2d-3e5b9c13b50c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1749 microversion: 2.20 time: 0.156760 Jul 20 19:30:45.041576 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 391/773] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:44 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1749 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:30:45.118464 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-2c5ee8f8-5695-4f07-b271-fa93fb47cbec tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:45.126723 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-2c5ee8f8-5695-4f07-b271-fa93fb47cbec tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1260 microversion: 2.1 time: 0.155155 Jul 20 19:30:45.127300 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 383/774] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:44 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:30:46.060050 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-26f301b2-5c69-4998-971a-4aca46a5cb2f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:46.060640 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-26f301b2-5c69-4998-971a-4aca46a5cb2f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:46.067983 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-26f301b2-5c69-4998-971a-4aca46a5cb2f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:46.068421 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-26f301b2-5c69-4998-971a-4aca46a5cb2f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:46.069164 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-26f301b2-5c69-4998-971a-4aca46a5cb2f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:46.069615 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-26f301b2-5c69-4998-971a-4aca46a5cb2f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:46.143423 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d3074a0f-f66a-4591-9f5b-623095e94941 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:46.144042 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d3074a0f-f66a-4591-9f5b-623095e94941 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:46.151031 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d3074a0f-f66a-4591-9f5b-623095e94941 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:46.151579 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d3074a0f-f66a-4591-9f5b-623095e94941 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:46.152348 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d3074a0f-f66a-4591-9f5b-623095e94941 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:46.152804 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d3074a0f-f66a-4591-9f5b-623095e94941 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:46.199688 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-26f301b2-5c69-4998-971a-4aca46a5cb2f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:46.208419 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-26f301b2-5c69-4998-971a-4aca46a5cb2f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:46.209955 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-26f301b2-5c69-4998-971a-4aca46a5cb2f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:46.211095 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-26f301b2-5c69-4998-971a-4aca46a5cb2f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1749 microversion: 2.20 time: 0.154906 Jul 20 19:30:46.211925 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 392/775] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:46 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1749 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:30:46.284842 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d3074a0f-f66a-4591-9f5b-623095e94941 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:46.292481 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d3074a0f-f66a-4591-9f5b-623095e94941 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1260 microversion: 2.1 time: 0.152894 Jul 20 19:30:46.293048 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 384/776] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:46 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:30:47.230379 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-501c5d90-79df-4730-bdfb-373a43fb8c06 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:47.230929 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-501c5d90-79df-4730-bdfb-373a43fb8c06 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:47.237675 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-501c5d90-79df-4730-bdfb-373a43fb8c06 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:47.238125 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-501c5d90-79df-4730-bdfb-373a43fb8c06 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:47.238887 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-501c5d90-79df-4730-bdfb-373a43fb8c06 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:47.239321 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-501c5d90-79df-4730-bdfb-373a43fb8c06 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:47.309909 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d91e5ca7-9622-40d1-9016-ce32514d2648 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:47.311432 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d91e5ca7-9622-40d1-9016-ce32514d2648 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:47.327473 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d91e5ca7-9622-40d1-9016-ce32514d2648 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:47.327921 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d91e5ca7-9622-40d1-9016-ce32514d2648 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:47.329479 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d91e5ca7-9622-40d1-9016-ce32514d2648 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:47.329943 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d91e5ca7-9622-40d1-9016-ce32514d2648 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:47.386100 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-501c5d90-79df-4730-bdfb-373a43fb8c06 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:47.395332 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-501c5d90-79df-4730-bdfb-373a43fb8c06 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:47.396836 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-501c5d90-79df-4730-bdfb-373a43fb8c06 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:47.398028 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-501c5d90-79df-4730-bdfb-373a43fb8c06 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1749 microversion: 2.20 time: 0.171679 Jul 20 19:30:47.398583 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 393/777] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:47 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1749 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:30:47.460505 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d91e5ca7-9622-40d1-9016-ce32514d2648 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:47.468105 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d91e5ca7-9622-40d1-9016-ce32514d2648 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1260 microversion: 2.1 time: 0.162061 Jul 20 19:30:47.468673 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 385/778] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:47 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:30:48.415986 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-7f1e7b1e-a8b5-40c6-8d89-c9f2bf580e84 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:48.416587 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-7f1e7b1e-a8b5-40c6-8d89-c9f2bf580e84 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:48.418923 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_api:SELECT=52 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:48.424228 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-7f1e7b1e-a8b5-40c6-8d89-c9f2bf580e84 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:48.424677 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-7f1e7b1e-a8b5-40c6-8d89-c9f2bf580e84 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:48.425473 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-7f1e7b1e-a8b5-40c6-8d89-c9f2bf580e84 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:48.425944 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-7f1e7b1e-a8b5-40c6-8d89-c9f2bf580e84 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:48.485066 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-bb87885f-0f4f-4f64-9725-b8bc84d8cfd3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:48.485723 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-bb87885f-0f4f-4f64-9725-b8bc84d8cfd3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:48.492307 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bb87885f-0f4f-4f64-9725-b8bc84d8cfd3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:48.492751 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bb87885f-0f4f-4f64-9725-b8bc84d8cfd3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:48.493535 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bb87885f-0f4f-4f64-9725-b8bc84d8cfd3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:48.493969 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bb87885f-0f4f-4f64-9725-b8bc84d8cfd3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:48.557770 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-7f1e7b1e-a8b5-40c6-8d89-c9f2bf580e84 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:48.566910 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-7f1e7b1e-a8b5-40c6-8d89-c9f2bf580e84 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:48.568425 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-7f1e7b1e-a8b5-40c6-8d89-c9f2bf580e84 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:48.569633 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-7f1e7b1e-a8b5-40c6-8d89-c9f2bf580e84 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1749 microversion: 2.20 time: 0.157548 Jul 20 19:30:48.570201 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 394/779] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:48 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1749 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:30:48.873581 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-bb87885f-0f4f-4f64-9725-b8bc84d8cfd3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:48.881047 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-bb87885f-0f4f-4f64-9725-b8bc84d8cfd3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1260 microversion: 2.1 time: 0.400032 Jul 20 19:30:48.881639 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 386/780] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:48 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1260 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:30:49.589210 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-703e092b-9019-4da4-aeab-80c0a95ffd8a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:49.589851 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-703e092b-9019-4da4-aeab-80c0a95ffd8a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:49.597527 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-703e092b-9019-4da4-aeab-80c0a95ffd8a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:49.597987 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-703e092b-9019-4da4-aeab-80c0a95ffd8a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:49.598751 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-703e092b-9019-4da4-aeab-80c0a95ffd8a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:49.599281 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-703e092b-9019-4da4-aeab-80c0a95ffd8a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:49.728974 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-703e092b-9019-4da4-aeab-80c0a95ffd8a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:49.738163 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-703e092b-9019-4da4-aeab-80c0a95ffd8a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:49.739683 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-703e092b-9019-4da4-aeab-80c0a95ffd8a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:49.740832 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-703e092b-9019-4da4-aeab-80c0a95ffd8a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1749 microversion: 2.20 time: 0.156174 Jul 20 19:30:49.741393 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 395/781] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:49 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1749 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:30:49.898137 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-0165d1b8-39ae-4b27-9cd3-cd0be62b9e94 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:49.898759 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-0165d1b8-39ae-4b27-9cd3-cd0be62b9e94 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:49.905393 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0165d1b8-39ae-4b27-9cd3-cd0be62b9e94 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:49.905881 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0165d1b8-39ae-4b27-9cd3-cd0be62b9e94 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:49.906770 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0165d1b8-39ae-4b27-9cd3-cd0be62b9e94 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:49.907207 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0165d1b8-39ae-4b27-9cd3-cd0be62b9e94 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:50.045697 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0165d1b8-39ae-4b27-9cd3-cd0be62b9e94 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:50.054021 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-0165d1b8-39ae-4b27-9cd3-cd0be62b9e94 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1260 microversion: 2.1 time: 0.159668 Jul 20 19:30:50.054594 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 387/782] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:49 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:50.759213 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-332f6905-97a8-49b6-bfcc-384fbbe81c38 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:50.759812 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-332f6905-97a8-49b6-bfcc-384fbbe81c38 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:50.766489 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-332f6905-97a8-49b6-bfcc-384fbbe81c38 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:50.766928 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-332f6905-97a8-49b6-bfcc-384fbbe81c38 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:50.767688 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-332f6905-97a8-49b6-bfcc-384fbbe81c38 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:50.768116 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-332f6905-97a8-49b6-bfcc-384fbbe81c38 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:50.919973 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-332f6905-97a8-49b6-bfcc-384fbbe81c38 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:50.932053 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-332f6905-97a8-49b6-bfcc-384fbbe81c38 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:50.933599 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-332f6905-97a8-49b6-bfcc-384fbbe81c38 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:50.934793 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-332f6905-97a8-49b6-bfcc-384fbbe81c38 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1749 microversion: 2.20 time: 0.179520 Jul 20 19:30:50.935344 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 396/783] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:50 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1749 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:30:51.128526 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-da03bac0-d708-4c5e-9718-4e5ce4ed38e7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:51.129182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-da03bac0-d708-4c5e-9718-4e5ce4ed38e7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:51.135769 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-da03bac0-d708-4c5e-9718-4e5ce4ed38e7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:51.136213 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-da03bac0-d708-4c5e-9718-4e5ce4ed38e7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:51.136974 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-da03bac0-d708-4c5e-9718-4e5ce4ed38e7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:51.137406 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-da03bac0-d708-4c5e-9718-4e5ce4ed38e7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:51.292616 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-da03bac0-d708-4c5e-9718-4e5ce4ed38e7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:51.300332 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-da03bac0-d708-4c5e-9718-4e5ce4ed38e7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1260 microversion: 2.1 time: 0.175901 Jul 20 19:30:51.300903 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 388/784] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:51 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1260 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:51.954205 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-15158f5a-4001-48b4-a9b0-a69ac9476a75 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:51.954844 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-15158f5a-4001-48b4-a9b0-a69ac9476a75 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:51.961292 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-15158f5a-4001-48b4-a9b0-a69ac9476a75 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:51.962030 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-15158f5a-4001-48b4-a9b0-a69ac9476a75 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:51.962786 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-15158f5a-4001-48b4-a9b0-a69ac9476a75 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:51.963216 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-15158f5a-4001-48b4-a9b0-a69ac9476a75 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:52.092476 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-15158f5a-4001-48b4-a9b0-a69ac9476a75 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:52.101389 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-15158f5a-4001-48b4-a9b0-a69ac9476a75 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:52.102942 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-15158f5a-4001-48b4-a9b0-a69ac9476a75 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:52.104094 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-15158f5a-4001-48b4-a9b0-a69ac9476a75 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1749 microversion: 2.20 time: 0.154519 Jul 20 19:30:52.104649 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 397/785] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:51 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1749 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:30:52.317996 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-7e506010-99f4-4325-94ba-8e3cf5470f82 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:52.317996 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-7e506010-99f4-4325-94ba-8e3cf5470f82 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:52.325319 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7e506010-99f4-4325-94ba-8e3cf5470f82 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:52.325799 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7e506010-99f4-4325-94ba-8e3cf5470f82 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:52.326867 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7e506010-99f4-4325-94ba-8e3cf5470f82 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:52.327492 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7e506010-99f4-4325-94ba-8e3cf5470f82 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:52.460334 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-7e506010-99f4-4325-94ba-8e3cf5470f82 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:52.462821 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:52.469822 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-7e506010-99f4-4325-94ba-8e3cf5470f82 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1260 microversion: 2.1 time: 0.157267 Jul 20 19:30:52.470393 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 389/786] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:52 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:53.124272 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-a81cb7fe-d036-4a2b-8e4d-851831094831 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:53.125044 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-a81cb7fe-d036-4a2b-8e4d-851831094831 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:53.131800 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a81cb7fe-d036-4a2b-8e4d-851831094831 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:53.132516 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a81cb7fe-d036-4a2b-8e4d-851831094831 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:53.133017 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a81cb7fe-d036-4a2b-8e4d-851831094831 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:53.133446 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a81cb7fe-d036-4a2b-8e4d-851831094831 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:53.151873 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_cell1:SELECT=100 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:53.264236 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-a81cb7fe-d036-4a2b-8e4d-851831094831 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:53.272940 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-a81cb7fe-d036-4a2b-8e4d-851831094831 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:53.274504 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-a81cb7fe-d036-4a2b-8e4d-851831094831 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:53.275668 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-a81cb7fe-d036-4a2b-8e4d-851831094831 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1749 microversion: 2.20 time: 0.155646 Jul 20 19:30:53.276224 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 398/787] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:53 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1749 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:30:53.487536 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-83c2a380-25c3-4c8a-8ec6-11a68ecb5f1d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:53.488118 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-83c2a380-25c3-4c8a-8ec6-11a68ecb5f1d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:53.495432 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-83c2a380-25c3-4c8a-8ec6-11a68ecb5f1d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:53.495814 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-83c2a380-25c3-4c8a-8ec6-11a68ecb5f1d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:53.496567 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-83c2a380-25c3-4c8a-8ec6-11a68ecb5f1d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:53.496994 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-83c2a380-25c3-4c8a-8ec6-11a68ecb5f1d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:53.633132 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-83c2a380-25c3-4c8a-8ec6-11a68ecb5f1d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:53.640975 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-83c2a380-25c3-4c8a-8ec6-11a68ecb5f1d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1260 microversion: 2.1 time: 0.157745 Jul 20 19:30:53.641793 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 390/788] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:53 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:30:54.294965 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-e6b290d2-759a-407d-8b7f-3b31793b1b8f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:54.295500 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-e6b290d2-759a-407d-8b7f-3b31793b1b8f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:54.302120 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e6b290d2-759a-407d-8b7f-3b31793b1b8f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:54.302564 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e6b290d2-759a-407d-8b7f-3b31793b1b8f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:54.303362 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e6b290d2-759a-407d-8b7f-3b31793b1b8f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:54.303797 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e6b290d2-759a-407d-8b7f-3b31793b1b8f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:54.432691 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-e6b290d2-759a-407d-8b7f-3b31793b1b8f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:54.441191 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-e6b290d2-759a-407d-8b7f-3b31793b1b8f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:54.442737 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-e6b290d2-759a-407d-8b7f-3b31793b1b8f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:54.443878 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-e6b290d2-759a-407d-8b7f-3b31793b1b8f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1749 microversion: 2.20 time: 0.152844 Jul 20 19:30:54.444432 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 399/789] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:54 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1749 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:30:54.658025 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-b234bfee-e4e6-4171-b4e5-927ea9358e20 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:54.658617 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-b234bfee-e4e6-4171-b4e5-927ea9358e20 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:54.665344 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b234bfee-e4e6-4171-b4e5-927ea9358e20 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:54.665820 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b234bfee-e4e6-4171-b4e5-927ea9358e20 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:54.666575 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b234bfee-e4e6-4171-b4e5-927ea9358e20 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:54.667003 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b234bfee-e4e6-4171-b4e5-927ea9358e20 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:54.799913 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-b234bfee-e4e6-4171-b4e5-927ea9358e20 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:54.807626 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-b234bfee-e4e6-4171-b4e5-927ea9358e20 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1260 microversion: 2.1 time: 0.153609 Jul 20 19:30:54.808193 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 391/790] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:54 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:55.462680 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-52fd0514-9a8d-4800-8f0d-05f916d56b8c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:55.463415 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-52fd0514-9a8d-4800-8f0d-05f916d56b8c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:55.472052 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-52fd0514-9a8d-4800-8f0d-05f916d56b8c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:55.472490 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-52fd0514-9a8d-4800-8f0d-05f916d56b8c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:55.473336 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-52fd0514-9a8d-4800-8f0d-05f916d56b8c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:55.473730 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-52fd0514-9a8d-4800-8f0d-05f916d56b8c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:55.610917 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-52fd0514-9a8d-4800-8f0d-05f916d56b8c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:55.619597 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-52fd0514-9a8d-4800-8f0d-05f916d56b8c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:55.621108 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-52fd0514-9a8d-4800-8f0d-05f916d56b8c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:55.622296 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-52fd0514-9a8d-4800-8f0d-05f916d56b8c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.163801 Jul 20 19:30:55.622859 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 400/791] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:55 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:30:55.826031 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-5d3f94f9-41b1-4663-9f23-3b628e993f54 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:55.826420 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-5d3f94f9-41b1-4663-9f23-3b628e993f54 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:55.833121 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5d3f94f9-41b1-4663-9f23-3b628e993f54 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:55.833590 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5d3f94f9-41b1-4663-9f23-3b628e993f54 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:55.834374 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5d3f94f9-41b1-4663-9f23-3b628e993f54 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:55.834810 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5d3f94f9-41b1-4663-9f23-3b628e993f54 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:56.037788 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-5d3f94f9-41b1-4663-9f23-3b628e993f54 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:56.046008 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-5d3f94f9-41b1-4663-9f23-3b628e993f54 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1260 microversion: 2.1 time: 0.224904 Jul 20 19:30:56.046655 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 392/792] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:55 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1260 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:56.640120 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-f3a6e8ba-5a0b-4f92-8bad-c423bb314fae tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:56.640726 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-f3a6e8ba-5a0b-4f92-8bad-c423bb314fae tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:56.647225 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f3a6e8ba-5a0b-4f92-8bad-c423bb314fae tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:56.647668 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f3a6e8ba-5a0b-4f92-8bad-c423bb314fae tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:56.648424 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f3a6e8ba-5a0b-4f92-8bad-c423bb314fae tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:56.648857 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f3a6e8ba-5a0b-4f92-8bad-c423bb314fae tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:56.788066 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-f3a6e8ba-5a0b-4f92-8bad-c423bb314fae tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:56.797310 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-f3a6e8ba-5a0b-4f92-8bad-c423bb314fae tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:56.798863 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-f3a6e8ba-5a0b-4f92-8bad-c423bb314fae tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:56.800026 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-f3a6e8ba-5a0b-4f92-8bad-c423bb314fae tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.163831 Jul 20 19:30:56.800584 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 401/793] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:56 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:30:57.062185 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a65b0bb3-ab45-4029-9f71-49336658ef1f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:57.062803 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a65b0bb3-ab45-4029-9f71-49336658ef1f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:57.069529 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a65b0bb3-ab45-4029-9f71-49336658ef1f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:57.069996 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a65b0bb3-ab45-4029-9f71-49336658ef1f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:57.070776 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a65b0bb3-ab45-4029-9f71-49336658ef1f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:57.071210 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a65b0bb3-ab45-4029-9f71-49336658ef1f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:57.205635 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a65b0bb3-ab45-4029-9f71-49336658ef1f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:57.213290 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a65b0bb3-ab45-4029-9f71-49336658ef1f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1260 microversion: 2.1 time: 0.155085 Jul 20 19:30:57.213890 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 393/794] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:57 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:57.819123 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-05520479-680c-4390-b7ac-444a0eb6fd96 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:57.819813 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-05520479-680c-4390-b7ac-444a0eb6fd96 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:57.826392 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-05520479-680c-4390-b7ac-444a0eb6fd96 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:57.826836 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-05520479-680c-4390-b7ac-444a0eb6fd96 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:57.827627 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-05520479-680c-4390-b7ac-444a0eb6fd96 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:57.828784 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-05520479-680c-4390-b7ac-444a0eb6fd96 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:57.958130 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-05520479-680c-4390-b7ac-444a0eb6fd96 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:57.967313 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-05520479-680c-4390-b7ac-444a0eb6fd96 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:57.968878 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-05520479-680c-4390-b7ac-444a0eb6fd96 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:57.970059 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-05520479-680c-4390-b7ac-444a0eb6fd96 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.154918 Jul 20 19:30:57.970621 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 402/795] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:57 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:30:58.229889 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-95ded07d-0779-4928-b23f-f76766c55241 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:58.230531 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-95ded07d-0779-4928-b23f-f76766c55241 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:58.237759 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-95ded07d-0779-4928-b23f-f76766c55241 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:58.238208 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-95ded07d-0779-4928-b23f-f76766c55241 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:58.238975 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-95ded07d-0779-4928-b23f-f76766c55241 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:58.239409 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-95ded07d-0779-4928-b23f-f76766c55241 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:58.522052 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-95ded07d-0779-4928-b23f-f76766c55241 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:58.529654 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-95ded07d-0779-4928-b23f-f76766c55241 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1260 microversion: 2.1 time: 0.303603 Jul 20 19:30:58.530213 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 394/796] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:58 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1260 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:58.988591 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-cbb5a6b6-6aaf-4882-913c-d76241a6dd6f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:58.989287 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-cbb5a6b6-6aaf-4882-913c-d76241a6dd6f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:58.996454 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-cbb5a6b6-6aaf-4882-913c-d76241a6dd6f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:58.996957 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-cbb5a6b6-6aaf-4882-913c-d76241a6dd6f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:58.997805 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-cbb5a6b6-6aaf-4882-913c-d76241a6dd6f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:58.998460 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-cbb5a6b6-6aaf-4882-913c-d76241a6dd6f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:59.094152 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [req-9341f676-1bd7-4bc1-b2ab-829ce17aebf6 req-edb2d340-7408-4ee6-acf2-ec8b26494c34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "239cb0b6-54d7-4cc2-945a-1f026a015992", "name": "network-vif-plugged", "status": "completed", "tag": "761fbace-90da-4e61-bc51-77b19745762a"}]} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:30:59.104244 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-9341f676-1bd7-4bc1-b2ab-829ce17aebf6 req-edb2d340-7408-4ee6-acf2-ec8b26494c34 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:59.104766 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-9341f676-1bd7-4bc1-b2ab-829ce17aebf6 req-edb2d340-7408-4ee6-acf2-ec8b26494c34 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:59.117409 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.compute.server_external_events [req-9341f676-1bd7-4bc1-b2ab-829ce17aebf6 req-edb2d340-7408-4ee6-acf2-ec8b26494c34 service nova] Creating event network-vif-plugged:761fbace-90da-4e61-bc51-77b19745762a for instance 239cb0b6-54d7-4cc2-945a-1f026a015992 on hv-cinder-83538 Jul 20 19:30:59.123251 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [req-9341f676-1bd7-4bc1-b2ab-829ce17aebf6 req-edb2d340-7408-4ee6-acf2-ec8b26494c34 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033587 Jul 20 19:30:59.124846 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 395/797] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 19:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:30:59.149595 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-cbb5a6b6-6aaf-4882-913c-d76241a6dd6f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:59.170187 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-cbb5a6b6-6aaf-4882-913c-d76241a6dd6f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:59.171775 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-cbb5a6b6-6aaf-4882-913c-d76241a6dd6f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:59.172922 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-cbb5a6b6-6aaf-4882-913c-d76241a6dd6f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.188421 Jul 20 19:30:59.173476 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 403/798] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:58 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:30:59.548900 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c5bbb30c-95bf-4902-8e3d-6e2e2af05e8e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:59.549628 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c5bbb30c-95bf-4902-8e3d-6e2e2af05e8e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:59.555756 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c5bbb30c-95bf-4902-8e3d-6e2e2af05e8e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:59.556203 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c5bbb30c-95bf-4902-8e3d-6e2e2af05e8e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:59.556971 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c5bbb30c-95bf-4902-8e3d-6e2e2af05e8e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:59.557402 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c5bbb30c-95bf-4902-8e3d-6e2e2af05e8e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:59.690078 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c5bbb30c-95bf-4902-8e3d-6e2e2af05e8e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:59.697529 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c5bbb30c-95bf-4902-8e3d-6e2e2af05e8e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1260 microversion: 2.1 time: 0.154050 Jul 20 19:30:59.698122 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 396/799] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:59 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:00.192099 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-6ba6ff0f-41d6-405c-95d6-e46f755ca208 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:00.192698 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-6ba6ff0f-41d6-405c-95d6-e46f755ca208 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:00.199303 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-6ba6ff0f-41d6-405c-95d6-e46f755ca208 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:00.199741 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-6ba6ff0f-41d6-405c-95d6-e46f755ca208 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:00.200488 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-6ba6ff0f-41d6-405c-95d6-e46f755ca208 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:00.200911 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-6ba6ff0f-41d6-405c-95d6-e46f755ca208 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:00.331069 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-6ba6ff0f-41d6-405c-95d6-e46f755ca208 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:00.339762 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-6ba6ff0f-41d6-405c-95d6-e46f755ca208 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:00.341291 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-6ba6ff0f-41d6-405c-95d6-e46f755ca208 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:00.342446 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-6ba6ff0f-41d6-405c-95d6-e46f755ca208 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.154253 Jul 20 19:31:00.342977 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 404/800] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:00 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:31:00.715159 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-68a7fd49-0092-4909-bc0a-4a11139f949f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:00.715765 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-68a7fd49-0092-4909-bc0a-4a11139f949f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:00.722339 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-68a7fd49-0092-4909-bc0a-4a11139f949f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:00.722786 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-68a7fd49-0092-4909-bc0a-4a11139f949f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:00.723554 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-68a7fd49-0092-4909-bc0a-4a11139f949f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:00.724011 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-68a7fd49-0092-4909-bc0a-4a11139f949f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:00.856073 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-68a7fd49-0092-4909-bc0a-4a11139f949f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:00.863672 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-68a7fd49-0092-4909-bc0a-4a11139f949f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1260 microversion: 2.1 time: 0.152607 Jul 20 19:31:00.864222 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 397/801] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:00 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:01.361290 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-cf7cb5e6-78ae-477e-b062-57a880259232 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:01.361922 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-cf7cb5e6-78ae-477e-b062-57a880259232 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:01.368377 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-cf7cb5e6-78ae-477e-b062-57a880259232 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:01.368821 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-cf7cb5e6-78ae-477e-b062-57a880259232 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:01.369600 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-cf7cb5e6-78ae-477e-b062-57a880259232 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:01.370033 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-cf7cb5e6-78ae-477e-b062-57a880259232 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:01.500337 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-cf7cb5e6-78ae-477e-b062-57a880259232 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:01.508785 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-cf7cb5e6-78ae-477e-b062-57a880259232 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:01.510330 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-cf7cb5e6-78ae-477e-b062-57a880259232 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:01.511469 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-cf7cb5e6-78ae-477e-b062-57a880259232 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.154901 Jul 20 19:31:01.512025 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 405/802] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:01 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:31:01.880030 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d0ad586d-a2b3-44b6-8842-eb60bf2e0d76 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:01.880675 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d0ad586d-a2b3-44b6-8842-eb60bf2e0d76 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:01.887437 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d0ad586d-a2b3-44b6-8842-eb60bf2e0d76 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:01.887880 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d0ad586d-a2b3-44b6-8842-eb60bf2e0d76 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:01.888673 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d0ad586d-a2b3-44b6-8842-eb60bf2e0d76 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:01.889155 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d0ad586d-a2b3-44b6-8842-eb60bf2e0d76 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:02.020094 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d0ad586d-a2b3-44b6-8842-eb60bf2e0d76 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:02.027537 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d0ad586d-a2b3-44b6-8842-eb60bf2e0d76 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1443 microversion: 2.1 time: 0.151423 Jul 20 19:31:02.028098 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 398/803] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:01 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1443 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:02.044052 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-f6964ecb-3c50-4ccc-b9a5-47d668399af3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:02.044672 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-f6964ecb-3c50-4ccc-b9a5-47d668399af3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:02.051078 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f6964ecb-3c50-4ccc-b9a5-47d668399af3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:02.051521 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f6964ecb-3c50-4ccc-b9a5-47d668399af3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:02.052266 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f6964ecb-3c50-4ccc-b9a5-47d668399af3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:02.052692 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f6964ecb-3c50-4ccc-b9a5-47d668399af3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:02.187216 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-f6964ecb-3c50-4ccc-b9a5-47d668399af3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:02.194921 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-f6964ecb-3c50-4ccc-b9a5-47d668399af3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1443 microversion: 2.1 time: 0.154735 Jul 20 19:31:02.195484 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 406/804] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:02 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1443 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:02.530142 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-39ffd384-1938-4627-b2c2-dd1387cea9c8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:02.531263 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-39ffd384-1938-4627-b2c2-dd1387cea9c8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:02.537859 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-39ffd384-1938-4627-b2c2-dd1387cea9c8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:02.538349 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-39ffd384-1938-4627-b2c2-dd1387cea9c8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:02.539131 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-39ffd384-1938-4627-b2c2-dd1387cea9c8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:02.539563 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-39ffd384-1938-4627-b2c2-dd1387cea9c8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:02.681655 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-39ffd384-1938-4627-b2c2-dd1387cea9c8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:02.691401 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-39ffd384-1938-4627-b2c2-dd1387cea9c8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:02.692939 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-39ffd384-1938-4627-b2c2-dd1387cea9c8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:02.694145 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-39ffd384-1938-4627-b2c2-dd1387cea9c8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.168261 Jul 20 19:31:02.694704 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 399/805] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:02 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:31:03.712858 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-51fd3bf4-04b2-4605-81bb-a24cbe45e05a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:03.713572 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-51fd3bf4-04b2-4605-81bb-a24cbe45e05a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:03.720433 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-51fd3bf4-04b2-4605-81bb-a24cbe45e05a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:03.720959 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-51fd3bf4-04b2-4605-81bb-a24cbe45e05a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:03.721767 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-51fd3bf4-04b2-4605-81bb-a24cbe45e05a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:03.722227 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-51fd3bf4-04b2-4605-81bb-a24cbe45e05a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:03.823921 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d47a0a27-2165-41a1-9ac8-e9ab2a9ad90e tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3f863e38-7194-48e4-b7c8-6f8d7038ecdd"}} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:31:03.825037 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d47a0a27-2165-41a1-9ac8-e9ab2a9ad90e tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 2b8da868-71d1-49ad-be95-25d0a41393e9] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:03.831191 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d47a0a27-2165-41a1-9ac8-e9ab2a9ad90e tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:03.831648 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d47a0a27-2165-41a1-9ac8-e9ab2a9ad90e tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:03.832423 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d47a0a27-2165-41a1-9ac8-e9ab2a9ad90e tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:03.832862 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d47a0a27-2165-41a1-9ac8-e9ab2a9ad90e tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:03.958802 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-51fd3bf4-04b2-4605-81bb-a24cbe45e05a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:03.967741 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-51fd3bf4-04b2-4605-81bb-a24cbe45e05a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:03.969951 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-51fd3bf4-04b2-4605-81bb-a24cbe45e05a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:03.971119 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-51fd3bf4-04b2-4605-81bb-a24cbe45e05a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.262560 Jul 20 19:31:03.971868 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 407/806] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:03 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:31:04.113724 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d47a0a27-2165-41a1-9ac8-e9ab2a9ad90e tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "POST /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.397137 Jul 20 19:31:04.114951 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 400/807] 10.222.0.69 () {60 vars in 1322 bytes} [Wed Jul 20 19:31:03 2022] POST /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9/os-volume_attachments => generated 194 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:31:04.269620 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [req-62848308-549d-4e31-991b-095f2f1a56ec req-7065b8d0-c4c6-447a-95cb-4db1797f95c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "239cb0b6-54d7-4cc2-945a-1f026a015992", "tag": "761fbace-90da-4e61-bc51-77b19745762a"}]} {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:31:04.277932 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [req-62848308-549d-4e31-991b-095f2f1a56ec req-7065b8d0-c4c6-447a-95cb-4db1797f95c0 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:04.278379 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [req-62848308-549d-4e31-991b-095f2f1a56ec req-7065b8d0-c4c6-447a-95cb-4db1797f95c0 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:04.290386 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.compute.server_external_events [req-62848308-549d-4e31-991b-095f2f1a56ec req-7065b8d0-c4c6-447a-95cb-4db1797f95c0 service nova] Creating event network-changed:761fbace-90da-4e61-bc51-77b19745762a for instance 239cb0b6-54d7-4cc2-945a-1f026a015992 on hv-cinder-83538 Jul 20 19:31:04.295471 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [req-62848308-549d-4e31-991b-095f2f1a56ec req-7065b8d0-c4c6-447a-95cb-4db1797f95c0 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089839 Jul 20 19:31:04.296146 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 408/808] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 19:31:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:31:04.991068 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-be901866-b474-4f00-a69f-f9fefa03d152 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:04.992428 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-be901866-b474-4f00-a69f-f9fefa03d152 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:04.999609 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-be901866-b474-4f00-a69f-f9fefa03d152 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:05.000064 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-be901866-b474-4f00-a69f-f9fefa03d152 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:05.000995 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-be901866-b474-4f00-a69f-f9fefa03d152 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:05.001427 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-be901866-b474-4f00-a69f-f9fefa03d152 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:05.150667 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-be901866-b474-4f00-a69f-f9fefa03d152 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:05.159693 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-be901866-b474-4f00-a69f-f9fefa03d152 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:05.161191 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-be901866-b474-4f00-a69f-f9fefa03d152 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:05.162415 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-be901866-b474-4f00-a69f-f9fefa03d152 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.176555 Jul 20 19:31:05.162974 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 401/809] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:04 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:31:06.181427 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-58a147f0-1e74-48a2-999b-afa2382abb08 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:06.182171 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-58a147f0-1e74-48a2-999b-afa2382abb08 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:06.188648 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-58a147f0-1e74-48a2-999b-afa2382abb08 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:06.189090 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-58a147f0-1e74-48a2-999b-afa2382abb08 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:06.189881 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-58a147f0-1e74-48a2-999b-afa2382abb08 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:06.190316 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-58a147f0-1e74-48a2-999b-afa2382abb08 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:06.328123 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-58a147f0-1e74-48a2-999b-afa2382abb08 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:06.336642 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-58a147f0-1e74-48a2-999b-afa2382abb08 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:06.338183 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-58a147f0-1e74-48a2-999b-afa2382abb08 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:06.339326 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-58a147f0-1e74-48a2-999b-afa2382abb08 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.162649 Jul 20 19:31:06.339886 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 409/810] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:06 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:31:07.357645 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ac6cad04-0c91-46a9-a7a3-039944eada35 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:07.358350 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ac6cad04-0c91-46a9-a7a3-039944eada35 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:07.365894 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ac6cad04-0c91-46a9-a7a3-039944eada35 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:07.366342 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ac6cad04-0c91-46a9-a7a3-039944eada35 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:07.367106 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ac6cad04-0c91-46a9-a7a3-039944eada35 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:07.367538 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ac6cad04-0c91-46a9-a7a3-039944eada35 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:07.493705 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ac6cad04-0c91-46a9-a7a3-039944eada35 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:07.502707 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ac6cad04-0c91-46a9-a7a3-039944eada35 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:07.504203 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ac6cad04-0c91-46a9-a7a3-039944eada35 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:07.505347 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ac6cad04-0c91-46a9-a7a3-039944eada35 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.151622 Jul 20 19:31:07.505967 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 402/811] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:07 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:31:08.523971 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-ce4ec99e-fd3a-421f-ae26-5accf272e3b2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:08.524612 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-ce4ec99e-fd3a-421f-ae26-5accf272e3b2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:08.531611 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-ce4ec99e-fd3a-421f-ae26-5accf272e3b2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:08.532056 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-ce4ec99e-fd3a-421f-ae26-5accf272e3b2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:08.532913 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-ce4ec99e-fd3a-421f-ae26-5accf272e3b2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:08.533345 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-ce4ec99e-fd3a-421f-ae26-5accf272e3b2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:08.667231 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-ce4ec99e-fd3a-421f-ae26-5accf272e3b2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:08.676440 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-ce4ec99e-fd3a-421f-ae26-5accf272e3b2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:08.677989 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-ce4ec99e-fd3a-421f-ae26-5accf272e3b2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:08.679146 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-ce4ec99e-fd3a-421f-ae26-5accf272e3b2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.159168 Jul 20 19:31:08.679706 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 410/812] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:08 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:31:09.697842 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d0bdc3d9-2ec1-4548-bb30-bda0a3189469 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:09.698442 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d0bdc3d9-2ec1-4548-bb30-bda0a3189469 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:09.700948 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_api:SELECT=52 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:09.706761 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d0bdc3d9-2ec1-4548-bb30-bda0a3189469 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:09.707205 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d0bdc3d9-2ec1-4548-bb30-bda0a3189469 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:09.707966 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d0bdc3d9-2ec1-4548-bb30-bda0a3189469 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:09.708394 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d0bdc3d9-2ec1-4548-bb30-bda0a3189469 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:09.840995 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d0bdc3d9-2ec1-4548-bb30-bda0a3189469 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:09.849439 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d0bdc3d9-2ec1-4548-bb30-bda0a3189469 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:09.850968 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d0bdc3d9-2ec1-4548-bb30-bda0a3189469 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:09.852147 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d0bdc3d9-2ec1-4548-bb30-bda0a3189469 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.158207 Jul 20 19:31:09.852696 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 403/813] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:09 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:31:10.871117 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-9495d111-06f3-41a5-9126-14105173c6dd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:10.871700 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-9495d111-06f3-41a5-9126-14105173c6dd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:10.878730 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9495d111-06f3-41a5-9126-14105173c6dd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:10.879164 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9495d111-06f3-41a5-9126-14105173c6dd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:10.879908 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9495d111-06f3-41a5-9126-14105173c6dd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:10.880331 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9495d111-06f3-41a5-9126-14105173c6dd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:11.008895 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-9495d111-06f3-41a5-9126-14105173c6dd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:11.017357 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-9495d111-06f3-41a5-9126-14105173c6dd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:11.018892 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-9495d111-06f3-41a5-9126-14105173c6dd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:11.020032 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-9495d111-06f3-41a5-9126-14105173c6dd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.152858 Jul 20 19:31:11.020583 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 411/814] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:10 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:31:12.038545 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-22113cd8-5eb3-4692-9309-bfcc6ac6ab93 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:12.039136 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-22113cd8-5eb3-4692-9309-bfcc6ac6ab93 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:12.045584 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-22113cd8-5eb3-4692-9309-bfcc6ac6ab93 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:12.046043 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-22113cd8-5eb3-4692-9309-bfcc6ac6ab93 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:12.047375 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-22113cd8-5eb3-4692-9309-bfcc6ac6ab93 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:12.047375 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-22113cd8-5eb3-4692-9309-bfcc6ac6ab93 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:12.175705 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-22113cd8-5eb3-4692-9309-bfcc6ac6ab93 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:12.183942 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-22113cd8-5eb3-4692-9309-bfcc6ac6ab93 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:12.185440 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-22113cd8-5eb3-4692-9309-bfcc6ac6ab93 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:12.187119 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-22113cd8-5eb3-4692-9309-bfcc6ac6ab93 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.152530 Jul 20 19:31:12.187666 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 404/815] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:12 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:31:13.204915 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-ea8adf0b-b016-4982-aaa0-19927512f0ed tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:13.205823 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-ea8adf0b-b016-4982-aaa0-19927512f0ed tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:13.212342 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-ea8adf0b-b016-4982-aaa0-19927512f0ed tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:13.212784 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-ea8adf0b-b016-4982-aaa0-19927512f0ed tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:13.213573 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-ea8adf0b-b016-4982-aaa0-19927512f0ed tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:13.214008 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-ea8adf0b-b016-4982-aaa0-19927512f0ed tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:13.342413 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-ea8adf0b-b016-4982-aaa0-19927512f0ed tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:13.351261 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-ea8adf0b-b016-4982-aaa0-19927512f0ed tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:13.352774 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-ea8adf0b-b016-4982-aaa0-19927512f0ed tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:13.353987 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-ea8adf0b-b016-4982-aaa0-19927512f0ed tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.153709 Jul 20 19:31:13.354552 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 412/816] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:13 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:31:14.373194 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-040ce635-4719-4d10-b7a8-e524534c18de tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:14.373872 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-040ce635-4719-4d10-b7a8-e524534c18de tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:14.381067 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-040ce635-4719-4d10-b7a8-e524534c18de tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:14.381530 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-040ce635-4719-4d10-b7a8-e524534c18de tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:14.382429 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-040ce635-4719-4d10-b7a8-e524534c18de tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:14.382865 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-040ce635-4719-4d10-b7a8-e524534c18de tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:14.519222 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-040ce635-4719-4d10-b7a8-e524534c18de tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:14.521683 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:14.530490 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-040ce635-4719-4d10-b7a8-e524534c18de tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:14.531986 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-040ce635-4719-4d10-b7a8-e524534c18de tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:14.533154 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-040ce635-4719-4d10-b7a8-e524534c18de tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.164785 Jul 20 19:31:14.533733 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 405/817] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:14 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:31:15.552408 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-fed5b286-4a4a-4f07-9f37-b7a6c9c1e120 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:15.553010 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-fed5b286-4a4a-4f07-9f37-b7a6c9c1e120 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:15.559600 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-fed5b286-4a4a-4f07-9f37-b7a6c9c1e120 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:15.560052 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-fed5b286-4a4a-4f07-9f37-b7a6c9c1e120 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:15.560803 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-fed5b286-4a4a-4f07-9f37-b7a6c9c1e120 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:15.561977 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-fed5b286-4a4a-4f07-9f37-b7a6c9c1e120 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:15.693530 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-fed5b286-4a4a-4f07-9f37-b7a6c9c1e120 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:15.702236 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-fed5b286-4a4a-4f07-9f37-b7a6c9c1e120 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:15.703933 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-fed5b286-4a4a-4f07-9f37-b7a6c9c1e120 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:15.705086 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-fed5b286-4a4a-4f07-9f37-b7a6c9c1e120 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.156536 Jul 20 19:31:15.705673 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 413/818] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:15 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:31:16.723926 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-adabb0eb-aec7-43c4-8ef9-7a980b573314 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:16.724539 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-adabb0eb-aec7-43c4-8ef9-7a980b573314 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:16.732238 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-adabb0eb-aec7-43c4-8ef9-7a980b573314 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:16.732685 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-adabb0eb-aec7-43c4-8ef9-7a980b573314 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:16.734227 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-adabb0eb-aec7-43c4-8ef9-7a980b573314 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:16.734479 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-adabb0eb-aec7-43c4-8ef9-7a980b573314 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:16.868143 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-adabb0eb-aec7-43c4-8ef9-7a980b573314 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:16.877823 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-adabb0eb-aec7-43c4-8ef9-7a980b573314 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:16.879328 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-adabb0eb-aec7-43c4-8ef9-7a980b573314 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:16.880485 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-adabb0eb-aec7-43c4-8ef9-7a980b573314 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.160866 Jul 20 19:31:16.881041 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 406/819] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:16 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:31:17.898417 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-fa4ba625-56cb-42dd-8b9e-49f21e7b0783 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:17.899411 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-fa4ba625-56cb-42dd-8b9e-49f21e7b0783 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:17.905914 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-fa4ba625-56cb-42dd-8b9e-49f21e7b0783 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:17.906362 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-fa4ba625-56cb-42dd-8b9e-49f21e7b0783 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:17.907110 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-fa4ba625-56cb-42dd-8b9e-49f21e7b0783 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:17.907539 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-fa4ba625-56cb-42dd-8b9e-49f21e7b0783 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:18.040404 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-fa4ba625-56cb-42dd-8b9e-49f21e7b0783 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:18.050201 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-fa4ba625-56cb-42dd-8b9e-49f21e7b0783 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:18.051369 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-fa4ba625-56cb-42dd-8b9e-49f21e7b0783 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:18.052535 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-fa4ba625-56cb-42dd-8b9e-49f21e7b0783 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.157961 Jul 20 19:31:18.053168 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 414/820] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:17 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:31:19.071043 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ff1bc673-5046-4efe-9f19-7465ea3b90b0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:19.071624 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ff1bc673-5046-4efe-9f19-7465ea3b90b0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:19.078579 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ff1bc673-5046-4efe-9f19-7465ea3b90b0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:19.079029 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ff1bc673-5046-4efe-9f19-7465ea3b90b0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:19.079796 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ff1bc673-5046-4efe-9f19-7465ea3b90b0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:19.080233 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ff1bc673-5046-4efe-9f19-7465ea3b90b0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:19.210373 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ff1bc673-5046-4efe-9f19-7465ea3b90b0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:19.219479 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ff1bc673-5046-4efe-9f19-7465ea3b90b0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:19.220988 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ff1bc673-5046-4efe-9f19-7465ea3b90b0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:19.222263 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ff1bc673-5046-4efe-9f19-7465ea3b90b0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.155088 Jul 20 19:31:19.222818 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 407/821] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:19 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:31:20.240923 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-e381d7ec-1d2d-49f9-9a2a-3c0331d96ff1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:20.241501 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-e381d7ec-1d2d-49f9-9a2a-3c0331d96ff1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:20.243803 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_api:SELECT=42 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:20.250067 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e381d7ec-1d2d-49f9-9a2a-3c0331d96ff1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:20.250516 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e381d7ec-1d2d-49f9-9a2a-3c0331d96ff1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:20.251506 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e381d7ec-1d2d-49f9-9a2a-3c0331d96ff1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:20.251885 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e381d7ec-1d2d-49f9-9a2a-3c0331d96ff1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:20.382708 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-e381d7ec-1d2d-49f9-9a2a-3c0331d96ff1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:20.386105 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_cell1:SELECT=100 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:20.392071 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-e381d7ec-1d2d-49f9-9a2a-3c0331d96ff1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:20.393734 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-e381d7ec-1d2d-49f9-9a2a-3c0331d96ff1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:20.394891 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-e381d7ec-1d2d-49f9-9a2a-3c0331d96ff1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.157916 Jul 20 19:31:20.395450 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 415/822] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:20 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:31:21.412993 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-b5e8b78b-fef9-4771-8ee5-b6a683cb352f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:21.413619 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-b5e8b78b-fef9-4771-8ee5-b6a683cb352f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:21.420116 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b5e8b78b-fef9-4771-8ee5-b6a683cb352f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:21.420559 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b5e8b78b-fef9-4771-8ee5-b6a683cb352f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:21.421311 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b5e8b78b-fef9-4771-8ee5-b6a683cb352f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:21.421770 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b5e8b78b-fef9-4771-8ee5-b6a683cb352f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:21.552437 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-b5e8b78b-fef9-4771-8ee5-b6a683cb352f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:21.560752 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-b5e8b78b-fef9-4771-8ee5-b6a683cb352f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:21.562303 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-b5e8b78b-fef9-4771-8ee5-b6a683cb352f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:21.563528 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-b5e8b78b-fef9-4771-8ee5-b6a683cb352f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.154362 Jul 20 19:31:21.564799 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 408/823] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:21 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:31:22.583093 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-5283059e-cb4f-4f91-9045-11b6aa21bd2c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:22.583637 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-5283059e-cb4f-4f91-9045-11b6aa21bd2c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:22.590553 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-5283059e-cb4f-4f91-9045-11b6aa21bd2c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:22.591003 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-5283059e-cb4f-4f91-9045-11b6aa21bd2c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:22.591793 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-5283059e-cb4f-4f91-9045-11b6aa21bd2c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:22.592229 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-5283059e-cb4f-4f91-9045-11b6aa21bd2c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:22.721883 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-5283059e-cb4f-4f91-9045-11b6aa21bd2c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:22.730326 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-5283059e-cb4f-4f91-9045-11b6aa21bd2c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:22.731821 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-5283059e-cb4f-4f91-9045-11b6aa21bd2c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:22.732961 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-5283059e-cb4f-4f91-9045-11b6aa21bd2c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.154563 Jul 20 19:31:22.733529 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 416/824] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:22 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:31:23.750391 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-0c38ca97-2eb3-49ec-8613-462535df95c5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:23.751590 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-0c38ca97-2eb3-49ec-8613-462535df95c5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:23.758432 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0c38ca97-2eb3-49ec-8613-462535df95c5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:23.758878 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0c38ca97-2eb3-49ec-8613-462535df95c5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:23.759641 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0c38ca97-2eb3-49ec-8613-462535df95c5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:23.760075 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0c38ca97-2eb3-49ec-8613-462535df95c5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:23.888331 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0c38ca97-2eb3-49ec-8613-462535df95c5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:23.896849 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0c38ca97-2eb3-49ec-8613-462535df95c5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:23.898395 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0c38ca97-2eb3-49ec-8613-462535df95c5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:23.899554 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-0c38ca97-2eb3-49ec-8613-462535df95c5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.153110 Jul 20 19:31:23.900115 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 409/825] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:23 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:31:24.918123 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-b65e080c-4503-48c9-a5cc-2dadfce8c641 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:24.918717 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-b65e080c-4503-48c9-a5cc-2dadfce8c641 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:24.925380 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b65e080c-4503-48c9-a5cc-2dadfce8c641 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:24.925854 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b65e080c-4503-48c9-a5cc-2dadfce8c641 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:24.926608 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b65e080c-4503-48c9-a5cc-2dadfce8c641 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:24.927034 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b65e080c-4503-48c9-a5cc-2dadfce8c641 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:25.058805 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-b65e080c-4503-48c9-a5cc-2dadfce8c641 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:25.067385 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-b65e080c-4503-48c9-a5cc-2dadfce8c641 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:25.068891 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-b65e080c-4503-48c9-a5cc-2dadfce8c641 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:25.070077 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-b65e080c-4503-48c9-a5cc-2dadfce8c641 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.155876 Jul 20 19:31:25.070638 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 417/826] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:24 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:31:26.088887 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e5f352ce-4904-487c-a13e-aa1020f53ced tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:26.089427 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e5f352ce-4904-487c-a13e-aa1020f53ced tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:26.096625 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e5f352ce-4904-487c-a13e-aa1020f53ced tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:26.097076 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e5f352ce-4904-487c-a13e-aa1020f53ced tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:26.097878 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e5f352ce-4904-487c-a13e-aa1020f53ced tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:26.098310 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e5f352ce-4904-487c-a13e-aa1020f53ced tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:26.230027 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e5f352ce-4904-487c-a13e-aa1020f53ced tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:26.238875 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e5f352ce-4904-487c-a13e-aa1020f53ced tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:26.240381 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e5f352ce-4904-487c-a13e-aa1020f53ced tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:26.241557 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e5f352ce-4904-487c-a13e-aa1020f53ced tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.156984 Jul 20 19:31:26.242117 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 410/827] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:26 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:31:27.260165 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-3be0a989-b04c-4fbd-a41e-00cc44e89cfc tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:27.260751 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-3be0a989-b04c-4fbd-a41e-00cc44e89cfc tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:27.267679 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3be0a989-b04c-4fbd-a41e-00cc44e89cfc tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:27.268125 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3be0a989-b04c-4fbd-a41e-00cc44e89cfc tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:27.268991 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3be0a989-b04c-4fbd-a41e-00cc44e89cfc tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:27.269429 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3be0a989-b04c-4fbd-a41e-00cc44e89cfc tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:27.403652 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-3be0a989-b04c-4fbd-a41e-00cc44e89cfc tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:27.412086 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-3be0a989-b04c-4fbd-a41e-00cc44e89cfc tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:27.413631 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-3be0a989-b04c-4fbd-a41e-00cc44e89cfc tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:27.414788 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-3be0a989-b04c-4fbd-a41e-00cc44e89cfc tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.158525 Jul 20 19:31:27.415344 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 418/828] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:27 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:31:28.432588 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-54b51ca2-d9ab-4a9d-8500-4e671fb56874 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:28.433189 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-54b51ca2-d9ab-4a9d-8500-4e671fb56874 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:28.440151 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-54b51ca2-d9ab-4a9d-8500-4e671fb56874 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:28.440592 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-54b51ca2-d9ab-4a9d-8500-4e671fb56874 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:28.441341 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-54b51ca2-d9ab-4a9d-8500-4e671fb56874 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:28.441795 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-54b51ca2-d9ab-4a9d-8500-4e671fb56874 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:28.569232 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-54b51ca2-d9ab-4a9d-8500-4e671fb56874 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:28.577579 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-54b51ca2-d9ab-4a9d-8500-4e671fb56874 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:28.579705 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-54b51ca2-d9ab-4a9d-8500-4e671fb56874 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:28.581121 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-54b51ca2-d9ab-4a9d-8500-4e671fb56874 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.152319 Jul 20 19:31:28.581708 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 411/829] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:28 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:31:29.599459 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-aa8eadc0-af02-4bb4-b1cc-db3986085aba tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:29.599979 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-aa8eadc0-af02-4bb4-b1cc-db3986085aba tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:29.606638 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-aa8eadc0-af02-4bb4-b1cc-db3986085aba tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:29.607089 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-aa8eadc0-af02-4bb4-b1cc-db3986085aba tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:29.607850 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-aa8eadc0-af02-4bb4-b1cc-db3986085aba tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:29.608287 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-aa8eadc0-af02-4bb4-b1cc-db3986085aba tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:29.736585 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-aa8eadc0-af02-4bb4-b1cc-db3986085aba tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:29.745029 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-aa8eadc0-af02-4bb4-b1cc-db3986085aba tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:29.746566 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-aa8eadc0-af02-4bb4-b1cc-db3986085aba tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:29.747712 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-aa8eadc0-af02-4bb4-b1cc-db3986085aba tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.152334 Jul 20 19:31:29.748338 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 419/830] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:29 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:31:30.767139 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-580a0089-88ac-4978-8b3e-804f61d689d7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:30.767744 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-580a0089-88ac-4978-8b3e-804f61d689d7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:30.774241 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-580a0089-88ac-4978-8b3e-804f61d689d7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:30.774689 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-580a0089-88ac-4978-8b3e-804f61d689d7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:30.775452 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-580a0089-88ac-4978-8b3e-804f61d689d7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:30.775888 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-580a0089-88ac-4978-8b3e-804f61d689d7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:30.903344 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-580a0089-88ac-4978-8b3e-804f61d689d7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:30.912267 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-580a0089-88ac-4978-8b3e-804f61d689d7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:30.913802 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-580a0089-88ac-4978-8b3e-804f61d689d7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:30.914961 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-580a0089-88ac-4978-8b3e-804f61d689d7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.151753 Jul 20 19:31:30.915515 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 412/831] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:30 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:31:31.933561 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-bc5bfb9b-5ee9-4d01-8797-88534faa3670 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:31.934155 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-bc5bfb9b-5ee9-4d01-8797-88534faa3670 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:31.941223 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-bc5bfb9b-5ee9-4d01-8797-88534faa3670 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:31.941695 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-bc5bfb9b-5ee9-4d01-8797-88534faa3670 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:31.942443 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-bc5bfb9b-5ee9-4d01-8797-88534faa3670 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:31.942870 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-bc5bfb9b-5ee9-4d01-8797-88534faa3670 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:32.075799 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-bc5bfb9b-5ee9-4d01-8797-88534faa3670 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:32.084931 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-bc5bfb9b-5ee9-4d01-8797-88534faa3670 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:32.086736 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-bc5bfb9b-5ee9-4d01-8797-88534faa3670 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:32.087905 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-bc5bfb9b-5ee9-4d01-8797-88534faa3670 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.158280 Jul 20 19:31:32.088469 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 420/832] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:31 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:31:33.107513 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a598596b-a17b-4c36-a418-467c55eb3a87 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:33.108156 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a598596b-a17b-4c36-a418-467c55eb3a87 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:33.114883 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a598596b-a17b-4c36-a418-467c55eb3a87 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:33.115347 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a598596b-a17b-4c36-a418-467c55eb3a87 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:33.116098 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a598596b-a17b-4c36-a418-467c55eb3a87 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:33.116522 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a598596b-a17b-4c36-a418-467c55eb3a87 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:33.245867 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a598596b-a17b-4c36-a418-467c55eb3a87 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:33.254822 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a598596b-a17b-4c36-a418-467c55eb3a87 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:33.256320 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a598596b-a17b-4c36-a418-467c55eb3a87 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:33.257463 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a598596b-a17b-4c36-a418-467c55eb3a87 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.154004 Jul 20 19:31:33.258182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 413/833] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:33 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:31:34.276078 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-eefdc68a-18d9-4b08-a93c-73fae5b42bbd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:34.276689 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-eefdc68a-18d9-4b08-a93c-73fae5b42bbd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:34.283763 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-eefdc68a-18d9-4b08-a93c-73fae5b42bbd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:34.284253 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-eefdc68a-18d9-4b08-a93c-73fae5b42bbd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:34.284967 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-eefdc68a-18d9-4b08-a93c-73fae5b42bbd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:34.285404 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-eefdc68a-18d9-4b08-a93c-73fae5b42bbd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:34.416948 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-eefdc68a-18d9-4b08-a93c-73fae5b42bbd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:34.425388 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-eefdc68a-18d9-4b08-a93c-73fae5b42bbd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:34.426926 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-eefdc68a-18d9-4b08-a93c-73fae5b42bbd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:34.428080 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-eefdc68a-18d9-4b08-a93c-73fae5b42bbd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.155868 Jul 20 19:31:34.428642 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 421/834] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:34 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:31:35.446155 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-7a8296ce-dc4b-46f4-b4a0-eeda3322f4f2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:35.446772 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-7a8296ce-dc4b-46f4-b4a0-eeda3322f4f2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:35.453214 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7a8296ce-dc4b-46f4-b4a0-eeda3322f4f2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:35.453699 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7a8296ce-dc4b-46f4-b4a0-eeda3322f4f2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:35.454465 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7a8296ce-dc4b-46f4-b4a0-eeda3322f4f2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:35.454908 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7a8296ce-dc4b-46f4-b4a0-eeda3322f4f2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:35.582261 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-7a8296ce-dc4b-46f4-b4a0-eeda3322f4f2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:35.590776 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-7a8296ce-dc4b-46f4-b4a0-eeda3322f4f2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:35.592304 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-7a8296ce-dc4b-46f4-b4a0-eeda3322f4f2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:35.593456 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-7a8296ce-dc4b-46f4-b4a0-eeda3322f4f2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.151183 Jul 20 19:31:35.594048 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 414/835] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:35 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:31:36.613047 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-f9398a78-d6d5-4aff-afdb-cef736bad8fa tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:36.613593 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-f9398a78-d6d5-4aff-afdb-cef736bad8fa tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:36.620124 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f9398a78-d6d5-4aff-afdb-cef736bad8fa tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:36.620565 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f9398a78-d6d5-4aff-afdb-cef736bad8fa tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:36.621321 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f9398a78-d6d5-4aff-afdb-cef736bad8fa tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:36.621779 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f9398a78-d6d5-4aff-afdb-cef736bad8fa tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:36.754125 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-f9398a78-d6d5-4aff-afdb-cef736bad8fa tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:36.762594 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-f9398a78-d6d5-4aff-afdb-cef736bad8fa tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:36.764083 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-f9398a78-d6d5-4aff-afdb-cef736bad8fa tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:36.765272 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-f9398a78-d6d5-4aff-afdb-cef736bad8fa tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.157028 Jul 20 19:31:36.765861 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 422/836] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:36 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:31:37.783657 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ed9e0adc-0ccb-4e13-8d68-f33a46d82619 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:37.784274 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ed9e0adc-0ccb-4e13-8d68-f33a46d82619 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:37.790670 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ed9e0adc-0ccb-4e13-8d68-f33a46d82619 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:37.791112 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ed9e0adc-0ccb-4e13-8d68-f33a46d82619 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:37.791867 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ed9e0adc-0ccb-4e13-8d68-f33a46d82619 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:37.792296 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ed9e0adc-0ccb-4e13-8d68-f33a46d82619 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:37.925963 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ed9e0adc-0ccb-4e13-8d68-f33a46d82619 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:37.934303 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ed9e0adc-0ccb-4e13-8d68-f33a46d82619 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:37.935806 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ed9e0adc-0ccb-4e13-8d68-f33a46d82619 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:37.936951 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ed9e0adc-0ccb-4e13-8d68-f33a46d82619 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.157320 Jul 20 19:31:37.937775 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 415/837] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:37 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:31:38.956361 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-9e70c378-cd43-4ff9-b2eb-99bf571a76de tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:38.956953 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-9e70c378-cd43-4ff9-b2eb-99bf571a76de tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:38.963917 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9e70c378-cd43-4ff9-b2eb-99bf571a76de tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:38.964357 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9e70c378-cd43-4ff9-b2eb-99bf571a76de tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:38.965133 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9e70c378-cd43-4ff9-b2eb-99bf571a76de tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:38.965611 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9e70c378-cd43-4ff9-b2eb-99bf571a76de tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:39.097225 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-9e70c378-cd43-4ff9-b2eb-99bf571a76de tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:39.106772 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-9e70c378-cd43-4ff9-b2eb-99bf571a76de tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:39.108320 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-9e70c378-cd43-4ff9-b2eb-99bf571a76de tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:39.109489 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-9e70c378-cd43-4ff9-b2eb-99bf571a76de tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.157579 Jul 20 19:31:39.110082 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 423/838] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:38 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:31:40.128323 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-5fa1984d-a5bd-4e71-9acd-bb38be3f180d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:40.128924 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-5fa1984d-a5bd-4e71-9acd-bb38be3f180d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:40.131290 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_api:SELECT=26 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:40.136104 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5fa1984d-a5bd-4e71-9acd-bb38be3f180d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:40.136547 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5fa1984d-a5bd-4e71-9acd-bb38be3f180d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:40.137298 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5fa1984d-a5bd-4e71-9acd-bb38be3f180d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:40.137926 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5fa1984d-a5bd-4e71-9acd-bb38be3f180d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:40.268238 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-5fa1984d-a5bd-4e71-9acd-bb38be3f180d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:40.277258 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-5fa1984d-a5bd-4e71-9acd-bb38be3f180d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:40.278794 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-5fa1984d-a5bd-4e71-9acd-bb38be3f180d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:40.279954 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-5fa1984d-a5bd-4e71-9acd-bb38be3f180d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.156163 Jul 20 19:31:40.280502 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 416/839] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:40 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:31:41.298407 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-cc7ee82c-af79-424b-8a50-3411dde22066 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:41.298946 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-cc7ee82c-af79-424b-8a50-3411dde22066 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:41.305706 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-cc7ee82c-af79-424b-8a50-3411dde22066 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:41.306159 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-cc7ee82c-af79-424b-8a50-3411dde22066 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:41.306970 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-cc7ee82c-af79-424b-8a50-3411dde22066 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:41.307406 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-cc7ee82c-af79-424b-8a50-3411dde22066 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:41.440189 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-cc7ee82c-af79-424b-8a50-3411dde22066 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:41.448757 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-cc7ee82c-af79-424b-8a50-3411dde22066 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:41.450422 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-cc7ee82c-af79-424b-8a50-3411dde22066 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:41.451594 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-cc7ee82c-af79-424b-8a50-3411dde22066 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.157194 Jul 20 19:31:41.452157 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 424/840] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:41 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:31:42.470767 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-eebf588f-e339-4153-b13c-73eb9987fbb5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:42.471627 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-eebf588f-e339-4153-b13c-73eb9987fbb5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:42.477991 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-eebf588f-e339-4153-b13c-73eb9987fbb5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:42.478409 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-eebf588f-e339-4153-b13c-73eb9987fbb5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:42.479169 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-eebf588f-e339-4153-b13c-73eb9987fbb5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:42.479601 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-eebf588f-e339-4153-b13c-73eb9987fbb5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:42.619823 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-eebf588f-e339-4153-b13c-73eb9987fbb5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:42.628981 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-eebf588f-e339-4153-b13c-73eb9987fbb5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:42.630649 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-eebf588f-e339-4153-b13c-73eb9987fbb5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:42.631860 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-eebf588f-e339-4153-b13c-73eb9987fbb5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.165490 Jul 20 19:31:42.632421 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 417/841] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:42 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:31:43.650086 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-c76fd394-887b-4f3e-a0d2-3fce4e7ebaee tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:43.650789 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-c76fd394-887b-4f3e-a0d2-3fce4e7ebaee tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:43.658173 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c76fd394-887b-4f3e-a0d2-3fce4e7ebaee tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:43.658623 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c76fd394-887b-4f3e-a0d2-3fce4e7ebaee tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:43.659385 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c76fd394-887b-4f3e-a0d2-3fce4e7ebaee tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:43.659819 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c76fd394-887b-4f3e-a0d2-3fce4e7ebaee tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:43.791954 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-c76fd394-887b-4f3e-a0d2-3fce4e7ebaee tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:43.800528 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-c76fd394-887b-4f3e-a0d2-3fce4e7ebaee tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:43.802072 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-c76fd394-887b-4f3e-a0d2-3fce4e7ebaee tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:43.803223 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-c76fd394-887b-4f3e-a0d2-3fce4e7ebaee tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.157315 Jul 20 19:31:43.803782 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 425/842] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:43 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:31:44.822076 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-8b2871e3-29eb-4f05-b427-e8a596fa9eee tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:44.822677 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-8b2871e3-29eb-4f05-b427-e8a596fa9eee tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:44.829295 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8b2871e3-29eb-4f05-b427-e8a596fa9eee tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:44.829914 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8b2871e3-29eb-4f05-b427-e8a596fa9eee tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:44.830673 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8b2871e3-29eb-4f05-b427-e8a596fa9eee tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:44.831101 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8b2871e3-29eb-4f05-b427-e8a596fa9eee tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:44.960356 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8b2871e3-29eb-4f05-b427-e8a596fa9eee tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:44.968910 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8b2871e3-29eb-4f05-b427-e8a596fa9eee tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:44.970904 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8b2871e3-29eb-4f05-b427-e8a596fa9eee tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:44.972066 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-8b2871e3-29eb-4f05-b427-e8a596fa9eee tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.153883 Jul 20 19:31:44.972622 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 418/843] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:44 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:31:45.990761 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-891678db-7759-43cd-9cba-a9e630f692a2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:45.991342 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-891678db-7759-43cd-9cba-a9e630f692a2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:45.998724 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-891678db-7759-43cd-9cba-a9e630f692a2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:45.999180 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-891678db-7759-43cd-9cba-a9e630f692a2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:45.999959 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-891678db-7759-43cd-9cba-a9e630f692a2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:46.000432 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-891678db-7759-43cd-9cba-a9e630f692a2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:46.132917 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-891678db-7759-43cd-9cba-a9e630f692a2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:46.141956 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-891678db-7759-43cd-9cba-a9e630f692a2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:46.143553 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-891678db-7759-43cd-9cba-a9e630f692a2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:46.144723 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-891678db-7759-43cd-9cba-a9e630f692a2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.157906 Jul 20 19:31:46.145277 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 426/844] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:45 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:31:47.163235 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-81f600a9-6b25-4d27-b9c7-a7d475cf6874 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:47.163873 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-81f600a9-6b25-4d27-b9c7-a7d475cf6874 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:47.170404 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-81f600a9-6b25-4d27-b9c7-a7d475cf6874 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:47.170859 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-81f600a9-6b25-4d27-b9c7-a7d475cf6874 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:47.171623 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-81f600a9-6b25-4d27-b9c7-a7d475cf6874 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:47.172062 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-81f600a9-6b25-4d27-b9c7-a7d475cf6874 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:47.176638 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=80 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:47.305557 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-81f600a9-6b25-4d27-b9c7-a7d475cf6874 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:47.314517 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-81f600a9-6b25-4d27-b9c7-a7d475cf6874 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:47.316106 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-81f600a9-6b25-4d27-b9c7-a7d475cf6874 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:47.317930 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-81f600a9-6b25-4d27-b9c7-a7d475cf6874 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.157957 Jul 20 19:31:47.317930 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 419/845] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:47 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:31:48.335289 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-bbe5a749-5be6-445b-8be8-ea7b8e9b2014 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:48.336193 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-bbe5a749-5be6-445b-8be8-ea7b8e9b2014 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:48.342679 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-bbe5a749-5be6-445b-8be8-ea7b8e9b2014 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:48.343129 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-bbe5a749-5be6-445b-8be8-ea7b8e9b2014 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:48.343889 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-bbe5a749-5be6-445b-8be8-ea7b8e9b2014 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:48.344836 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-bbe5a749-5be6-445b-8be8-ea7b8e9b2014 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:48.480386 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-bbe5a749-5be6-445b-8be8-ea7b8e9b2014 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:48.489360 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-bbe5a749-5be6-445b-8be8-ea7b8e9b2014 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:48.490880 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-bbe5a749-5be6-445b-8be8-ea7b8e9b2014 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:48.492023 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-bbe5a749-5be6-445b-8be8-ea7b8e9b2014 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.160701 Jul 20 19:31:48.492694 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 427/846] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:48 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:31:49.510652 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a6942b92-0c36-40f1-8e0e-7bdb1376fa11 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:49.511255 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a6942b92-0c36-40f1-8e0e-7bdb1376fa11 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:49.517793 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a6942b92-0c36-40f1-8e0e-7bdb1376fa11 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:49.518238 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a6942b92-0c36-40f1-8e0e-7bdb1376fa11 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:49.518996 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a6942b92-0c36-40f1-8e0e-7bdb1376fa11 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:49.519426 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a6942b92-0c36-40f1-8e0e-7bdb1376fa11 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:49.647779 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a6942b92-0c36-40f1-8e0e-7bdb1376fa11 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:49.656324 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a6942b92-0c36-40f1-8e0e-7bdb1376fa11 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:49.658512 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a6942b92-0c36-40f1-8e0e-7bdb1376fa11 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:49.659676 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a6942b92-0c36-40f1-8e0e-7bdb1376fa11 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.152889 Jul 20 19:31:49.660225 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 420/847] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:49 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:31:50.678116 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-0ce37316-6829-4d63-8079-6cee3aa06bf6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:50.678708 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-0ce37316-6829-4d63-8079-6cee3aa06bf6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:50.681042 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_api:SELECT=26 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:50.686815 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-0ce37316-6829-4d63-8079-6cee3aa06bf6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:50.687266 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-0ce37316-6829-4d63-8079-6cee3aa06bf6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:50.688046 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-0ce37316-6829-4d63-8079-6cee3aa06bf6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:50.688481 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-0ce37316-6829-4d63-8079-6cee3aa06bf6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:50.816529 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-0ce37316-6829-4d63-8079-6cee3aa06bf6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:50.824951 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-0ce37316-6829-4d63-8079-6cee3aa06bf6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:50.826482 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-0ce37316-6829-4d63-8079-6cee3aa06bf6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:50.827639 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-0ce37316-6829-4d63-8079-6cee3aa06bf6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.153434 Jul 20 19:31:50.828195 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 428/848] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:50 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:31:51.847465 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-6ae96729-8053-4302-a8a1-6b8abd192cce tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:51.848029 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-6ae96729-8053-4302-a8a1-6b8abd192cce tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:51.854494 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6ae96729-8053-4302-a8a1-6b8abd192cce tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:51.854949 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6ae96729-8053-4302-a8a1-6b8abd192cce tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:51.855718 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6ae96729-8053-4302-a8a1-6b8abd192cce tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:51.856159 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6ae96729-8053-4302-a8a1-6b8abd192cce tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:51.981873 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6ae96729-8053-4302-a8a1-6b8abd192cce tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:51.991009 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6ae96729-8053-4302-a8a1-6b8abd192cce tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:51.992547 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6ae96729-8053-4302-a8a1-6b8abd192cce tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:51.993728 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-6ae96729-8053-4302-a8a1-6b8abd192cce tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.151142 Jul 20 19:31:51.994293 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 421/849] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:51 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:31:53.012500 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-b49533b6-b944-43cf-a6e3-3acbb1b0a09e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:53.013134 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-b49533b6-b944-43cf-a6e3-3acbb1b0a09e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:53.020364 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b49533b6-b944-43cf-a6e3-3acbb1b0a09e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:53.020810 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b49533b6-b944-43cf-a6e3-3acbb1b0a09e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:53.021595 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b49533b6-b944-43cf-a6e3-3acbb1b0a09e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:53.022036 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b49533b6-b944-43cf-a6e3-3acbb1b0a09e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:53.025964 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_cell1:SELECT=79 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:53.154296 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-b49533b6-b944-43cf-a6e3-3acbb1b0a09e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:53.163562 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-b49533b6-b944-43cf-a6e3-3acbb1b0a09e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:53.165066 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-b49533b6-b944-43cf-a6e3-3acbb1b0a09e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:53.166232 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-b49533b6-b944-43cf-a6e3-3acbb1b0a09e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.157703 Jul 20 19:31:53.166778 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 429/850] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:53 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:31:54.184389 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-7bde7b77-5354-4e15-961b-4fa9b1a880d0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:54.185020 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-7bde7b77-5354-4e15-961b-4fa9b1a880d0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:54.192445 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7bde7b77-5354-4e15-961b-4fa9b1a880d0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:54.192891 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7bde7b77-5354-4e15-961b-4fa9b1a880d0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:54.193683 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7bde7b77-5354-4e15-961b-4fa9b1a880d0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:54.194120 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7bde7b77-5354-4e15-961b-4fa9b1a880d0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:54.327908 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-7bde7b77-5354-4e15-961b-4fa9b1a880d0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:54.337367 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-7bde7b77-5354-4e15-961b-4fa9b1a880d0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:54.338919 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-7bde7b77-5354-4e15-961b-4fa9b1a880d0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:54.340075 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-7bde7b77-5354-4e15-961b-4fa9b1a880d0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.159597 Jul 20 19:31:54.340636 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 422/851] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:54 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:31:55.358118 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-db81ae27-903c-415c-be0d-8375c1290cdf tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:55.358722 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-db81ae27-903c-415c-be0d-8375c1290cdf tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:55.365395 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-db81ae27-903c-415c-be0d-8375c1290cdf tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:55.365879 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-db81ae27-903c-415c-be0d-8375c1290cdf tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:55.366641 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-db81ae27-903c-415c-be0d-8375c1290cdf tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:55.367075 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-db81ae27-903c-415c-be0d-8375c1290cdf tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:55.494407 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-db81ae27-903c-415c-be0d-8375c1290cdf tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:55.502766 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-db81ae27-903c-415c-be0d-8375c1290cdf tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:55.504271 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-db81ae27-903c-415c-be0d-8375c1290cdf tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:55.505419 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-db81ae27-903c-415c-be0d-8375c1290cdf tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.151270 Jul 20 19:31:55.506006 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 430/852] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:55 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:31:56.226324 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a9c344a1-10f3-4049-a868-923184309d3e tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:56.226892 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a9c344a1-10f3-4049-a868-923184309d3e tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:56.233400 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a9c344a1-10f3-4049-a868-923184309d3e tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:56.233879 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a9c344a1-10f3-4049-a868-923184309d3e tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:56.234642 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a9c344a1-10f3-4049-a868-923184309d3e tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:56.235082 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a9c344a1-10f3-4049-a868-923184309d3e tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:56.317413 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.objects.instance [None req-a9c344a1-10f3-4049-a868-923184309d3e tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lazy-loading 'services' on Instance uuid c33037ed-7b36-43aa-85ad-e48920801b0a {{(pid=117761) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:31:56.388981 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a9c344a1-10f3-4049-a868-923184309d3e tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "DELETE /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a/os-volume_attachments/6649e176-aa9f-4321-a737-fbc7fefd194b" status: 202 len: 0 microversion: 2.1 time: 0.166435 Jul 20 19:31:56.389686 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 423/853] 10.222.0.69 () {58 vars in 1415 bytes} [Wed Jul 20 19:31:56 2022] DELETE /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a/os-volume_attachments/6649e176-aa9f-4321-a737-fbc7fefd194b => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 19:31:56.524149 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-12026213-546e-4ac6-956f-dd76423ea567 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:56.524711 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-12026213-546e-4ac6-956f-dd76423ea567 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:56.531182 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-12026213-546e-4ac6-956f-dd76423ea567 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:56.531629 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-12026213-546e-4ac6-956f-dd76423ea567 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:56.532379 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-12026213-546e-4ac6-956f-dd76423ea567 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:56.532814 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-12026213-546e-4ac6-956f-dd76423ea567 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:56.662466 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-12026213-546e-4ac6-956f-dd76423ea567 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:56.671398 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-12026213-546e-4ac6-956f-dd76423ea567 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:56.672924 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-12026213-546e-4ac6-956f-dd76423ea567 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:56.674111 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-12026213-546e-4ac6-956f-dd76423ea567 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.153929 Jul 20 19:31:56.674680 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 431/854] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:56 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:31:57.693131 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-6838ddde-2df5-493d-b4f9-dfd33228fec6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:57.693849 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-6838ddde-2df5-493d-b4f9-dfd33228fec6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:57.700941 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6838ddde-2df5-493d-b4f9-dfd33228fec6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:57.701386 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6838ddde-2df5-493d-b4f9-dfd33228fec6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:57.702250 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6838ddde-2df5-493d-b4f9-dfd33228fec6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:57.702729 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6838ddde-2df5-493d-b4f9-dfd33228fec6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:57.837331 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6838ddde-2df5-493d-b4f9-dfd33228fec6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:57.845825 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6838ddde-2df5-493d-b4f9-dfd33228fec6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:57.847332 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6838ddde-2df5-493d-b4f9-dfd33228fec6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:57.848942 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-6838ddde-2df5-493d-b4f9-dfd33228fec6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.160573 Jul 20 19:31:57.849385 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 424/855] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:57 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:31:58.867263 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-83011174-9375-4f29-81c5-31e157376ead tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:58.867852 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-83011174-9375-4f29-81c5-31e157376ead tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:58.875267 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-83011174-9375-4f29-81c5-31e157376ead tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:58.875712 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-83011174-9375-4f29-81c5-31e157376ead tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:58.876477 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-83011174-9375-4f29-81c5-31e157376ead tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:58.876912 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-83011174-9375-4f29-81c5-31e157376ead tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:59.012139 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-83011174-9375-4f29-81c5-31e157376ead tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:59.021462 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-83011174-9375-4f29-81c5-31e157376ead tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:59.023008 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-83011174-9375-4f29-81c5-31e157376ead tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:59.024174 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-83011174-9375-4f29-81c5-31e157376ead tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.161142 Jul 20 19:31:59.033664 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 432/856] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:58 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:32:00.041565 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-2b70bb17-f3ad-440c-a277-d74a1f1417e6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:00.042176 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-2b70bb17-f3ad-440c-a277-d74a1f1417e6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:00.048955 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2b70bb17-f3ad-440c-a277-d74a1f1417e6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:00.049408 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2b70bb17-f3ad-440c-a277-d74a1f1417e6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:00.050197 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2b70bb17-f3ad-440c-a277-d74a1f1417e6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:00.051134 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2b70bb17-f3ad-440c-a277-d74a1f1417e6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:00.181279 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-2b70bb17-f3ad-440c-a277-d74a1f1417e6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:00.189605 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-2b70bb17-f3ad-440c-a277-d74a1f1417e6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:00.191098 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-2b70bb17-f3ad-440c-a277-d74a1f1417e6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:00.192311 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-2b70bb17-f3ad-440c-a277-d74a1f1417e6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.154680 Jul 20 19:32:00.192863 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 425/857] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:00 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:32:01.211225 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-64215e16-31e3-4007-846d-d750fec6fe42 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:01.211809 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-64215e16-31e3-4007-846d-d750fec6fe42 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:01.219015 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-64215e16-31e3-4007-846d-d750fec6fe42 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:01.219463 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-64215e16-31e3-4007-846d-d750fec6fe42 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:01.220237 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-64215e16-31e3-4007-846d-d750fec6fe42 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:01.220676 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-64215e16-31e3-4007-846d-d750fec6fe42 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:01.351313 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-64215e16-31e3-4007-846d-d750fec6fe42 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:01.359727 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-64215e16-31e3-4007-846d-d750fec6fe42 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:01.361243 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-64215e16-31e3-4007-846d-d750fec6fe42 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:01.362434 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-64215e16-31e3-4007-846d-d750fec6fe42 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.156004 Jul 20 19:32:01.362992 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 433/858] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:01 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:32:02.381608 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-5b27e92f-f001-4e32-a83d-c5691ae1574f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:02.382209 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-5b27e92f-f001-4e32-a83d-c5691ae1574f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:02.388785 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5b27e92f-f001-4e32-a83d-c5691ae1574f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:02.389237 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5b27e92f-f001-4e32-a83d-c5691ae1574f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:02.390037 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5b27e92f-f001-4e32-a83d-c5691ae1574f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:02.390468 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5b27e92f-f001-4e32-a83d-c5691ae1574f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:02.523994 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-5b27e92f-f001-4e32-a83d-c5691ae1574f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:02.532546 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-5b27e92f-f001-4e32-a83d-c5691ae1574f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:02.534101 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-5b27e92f-f001-4e32-a83d-c5691ae1574f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:02.535416 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-5b27e92f-f001-4e32-a83d-c5691ae1574f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.158369 Jul 20 19:32:02.536684 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 426/859] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:02 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:32:03.556175 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-4c8d2b26-6637-43b1-85e7-bc1cb4e1969c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:03.556820 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-4c8d2b26-6637-43b1-85e7-bc1cb4e1969c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:03.563365 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4c8d2b26-6637-43b1-85e7-bc1cb4e1969c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:03.563816 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4c8d2b26-6637-43b1-85e7-bc1cb4e1969c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:03.564576 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4c8d2b26-6637-43b1-85e7-bc1cb4e1969c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:03.565006 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4c8d2b26-6637-43b1-85e7-bc1cb4e1969c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:03.699505 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-4c8d2b26-6637-43b1-85e7-bc1cb4e1969c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:03.707848 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-4c8d2b26-6637-43b1-85e7-bc1cb4e1969c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:03.709737 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-4c8d2b26-6637-43b1-85e7-bc1cb4e1969c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:03.711229 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-4c8d2b26-6637-43b1-85e7-bc1cb4e1969c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.158952 Jul 20 19:32:03.711786 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 434/860] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:03 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:32:04.729492 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d536635f-82bf-4db6-98c1-de1cde3bc724 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:04.730138 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d536635f-82bf-4db6-98c1-de1cde3bc724 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:04.736388 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d536635f-82bf-4db6-98c1-de1cde3bc724 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:04.736831 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d536635f-82bf-4db6-98c1-de1cde3bc724 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:04.737608 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d536635f-82bf-4db6-98c1-de1cde3bc724 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:04.738039 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d536635f-82bf-4db6-98c1-de1cde3bc724 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:04.866727 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d536635f-82bf-4db6-98c1-de1cde3bc724 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:04.875304 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d536635f-82bf-4db6-98c1-de1cde3bc724 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:04.876809 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d536635f-82bf-4db6-98c1-de1cde3bc724 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:04.878076 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d536635f-82bf-4db6-98c1-de1cde3bc724 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.152659 Jul 20 19:32:04.878622 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 427/861] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:04 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:32:05.897326 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-48c4496b-52d4-4178-ad49-9cf2bb119504 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:05.898044 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-48c4496b-52d4-4178-ad49-9cf2bb119504 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:05.906070 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-48c4496b-52d4-4178-ad49-9cf2bb119504 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:05.906597 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-48c4496b-52d4-4178-ad49-9cf2bb119504 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:05.907453 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-48c4496b-52d4-4178-ad49-9cf2bb119504 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:05.907955 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-48c4496b-52d4-4178-ad49-9cf2bb119504 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:06.038468 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-48c4496b-52d4-4178-ad49-9cf2bb119504 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:06.046710 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-48c4496b-52d4-4178-ad49-9cf2bb119504 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:06.048204 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-48c4496b-52d4-4178-ad49-9cf2bb119504 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:06.049345 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-48c4496b-52d4-4178-ad49-9cf2bb119504 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.157010 Jul 20 19:32:06.049957 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 435/862] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:05 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:32:07.068302 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-b4d53140-e460-4995-8531-0d948063067e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:07.069240 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-b4d53140-e460-4995-8531-0d948063067e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:07.076859 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b4d53140-e460-4995-8531-0d948063067e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:07.077395 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b4d53140-e460-4995-8531-0d948063067e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:07.078188 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b4d53140-e460-4995-8531-0d948063067e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:07.078624 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b4d53140-e460-4995-8531-0d948063067e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:07.143260 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 19:32:07.143491 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Wed Jul 20 19:32:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 (ip 10.222.0.69) !!! Jul 20 19:32:07.217605 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-b4d53140-e460-4995-8531-0d948063067e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:07.225983 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-b4d53140-e460-4995-8531-0d948063067e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:07.227471 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-b4d53140-e460-4995-8531-0d948063067e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:07.228622 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-b4d53140-e460-4995-8531-0d948063067e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.165581 Jul 20 19:32:07.229182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 428/863] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:07 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:32:08.247052 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-c7fac9ed-5c2b-421c-b109-583f119061ad tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:08.247741 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-c7fac9ed-5c2b-421c-b109-583f119061ad tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:08.255592 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c7fac9ed-5c2b-421c-b109-583f119061ad tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:08.256064 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c7fac9ed-5c2b-421c-b109-583f119061ad tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:08.256976 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c7fac9ed-5c2b-421c-b109-583f119061ad tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:08.257463 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c7fac9ed-5c2b-421c-b109-583f119061ad tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:08.393967 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-c7fac9ed-5c2b-421c-b109-583f119061ad tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:08.402502 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-c7fac9ed-5c2b-421c-b109-583f119061ad tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:08.404006 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-c7fac9ed-5c2b-421c-b109-583f119061ad tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:08.405358 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-c7fac9ed-5c2b-421c-b109-583f119061ad tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.162686 Jul 20 19:32:08.405940 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 436/864] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:08 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:32:09.423478 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c4cd243b-5c9a-49b8-a6c8-f922d4b9a920 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:09.424070 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c4cd243b-5c9a-49b8-a6c8-f922d4b9a920 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:09.431201 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c4cd243b-5c9a-49b8-a6c8-f922d4b9a920 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:09.431656 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c4cd243b-5c9a-49b8-a6c8-f922d4b9a920 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:09.432464 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c4cd243b-5c9a-49b8-a6c8-f922d4b9a920 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:09.432896 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c4cd243b-5c9a-49b8-a6c8-f922d4b9a920 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:09.568279 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c4cd243b-5c9a-49b8-a6c8-f922d4b9a920 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:09.576639 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c4cd243b-5c9a-49b8-a6c8-f922d4b9a920 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:09.578091 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c4cd243b-5c9a-49b8-a6c8-f922d4b9a920 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:09.579246 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c4cd243b-5c9a-49b8-a6c8-f922d4b9a920 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.159671 Jul 20 19:32:09.579796 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 429/865] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:09 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:32:10.598508 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-3fbe5cd9-f5be-448f-94eb-ad60598e8086 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:10.599101 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-3fbe5cd9-f5be-448f-94eb-ad60598e8086 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:10.606105 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3fbe5cd9-f5be-448f-94eb-ad60598e8086 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:10.606546 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3fbe5cd9-f5be-448f-94eb-ad60598e8086 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:10.607293 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3fbe5cd9-f5be-448f-94eb-ad60598e8086 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:10.607721 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3fbe5cd9-f5be-448f-94eb-ad60598e8086 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:10.740468 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-3fbe5cd9-f5be-448f-94eb-ad60598e8086 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:10.749577 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-3fbe5cd9-f5be-448f-94eb-ad60598e8086 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:10.751531 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-3fbe5cd9-f5be-448f-94eb-ad60598e8086 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:10.752687 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-3fbe5cd9-f5be-448f-94eb-ad60598e8086 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.158150 Jul 20 19:32:10.753249 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 437/866] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:10 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:32:11.770825 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-8d695de9-5474-4a5d-bf21-f81e801e27de tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:11.771423 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-8d695de9-5474-4a5d-bf21-f81e801e27de tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:11.773734 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_api:SELECT=28 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:11.778997 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8d695de9-5474-4a5d-bf21-f81e801e27de tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:11.779449 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8d695de9-5474-4a5d-bf21-f81e801e27de tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:11.780217 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8d695de9-5474-4a5d-bf21-f81e801e27de tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:11.780658 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8d695de9-5474-4a5d-bf21-f81e801e27de tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:11.915615 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8d695de9-5474-4a5d-bf21-f81e801e27de tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:11.924009 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8d695de9-5474-4a5d-bf21-f81e801e27de tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:11.925502 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8d695de9-5474-4a5d-bf21-f81e801e27de tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:11.926692 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-8d695de9-5474-4a5d-bf21-f81e801e27de tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.159785 Jul 20 19:32:11.927267 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 430/867] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:11 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:32:12.945885 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-e250b4c0-7991-442c-8f59-a7d444b6b57b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:12.946485 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-e250b4c0-7991-442c-8f59-a7d444b6b57b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:12.953101 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e250b4c0-7991-442c-8f59-a7d444b6b57b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:12.953570 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e250b4c0-7991-442c-8f59-a7d444b6b57b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:12.954328 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e250b4c0-7991-442c-8f59-a7d444b6b57b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:12.954758 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e250b4c0-7991-442c-8f59-a7d444b6b57b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:13.083185 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-e250b4c0-7991-442c-8f59-a7d444b6b57b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:13.092681 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-e250b4c0-7991-442c-8f59-a7d444b6b57b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:13.094423 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-e250b4c0-7991-442c-8f59-a7d444b6b57b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:13.095744 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-e250b4c0-7991-442c-8f59-a7d444b6b57b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.154219 Jul 20 19:32:13.096347 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 438/868] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:12 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:32:14.114240 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4a4b4819-ca9d-470b-b883-afb1299c5d29 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:14.114902 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-4a4b4819-ca9d-470b-b883-afb1299c5d29 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:14.121403 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4a4b4819-ca9d-470b-b883-afb1299c5d29 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:14.121973 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4a4b4819-ca9d-470b-b883-afb1299c5d29 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:14.122817 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4a4b4819-ca9d-470b-b883-afb1299c5d29 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:14.123471 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4a4b4819-ca9d-470b-b883-afb1299c5d29 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:14.263916 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-4a4b4819-ca9d-470b-b883-afb1299c5d29 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:14.272370 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-4a4b4819-ca9d-470b-b883-afb1299c5d29 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:14.274156 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-4a4b4819-ca9d-470b-b883-afb1299c5d29 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:14.275307 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-4a4b4819-ca9d-470b-b883-afb1299c5d29 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.164973 Jul 20 19:32:14.275861 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 431/869] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:14 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:32:15.293925 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-1d64e3e1-c48e-4dc1-a7f2-aa77074e8001 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:15.294556 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-1d64e3e1-c48e-4dc1-a7f2-aa77074e8001 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:15.301149 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1d64e3e1-c48e-4dc1-a7f2-aa77074e8001 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:15.301625 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1d64e3e1-c48e-4dc1-a7f2-aa77074e8001 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:15.302393 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1d64e3e1-c48e-4dc1-a7f2-aa77074e8001 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:15.302825 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1d64e3e1-c48e-4dc1-a7f2-aa77074e8001 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:15.449541 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-1d64e3e1-c48e-4dc1-a7f2-aa77074e8001 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:15.458259 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-1d64e3e1-c48e-4dc1-a7f2-aa77074e8001 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:15.459907 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-1d64e3e1-c48e-4dc1-a7f2-aa77074e8001 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:15.461939 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-1d64e3e1-c48e-4dc1-a7f2-aa77074e8001 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.172068 Jul 20 19:32:15.462504 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 439/870] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:15 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:32:16.481550 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a719d34c-d577-49f0-a4bc-2e62fe183cb9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:16.482146 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a719d34c-d577-49f0-a4bc-2e62fe183cb9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:16.489050 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a719d34c-d577-49f0-a4bc-2e62fe183cb9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:16.489533 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a719d34c-d577-49f0-a4bc-2e62fe183cb9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:16.490312 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a719d34c-d577-49f0-a4bc-2e62fe183cb9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:16.490750 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a719d34c-d577-49f0-a4bc-2e62fe183cb9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:16.624672 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a719d34c-d577-49f0-a4bc-2e62fe183cb9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:16.633249 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a719d34c-d577-49f0-a4bc-2e62fe183cb9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:16.635503 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a719d34c-d577-49f0-a4bc-2e62fe183cb9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:16.636683 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a719d34c-d577-49f0-a4bc-2e62fe183cb9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.159536 Jul 20 19:32:16.637359 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 432/871] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:16 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:32:17.655604 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-53295ccf-1497-4539-9f65-c1e3a3b82828 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:17.656210 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-53295ccf-1497-4539-9f65-c1e3a3b82828 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:17.662904 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-53295ccf-1497-4539-9f65-c1e3a3b82828 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:17.663349 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-53295ccf-1497-4539-9f65-c1e3a3b82828 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:17.664106 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-53295ccf-1497-4539-9f65-c1e3a3b82828 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:17.664541 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-53295ccf-1497-4539-9f65-c1e3a3b82828 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:17.792481 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-53295ccf-1497-4539-9f65-c1e3a3b82828 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:17.801731 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-53295ccf-1497-4539-9f65-c1e3a3b82828 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:17.803253 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-53295ccf-1497-4539-9f65-c1e3a3b82828 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:17.804411 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-53295ccf-1497-4539-9f65-c1e3a3b82828 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.152750 Jul 20 19:32:17.804974 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 440/872] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:17 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:32:18.072407 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 19:32:18.072597 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: Wed Jul 20 19:32:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 19:32:18.822724 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-0a6c00fc-07a1-4bf9-97ac-1978e77ab959 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:18.823321 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-0a6c00fc-07a1-4bf9-97ac-1978e77ab959 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:18.829984 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0a6c00fc-07a1-4bf9-97ac-1978e77ab959 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:18.830478 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0a6c00fc-07a1-4bf9-97ac-1978e77ab959 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:18.831180 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0a6c00fc-07a1-4bf9-97ac-1978e77ab959 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:18.831609 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0a6c00fc-07a1-4bf9-97ac-1978e77ab959 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:18.834147 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=1 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:18.966349 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0a6c00fc-07a1-4bf9-97ac-1978e77ab959 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:18.975645 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0a6c00fc-07a1-4bf9-97ac-1978e77ab959 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:18.978019 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0a6c00fc-07a1-4bf9-97ac-1978e77ab959 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:18.979701 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-0a6c00fc-07a1-4bf9-97ac-1978e77ab959 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.160789 Jul 20 19:32:18.980273 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 433/873] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:18 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:32:19.998457 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-2112eb77-1729-4189-830a-6e9515f38e2e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:19.999059 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-2112eb77-1729-4189-830a-6e9515f38e2e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:20.005278 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2112eb77-1729-4189-830a-6e9515f38e2e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:20.005753 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2112eb77-1729-4189-830a-6e9515f38e2e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:20.006513 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2112eb77-1729-4189-830a-6e9515f38e2e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:20.006945 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2112eb77-1729-4189-830a-6e9515f38e2e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:20.139276 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-2112eb77-1729-4189-830a-6e9515f38e2e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:20.147775 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-2112eb77-1729-4189-830a-6e9515f38e2e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:20.149322 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-2112eb77-1729-4189-830a-6e9515f38e2e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:20.150501 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-2112eb77-1729-4189-830a-6e9515f38e2e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.156070 Jul 20 19:32:20.151056 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 441/874] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:19 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:32:21.168901 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a5e73146-02a8-41e2-858a-ce71b0d528f6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:21.169589 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a5e73146-02a8-41e2-858a-ce71b0d528f6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:21.176121 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a5e73146-02a8-41e2-858a-ce71b0d528f6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:21.176567 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a5e73146-02a8-41e2-858a-ce71b0d528f6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:21.177332 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a5e73146-02a8-41e2-858a-ce71b0d528f6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:21.177798 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a5e73146-02a8-41e2-858a-ce71b0d528f6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:21.312940 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a5e73146-02a8-41e2-858a-ce71b0d528f6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:21.324012 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a5e73146-02a8-41e2-858a-ce71b0d528f6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:21.325759 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a5e73146-02a8-41e2-858a-ce71b0d528f6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:21.327145 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a5e73146-02a8-41e2-858a-ce71b0d528f6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.162043 Jul 20 19:32:21.328055 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 434/875] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:21 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:32:22.346909 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-a3bab2b4-9570-4b13-ac12-a99e4f27b37d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:22.347446 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-a3bab2b4-9570-4b13-ac12-a99e4f27b37d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:22.349775 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_api:SELECT=28 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:22.355783 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a3bab2b4-9570-4b13-ac12-a99e4f27b37d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:22.356230 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a3bab2b4-9570-4b13-ac12-a99e4f27b37d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:22.357168 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a3bab2b4-9570-4b13-ac12-a99e4f27b37d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:22.357641 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a3bab2b4-9570-4b13-ac12-a99e4f27b37d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:22.487632 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-a3bab2b4-9570-4b13-ac12-a99e4f27b37d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:22.496118 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-a3bab2b4-9570-4b13-ac12-a99e4f27b37d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:22.497913 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-a3bab2b4-9570-4b13-ac12-a99e4f27b37d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:22.499125 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-a3bab2b4-9570-4b13-ac12-a99e4f27b37d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.156196 Jul 20 19:32:22.499695 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 442/876] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:22 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:32:23.518694 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-835783f3-236e-4c69-8c72-6cae17059c4f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:23.519347 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-835783f3-236e-4c69-8c72-6cae17059c4f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:23.526506 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-835783f3-236e-4c69-8c72-6cae17059c4f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:23.526960 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-835783f3-236e-4c69-8c72-6cae17059c4f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:23.527733 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-835783f3-236e-4c69-8c72-6cae17059c4f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:23.528172 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-835783f3-236e-4c69-8c72-6cae17059c4f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:23.665368 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-835783f3-236e-4c69-8c72-6cae17059c4f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:23.674083 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-835783f3-236e-4c69-8c72-6cae17059c4f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:23.675569 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-835783f3-236e-4c69-8c72-6cae17059c4f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:23.676713 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-835783f3-236e-4c69-8c72-6cae17059c4f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.162013 Jul 20 19:32:23.677262 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 435/877] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:23 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:32:24.695166 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-db39992e-4eba-4dee-b6dc-3d4a40807a91 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:24.695806 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-db39992e-4eba-4dee-b6dc-3d4a40807a91 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:24.702526 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-db39992e-4eba-4dee-b6dc-3d4a40807a91 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:24.702966 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-db39992e-4eba-4dee-b6dc-3d4a40807a91 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:24.703721 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-db39992e-4eba-4dee-b6dc-3d4a40807a91 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:24.704155 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-db39992e-4eba-4dee-b6dc-3d4a40807a91 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:24.708051 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_cell1:SELECT=84 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:24.835271 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-db39992e-4eba-4dee-b6dc-3d4a40807a91 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:24.843759 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-db39992e-4eba-4dee-b6dc-3d4a40807a91 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:24.845272 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-db39992e-4eba-4dee-b6dc-3d4a40807a91 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:24.846450 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-db39992e-4eba-4dee-b6dc-3d4a40807a91 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.155232 Jul 20 19:32:24.846996 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 443/878] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:24 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:32:25.865613 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-46892315-8ebd-4d12-b641-e98bd43ba239 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:25.866216 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-46892315-8ebd-4d12-b641-e98bd43ba239 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:25.873804 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-46892315-8ebd-4d12-b641-e98bd43ba239 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:25.874249 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-46892315-8ebd-4d12-b641-e98bd43ba239 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:25.875012 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-46892315-8ebd-4d12-b641-e98bd43ba239 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:25.875443 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-46892315-8ebd-4d12-b641-e98bd43ba239 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:26.009884 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-46892315-8ebd-4d12-b641-e98bd43ba239 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:26.018206 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-46892315-8ebd-4d12-b641-e98bd43ba239 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:26.019691 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-46892315-8ebd-4d12-b641-e98bd43ba239 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:26.020830 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-46892315-8ebd-4d12-b641-e98bd43ba239 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.159166 Jul 20 19:32:26.021384 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 436/879] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:25 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:32:27.039001 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-d65a54e2-6e38-406d-be3b-e35057e6f140 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:27.039625 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-d65a54e2-6e38-406d-be3b-e35057e6f140 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:27.047121 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d65a54e2-6e38-406d-be3b-e35057e6f140 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:27.047557 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d65a54e2-6e38-406d-be3b-e35057e6f140 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:27.048303 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d65a54e2-6e38-406d-be3b-e35057e6f140 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:27.048729 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d65a54e2-6e38-406d-be3b-e35057e6f140 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:27.180591 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-d65a54e2-6e38-406d-be3b-e35057e6f140 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:27.190565 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-d65a54e2-6e38-406d-be3b-e35057e6f140 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:27.192078 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-d65a54e2-6e38-406d-be3b-e35057e6f140 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:27.193324 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-d65a54e2-6e38-406d-be3b-e35057e6f140 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.158260 Jul 20 19:32:27.193960 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 444/880] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:27 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:32:28.211935 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-2ba925a7-21a7-450d-aab2-9f33aa3fb705 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:28.212556 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-2ba925a7-21a7-450d-aab2-9f33aa3fb705 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:28.218993 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2ba925a7-21a7-450d-aab2-9f33aa3fb705 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:28.219437 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2ba925a7-21a7-450d-aab2-9f33aa3fb705 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:28.220187 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2ba925a7-21a7-450d-aab2-9f33aa3fb705 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:28.220614 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2ba925a7-21a7-450d-aab2-9f33aa3fb705 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:28.358642 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-2ba925a7-21a7-450d-aab2-9f33aa3fb705 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:28.366950 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-2ba925a7-21a7-450d-aab2-9f33aa3fb705 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:28.368462 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-2ba925a7-21a7-450d-aab2-9f33aa3fb705 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:28.369831 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-2ba925a7-21a7-450d-aab2-9f33aa3fb705 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.162116 Jul 20 19:32:28.370389 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 437/881] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:28 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:32:29.387993 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-594bc09e-2016-4484-ba83-790b67de21c7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:29.388521 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-594bc09e-2016-4484-ba83-790b67de21c7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:29.395788 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-594bc09e-2016-4484-ba83-790b67de21c7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:29.396240 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-594bc09e-2016-4484-ba83-790b67de21c7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:29.397000 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-594bc09e-2016-4484-ba83-790b67de21c7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:29.397435 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-594bc09e-2016-4484-ba83-790b67de21c7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:29.532333 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-594bc09e-2016-4484-ba83-790b67de21c7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:29.542107 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-594bc09e-2016-4484-ba83-790b67de21c7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:29.543619 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-594bc09e-2016-4484-ba83-790b67de21c7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:29.544768 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-594bc09e-2016-4484-ba83-790b67de21c7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.160919 Jul 20 19:32:29.545312 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 445/882] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:29 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:32:30.568107 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-6a732673-a24b-4d73-a44a-ee15d988cf69 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:30.568107 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-6a732673-a24b-4d73-a44a-ee15d988cf69 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:30.571605 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6a732673-a24b-4d73-a44a-ee15d988cf69 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:30.572767 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6a732673-a24b-4d73-a44a-ee15d988cf69 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:30.573484 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6a732673-a24b-4d73-a44a-ee15d988cf69 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:30.573957 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6a732673-a24b-4d73-a44a-ee15d988cf69 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:30.703432 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6a732673-a24b-4d73-a44a-ee15d988cf69 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:30.712015 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6a732673-a24b-4d73-a44a-ee15d988cf69 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:30.713561 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6a732673-a24b-4d73-a44a-ee15d988cf69 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:30.714712 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-6a732673-a24b-4d73-a44a-ee15d988cf69 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.155720 Jul 20 19:32:30.715261 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 438/883] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:30 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:32:31.733257 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-4eec2b64-9b27-4309-814a-2d22255d4a3a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:31.733879 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-4eec2b64-9b27-4309-814a-2d22255d4a3a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:31.740360 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4eec2b64-9b27-4309-814a-2d22255d4a3a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:31.740805 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4eec2b64-9b27-4309-814a-2d22255d4a3a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:31.741586 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4eec2b64-9b27-4309-814a-2d22255d4a3a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:31.742023 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4eec2b64-9b27-4309-814a-2d22255d4a3a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:31.875401 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-4eec2b64-9b27-4309-814a-2d22255d4a3a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:31.883653 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-4eec2b64-9b27-4309-814a-2d22255d4a3a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:31.885757 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-4eec2b64-9b27-4309-814a-2d22255d4a3a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:31.886897 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-4eec2b64-9b27-4309-814a-2d22255d4a3a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.158519 Jul 20 19:32:31.887449 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 446/884] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:31 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:32:32.904937 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-292fa313-e08b-4480-aaac-6a57924d0f0b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:32.905684 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-292fa313-e08b-4480-aaac-6a57924d0f0b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:32.912577 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-292fa313-e08b-4480-aaac-6a57924d0f0b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:32.913078 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-292fa313-e08b-4480-aaac-6a57924d0f0b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:32.913862 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-292fa313-e08b-4480-aaac-6a57924d0f0b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:32.914302 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-292fa313-e08b-4480-aaac-6a57924d0f0b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:33.043106 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-292fa313-e08b-4480-aaac-6a57924d0f0b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:33.051457 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-292fa313-e08b-4480-aaac-6a57924d0f0b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:33.052952 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-292fa313-e08b-4480-aaac-6a57924d0f0b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:33.054131 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-292fa313-e08b-4480-aaac-6a57924d0f0b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.153735 Jul 20 19:32:33.054678 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 439/885] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:32 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:32:34.073105 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-93cff8bd-6c0a-4b15-9a95-e70f7470153c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:34.073780 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-93cff8bd-6c0a-4b15-9a95-e70f7470153c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:34.080080 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-93cff8bd-6c0a-4b15-9a95-e70f7470153c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:34.080523 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-93cff8bd-6c0a-4b15-9a95-e70f7470153c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:34.081272 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-93cff8bd-6c0a-4b15-9a95-e70f7470153c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:34.081734 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-93cff8bd-6c0a-4b15-9a95-e70f7470153c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:34.210629 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-93cff8bd-6c0a-4b15-9a95-e70f7470153c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:34.219105 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-93cff8bd-6c0a-4b15-9a95-e70f7470153c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:34.220598 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-93cff8bd-6c0a-4b15-9a95-e70f7470153c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:34.221759 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-93cff8bd-6c0a-4b15-9a95-e70f7470153c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.153501 Jul 20 19:32:34.222310 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 447/886] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:34 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:32:35.240147 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-3672dca9-26c1-441c-a342-cbb5b37ef3df tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:35.240753 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-3672dca9-26c1-441c-a342-cbb5b37ef3df tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:35.247137 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3672dca9-26c1-441c-a342-cbb5b37ef3df tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:35.247463 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3672dca9-26c1-441c-a342-cbb5b37ef3df tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:35.248219 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3672dca9-26c1-441c-a342-cbb5b37ef3df tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:35.248650 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3672dca9-26c1-441c-a342-cbb5b37ef3df tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:35.381706 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3672dca9-26c1-441c-a342-cbb5b37ef3df tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:35.390710 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3672dca9-26c1-441c-a342-cbb5b37ef3df tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:35.392192 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3672dca9-26c1-441c-a342-cbb5b37ef3df tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:35.393332 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-3672dca9-26c1-441c-a342-cbb5b37ef3df tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.157200 Jul 20 19:32:35.393911 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 440/887] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:35 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:32:36.411512 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-638b891f-356f-4545-9795-3eb8f1745221 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:36.412129 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-638b891f-356f-4545-9795-3eb8f1745221 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:36.419590 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-638b891f-356f-4545-9795-3eb8f1745221 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:36.420040 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-638b891f-356f-4545-9795-3eb8f1745221 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:36.420800 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-638b891f-356f-4545-9795-3eb8f1745221 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:36.421233 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-638b891f-356f-4545-9795-3eb8f1745221 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:36.550004 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-638b891f-356f-4545-9795-3eb8f1745221 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:36.558465 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-638b891f-356f-4545-9795-3eb8f1745221 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:36.559961 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-638b891f-356f-4545-9795-3eb8f1745221 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:36.561092 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-638b891f-356f-4545-9795-3eb8f1745221 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.153486 Jul 20 19:32:36.561659 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 448/888] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:36 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:32:37.578481 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-6bcd1eb8-de4a-43e8-8941-f6e7a42a7c88 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:37.579014 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-6bcd1eb8-de4a-43e8-8941-f6e7a42a7c88 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:37.585673 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6bcd1eb8-de4a-43e8-8941-f6e7a42a7c88 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:37.586115 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6bcd1eb8-de4a-43e8-8941-f6e7a42a7c88 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:37.586874 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6bcd1eb8-de4a-43e8-8941-f6e7a42a7c88 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:37.587853 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6bcd1eb8-de4a-43e8-8941-f6e7a42a7c88 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:37.714961 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6bcd1eb8-de4a-43e8-8941-f6e7a42a7c88 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:37.723320 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6bcd1eb8-de4a-43e8-8941-f6e7a42a7c88 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:37.724824 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6bcd1eb8-de4a-43e8-8941-f6e7a42a7c88 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:37.726002 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-6bcd1eb8-de4a-43e8-8941-f6e7a42a7c88 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.151461 Jul 20 19:32:37.726560 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 441/889] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:37 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:32:38.744748 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-35522f24-79cc-433b-84f7-8d9c11f467be tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:38.745418 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-35522f24-79cc-433b-84f7-8d9c11f467be tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:38.752096 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-35522f24-79cc-433b-84f7-8d9c11f467be tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:38.752545 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-35522f24-79cc-433b-84f7-8d9c11f467be tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:38.753312 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-35522f24-79cc-433b-84f7-8d9c11f467be tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:38.753782 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-35522f24-79cc-433b-84f7-8d9c11f467be tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:38.885335 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-35522f24-79cc-433b-84f7-8d9c11f467be tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:38.893670 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-35522f24-79cc-433b-84f7-8d9c11f467be tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:38.895189 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-35522f24-79cc-433b-84f7-8d9c11f467be tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:38.896350 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-35522f24-79cc-433b-84f7-8d9c11f467be tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.155561 Jul 20 19:32:38.896912 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 449/890] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:38 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:32:39.916225 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-06efde86-b293-404e-9c37-0950f80bea48 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:39.916873 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-06efde86-b293-404e-9c37-0950f80bea48 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:39.923437 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-06efde86-b293-404e-9c37-0950f80bea48 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:39.923887 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-06efde86-b293-404e-9c37-0950f80bea48 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:39.924657 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-06efde86-b293-404e-9c37-0950f80bea48 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:39.925092 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-06efde86-b293-404e-9c37-0950f80bea48 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:40.062154 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-06efde86-b293-404e-9c37-0950f80bea48 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:40.070324 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-06efde86-b293-404e-9c37-0950f80bea48 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:40.071929 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-06efde86-b293-404e-9c37-0950f80bea48 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:40.073065 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-06efde86-b293-404e-9c37-0950f80bea48 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.161339 Jul 20 19:32:40.073650 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 442/891] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:39 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:32:41.092124 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-489617b5-8ba5-4d0b-ac02-c9486597f760 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:41.092849 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-489617b5-8ba5-4d0b-ac02-c9486597f760 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:41.100548 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-489617b5-8ba5-4d0b-ac02-c9486597f760 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:41.101325 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-489617b5-8ba5-4d0b-ac02-c9486597f760 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:41.102263 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-489617b5-8ba5-4d0b-ac02-c9486597f760 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:41.102767 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-489617b5-8ba5-4d0b-ac02-c9486597f760 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:41.237741 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-489617b5-8ba5-4d0b-ac02-c9486597f760 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:41.247402 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-489617b5-8ba5-4d0b-ac02-c9486597f760 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:41.248948 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-489617b5-8ba5-4d0b-ac02-c9486597f760 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:41.250187 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-489617b5-8ba5-4d0b-ac02-c9486597f760 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.162773 Jul 20 19:32:41.250739 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 450/892] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:41 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:32:42.268079 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-1bc84f68-992e-411c-9c8c-f33b7f0a66c4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:42.268951 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-1bc84f68-992e-411c-9c8c-f33b7f0a66c4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:42.271388 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_api:SELECT=26 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:42.276953 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1bc84f68-992e-411c-9c8c-f33b7f0a66c4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:42.277393 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1bc84f68-992e-411c-9c8c-f33b7f0a66c4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:42.278178 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1bc84f68-992e-411c-9c8c-f33b7f0a66c4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:42.278605 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1bc84f68-992e-411c-9c8c-f33b7f0a66c4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:42.406114 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1bc84f68-992e-411c-9c8c-f33b7f0a66c4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:42.414391 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1bc84f68-992e-411c-9c8c-f33b7f0a66c4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:42.415943 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1bc84f68-992e-411c-9c8c-f33b7f0a66c4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:42.417104 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-1bc84f68-992e-411c-9c8c-f33b7f0a66c4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.152892 Jul 20 19:32:42.417695 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 443/893] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:42 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:32:43.436469 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-9b5fe23b-a3a5-438c-89c6-d5d676ff7f42 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:43.437301 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-9b5fe23b-a3a5-438c-89c6-d5d676ff7f42 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:43.445783 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9b5fe23b-a3a5-438c-89c6-d5d676ff7f42 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:43.446268 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9b5fe23b-a3a5-438c-89c6-d5d676ff7f42 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:43.447027 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9b5fe23b-a3a5-438c-89c6-d5d676ff7f42 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:43.447464 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9b5fe23b-a3a5-438c-89c6-d5d676ff7f42 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:43.813572 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-9b5fe23b-a3a5-438c-89c6-d5d676ff7f42 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:43.822430 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-9b5fe23b-a3a5-438c-89c6-d5d676ff7f42 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:43.823949 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-9b5fe23b-a3a5-438c-89c6-d5d676ff7f42 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:43.825111 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-9b5fe23b-a3a5-438c-89c6-d5d676ff7f42 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.393193 Jul 20 19:32:43.825694 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 451/894] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:43 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:32:44.843520 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e2b03026-af7f-4384-9506-55912b0b0dd5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:44.844068 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e2b03026-af7f-4384-9506-55912b0b0dd5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:44.850410 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e2b03026-af7f-4384-9506-55912b0b0dd5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:44.850850 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e2b03026-af7f-4384-9506-55912b0b0dd5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:44.851606 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e2b03026-af7f-4384-9506-55912b0b0dd5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:44.852034 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e2b03026-af7f-4384-9506-55912b0b0dd5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:44.983298 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e2b03026-af7f-4384-9506-55912b0b0dd5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:44.991505 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e2b03026-af7f-4384-9506-55912b0b0dd5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:44.993021 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e2b03026-af7f-4384-9506-55912b0b0dd5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:44.994961 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e2b03026-af7f-4384-9506-55912b0b0dd5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.155376 Jul 20 19:32:44.995503 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 444/895] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:44 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:32:46.013004 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-39cc2369-274b-4842-8233-4bb9837111ef tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:46.013640 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-39cc2369-274b-4842-8233-4bb9837111ef tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:46.020086 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-39cc2369-274b-4842-8233-4bb9837111ef tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:46.020533 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-39cc2369-274b-4842-8233-4bb9837111ef tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:46.021285 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-39cc2369-274b-4842-8233-4bb9837111ef tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:46.021745 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-39cc2369-274b-4842-8233-4bb9837111ef tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:46.154254 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-39cc2369-274b-4842-8233-4bb9837111ef tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:46.162540 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-39cc2369-274b-4842-8233-4bb9837111ef tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:46.164031 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-39cc2369-274b-4842-8233-4bb9837111ef tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:46.165177 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-39cc2369-274b-4842-8233-4bb9837111ef tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.156270 Jul 20 19:32:46.166432 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 452/896] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:46 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:32:47.184419 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-75e04edd-168c-4026-b6cc-b0cbdfd3f0a0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:47.185015 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-75e04edd-168c-4026-b6cc-b0cbdfd3f0a0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:47.191416 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-75e04edd-168c-4026-b6cc-b0cbdfd3f0a0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:47.191856 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-75e04edd-168c-4026-b6cc-b0cbdfd3f0a0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:47.192602 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-75e04edd-168c-4026-b6cc-b0cbdfd3f0a0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:47.193028 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-75e04edd-168c-4026-b6cc-b0cbdfd3f0a0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:47.320626 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-75e04edd-168c-4026-b6cc-b0cbdfd3f0a0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:47.329881 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-75e04edd-168c-4026-b6cc-b0cbdfd3f0a0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:47.331371 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-75e04edd-168c-4026-b6cc-b0cbdfd3f0a0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:47.332518 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-75e04edd-168c-4026-b6cc-b0cbdfd3f0a0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.152720 Jul 20 19:32:47.333065 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 445/897] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:47 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:32:48.350304 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-286392a5-8118-4fc1-9c0d-c14f6545dbbc tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:48.350867 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-286392a5-8118-4fc1-9c0d-c14f6545dbbc tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:48.357752 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-286392a5-8118-4fc1-9c0d-c14f6545dbbc tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:48.358211 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-286392a5-8118-4fc1-9c0d-c14f6545dbbc tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:48.358966 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-286392a5-8118-4fc1-9c0d-c14f6545dbbc tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:48.359399 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-286392a5-8118-4fc1-9c0d-c14f6545dbbc tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:48.493377 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-286392a5-8118-4fc1-9c0d-c14f6545dbbc tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:48.502739 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-286392a5-8118-4fc1-9c0d-c14f6545dbbc tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:48.504272 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-286392a5-8118-4fc1-9c0d-c14f6545dbbc tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:48.505401 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-286392a5-8118-4fc1-9c0d-c14f6545dbbc tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.159045 Jul 20 19:32:48.506000 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 453/898] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:48 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:32:49.524225 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-0eff7d9e-8cc3-4527-b574-7ebf7eee32b3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:49.524936 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-0eff7d9e-8cc3-4527-b574-7ebf7eee32b3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:49.532825 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0eff7d9e-8cc3-4527-b574-7ebf7eee32b3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:49.533272 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0eff7d9e-8cc3-4527-b574-7ebf7eee32b3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:49.534074 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0eff7d9e-8cc3-4527-b574-7ebf7eee32b3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:49.534508 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0eff7d9e-8cc3-4527-b574-7ebf7eee32b3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:49.537198 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=78 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:49.666181 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0eff7d9e-8cc3-4527-b574-7ebf7eee32b3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:49.674741 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0eff7d9e-8cc3-4527-b574-7ebf7eee32b3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:49.676323 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0eff7d9e-8cc3-4527-b574-7ebf7eee32b3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:49.677573 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-0eff7d9e-8cc3-4527-b574-7ebf7eee32b3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.157413 Jul 20 19:32:49.678180 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 446/899] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:49 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:32:50.696065 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-9893b74d-2fcb-4d50-915f-16652e5e386d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:50.696666 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-9893b74d-2fcb-4d50-915f-16652e5e386d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:50.704212 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9893b74d-2fcb-4d50-915f-16652e5e386d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:50.704663 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9893b74d-2fcb-4d50-915f-16652e5e386d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:50.705428 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9893b74d-2fcb-4d50-915f-16652e5e386d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:50.705889 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9893b74d-2fcb-4d50-915f-16652e5e386d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:50.833064 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-9893b74d-2fcb-4d50-915f-16652e5e386d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:50.842065 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-9893b74d-2fcb-4d50-915f-16652e5e386d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:50.843569 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-9893b74d-2fcb-4d50-915f-16652e5e386d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:50.844803 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-9893b74d-2fcb-4d50-915f-16652e5e386d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.152642 Jul 20 19:32:50.845358 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 454/900] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:50 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:32:51.863763 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a3072e83-ddf8-4979-9050-37351a36b64a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:51.864312 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a3072e83-ddf8-4979-9050-37351a36b64a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:51.870733 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a3072e83-ddf8-4979-9050-37351a36b64a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:51.871177 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a3072e83-ddf8-4979-9050-37351a36b64a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:51.871929 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a3072e83-ddf8-4979-9050-37351a36b64a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:51.872364 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a3072e83-ddf8-4979-9050-37351a36b64a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:52.000246 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a3072e83-ddf8-4979-9050-37351a36b64a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:52.008443 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a3072e83-ddf8-4979-9050-37351a36b64a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:52.009952 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a3072e83-ddf8-4979-9050-37351a36b64a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:52.011088 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a3072e83-ddf8-4979-9050-37351a36b64a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.151335 Jul 20 19:32:52.011640 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 447/901] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:51 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:32:53.029707 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-a14ece5d-75de-49eb-9cb8-a8c0e9306621 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:53.030311 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-a14ece5d-75de-49eb-9cb8-a8c0e9306621 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:53.032721 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_api:SELECT=26 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:53.038915 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a14ece5d-75de-49eb-9cb8-a8c0e9306621 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:53.039360 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a14ece5d-75de-49eb-9cb8-a8c0e9306621 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:53.040124 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a14ece5d-75de-49eb-9cb8-a8c0e9306621 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:53.040555 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a14ece5d-75de-49eb-9cb8-a8c0e9306621 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:53.173862 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-a14ece5d-75de-49eb-9cb8-a8c0e9306621 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:53.182247 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-a14ece5d-75de-49eb-9cb8-a8c0e9306621 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:53.183746 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-a14ece5d-75de-49eb-9cb8-a8c0e9306621 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:53.184968 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-a14ece5d-75de-49eb-9cb8-a8c0e9306621 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.159235 Jul 20 19:32:53.186075 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 455/902] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:53 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:32:54.204198 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a6703a21-9f13-4124-b0bc-a7781963f474 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:54.204841 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a6703a21-9f13-4124-b0bc-a7781963f474 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:54.212100 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a6703a21-9f13-4124-b0bc-a7781963f474 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:54.212563 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a6703a21-9f13-4124-b0bc-a7781963f474 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:54.213332 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a6703a21-9f13-4124-b0bc-a7781963f474 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:54.213807 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a6703a21-9f13-4124-b0bc-a7781963f474 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:54.347191 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a6703a21-9f13-4124-b0bc-a7781963f474 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:54.355577 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a6703a21-9f13-4124-b0bc-a7781963f474 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:54.357028 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a6703a21-9f13-4124-b0bc-a7781963f474 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:54.358221 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a6703a21-9f13-4124-b0bc-a7781963f474 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.158555 Jul 20 19:32:54.358783 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 448/903] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:54 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:32:55.376250 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-b350ed47-6d33-46a2-9a52-d6f25afe48ed tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:55.376852 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-b350ed47-6d33-46a2-9a52-d6f25afe48ed tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:55.383384 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b350ed47-6d33-46a2-9a52-d6f25afe48ed tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:55.383835 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b350ed47-6d33-46a2-9a52-d6f25afe48ed tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:55.384594 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b350ed47-6d33-46a2-9a52-d6f25afe48ed tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:55.385033 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b350ed47-6d33-46a2-9a52-d6f25afe48ed tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:55.387579 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_cell1:SELECT=78 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:55.517760 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-b350ed47-6d33-46a2-9a52-d6f25afe48ed tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:55.526109 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-b350ed47-6d33-46a2-9a52-d6f25afe48ed tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:55.527651 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-b350ed47-6d33-46a2-9a52-d6f25afe48ed tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:55.528798 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-b350ed47-6d33-46a2-9a52-d6f25afe48ed tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1751 microversion: 2.20 time: 0.156630 Jul 20 19:32:55.530191 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 456/904] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:55 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:32:56.549032 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c09b5680-a033-4bf1-8aa0-cff40233540d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:56.549667 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c09b5680-a033-4bf1-8aa0-cff40233540d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:56.556211 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c09b5680-a033-4bf1-8aa0-cff40233540d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:56.556659 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c09b5680-a033-4bf1-8aa0-cff40233540d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:56.557418 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c09b5680-a033-4bf1-8aa0-cff40233540d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:56.558023 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c09b5680-a033-4bf1-8aa0-cff40233540d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:56.695981 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c09b5680-a033-4bf1-8aa0-cff40233540d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:56.705039 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c09b5680-a033-4bf1-8aa0-cff40233540d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:56.706578 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c09b5680-a033-4bf1-8aa0-cff40233540d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:56.707746 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c09b5680-a033-4bf1-8aa0-cff40233540d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.163349 Jul 20 19:32:56.708310 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 449/905] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:56 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:32:57.725699 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-87f42666-5b20-41cf-921c-08a48d5bc1d7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:57.726331 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-87f42666-5b20-41cf-921c-08a48d5bc1d7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:57.733102 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-87f42666-5b20-41cf-921c-08a48d5bc1d7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:57.733581 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-87f42666-5b20-41cf-921c-08a48d5bc1d7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:57.734348 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-87f42666-5b20-41cf-921c-08a48d5bc1d7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:57.734779 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-87f42666-5b20-41cf-921c-08a48d5bc1d7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:57.865105 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-87f42666-5b20-41cf-921c-08a48d5bc1d7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:57.874273 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-87f42666-5b20-41cf-921c-08a48d5bc1d7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:57.875849 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-87f42666-5b20-41cf-921c-08a48d5bc1d7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:57.877006 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-87f42666-5b20-41cf-921c-08a48d5bc1d7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.155229 Jul 20 19:32:57.877585 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 457/906] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:57 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:32:58.895132 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c81e5e30-320c-4b23-9650-658e18991900 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:58.895703 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c81e5e30-320c-4b23-9650-658e18991900 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:58.902319 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c81e5e30-320c-4b23-9650-658e18991900 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:58.902767 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c81e5e30-320c-4b23-9650-658e18991900 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:58.903535 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c81e5e30-320c-4b23-9650-658e18991900 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:58.903972 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c81e5e30-320c-4b23-9650-658e18991900 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:59.040199 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c81e5e30-320c-4b23-9650-658e18991900 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:59.049050 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c81e5e30-320c-4b23-9650-658e18991900 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:59.050608 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c81e5e30-320c-4b23-9650-658e18991900 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:59.051757 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c81e5e30-320c-4b23-9650-658e18991900 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.160692 Jul 20 19:32:59.052305 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 450/907] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:58 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:33:00.069445 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-e66d1ac8-6080-4d61-bb95-f88fac2cab05 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:00.070078 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-e66d1ac8-6080-4d61-bb95-f88fac2cab05 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:00.076549 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e66d1ac8-6080-4d61-bb95-f88fac2cab05 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:00.076995 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e66d1ac8-6080-4d61-bb95-f88fac2cab05 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:00.077788 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e66d1ac8-6080-4d61-bb95-f88fac2cab05 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:00.078224 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e66d1ac8-6080-4d61-bb95-f88fac2cab05 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:00.209687 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-e66d1ac8-6080-4d61-bb95-f88fac2cab05 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:00.218774 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-e66d1ac8-6080-4d61-bb95-f88fac2cab05 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:00.220470 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-e66d1ac8-6080-4d61-bb95-f88fac2cab05 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:00.221656 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-e66d1ac8-6080-4d61-bb95-f88fac2cab05 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.156012 Jul 20 19:33:00.222212 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 458/908] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:33:00 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:33:01.239544 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-f5c31a67-5272-46f1-80c0-420098a1cc6a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:01.240158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-f5c31a67-5272-46f1-80c0-420098a1cc6a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:01.246770 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f5c31a67-5272-46f1-80c0-420098a1cc6a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:01.247222 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f5c31a67-5272-46f1-80c0-420098a1cc6a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:01.248688 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f5c31a67-5272-46f1-80c0-420098a1cc6a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:01.249129 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f5c31a67-5272-46f1-80c0-420098a1cc6a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:01.380441 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-f5c31a67-5272-46f1-80c0-420098a1cc6a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:01.388718 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-f5c31a67-5272-46f1-80c0-420098a1cc6a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:01.390263 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-f5c31a67-5272-46f1-80c0-420098a1cc6a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:01.391422 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-f5c31a67-5272-46f1-80c0-420098a1cc6a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.155787 Jul 20 19:33:01.391979 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 451/909] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:33:01 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:33:02.409615 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-f2625884-e53b-4015-b289-ee0b933f7352 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:02.410217 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-f2625884-e53b-4015-b289-ee0b933f7352 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:02.417724 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f2625884-e53b-4015-b289-ee0b933f7352 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:02.418168 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f2625884-e53b-4015-b289-ee0b933f7352 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:02.418928 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f2625884-e53b-4015-b289-ee0b933f7352 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:02.419354 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f2625884-e53b-4015-b289-ee0b933f7352 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:02.549154 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-f2625884-e53b-4015-b289-ee0b933f7352 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:02.558619 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-f2625884-e53b-4015-b289-ee0b933f7352 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:02.560150 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-f2625884-e53b-4015-b289-ee0b933f7352 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:02.562185 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-f2625884-e53b-4015-b289-ee0b933f7352 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.156486 Jul 20 19:33:02.562758 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 459/910] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:33:02 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:33:03.580355 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-9bed764d-56ce-4725-baa4-140d1964ac74 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:03.580926 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-9bed764d-56ce-4725-baa4-140d1964ac74 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:03.587361 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9bed764d-56ce-4725-baa4-140d1964ac74 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:03.587813 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9bed764d-56ce-4725-baa4-140d1964ac74 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:03.588582 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9bed764d-56ce-4725-baa4-140d1964ac74 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:03.589016 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9bed764d-56ce-4725-baa4-140d1964ac74 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:03.716873 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-9bed764d-56ce-4725-baa4-140d1964ac74 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:03.725217 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-9bed764d-56ce-4725-baa4-140d1964ac74 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:03.726768 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-9bed764d-56ce-4725-baa4-140d1964ac74 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:03.727967 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-9bed764d-56ce-4725-baa4-140d1964ac74 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.151621 Jul 20 19:33:03.728524 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 452/911] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:33:03 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:33:04.746920 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-1eff4e3d-4e88-49ac-9e01-f68dde1ddde9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:04.747635 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-1eff4e3d-4e88-49ac-9e01-f68dde1ddde9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:04.754860 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1eff4e3d-4e88-49ac-9e01-f68dde1ddde9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:04.755298 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1eff4e3d-4e88-49ac-9e01-f68dde1ddde9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:04.756045 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1eff4e3d-4e88-49ac-9e01-f68dde1ddde9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:04.756476 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1eff4e3d-4e88-49ac-9e01-f68dde1ddde9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:04.888070 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-1eff4e3d-4e88-49ac-9e01-f68dde1ddde9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:04.897181 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-1eff4e3d-4e88-49ac-9e01-f68dde1ddde9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:04.898722 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-1eff4e3d-4e88-49ac-9e01-f68dde1ddde9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:04.899876 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-1eff4e3d-4e88-49ac-9e01-f68dde1ddde9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.156949 Jul 20 19:33:04.900436 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 460/912] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:33:04 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:33:05.917699 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-2072a5b6-2fdc-494e-99e0-fd8bc2825a1f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:05.918321 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-2072a5b6-2fdc-494e-99e0-fd8bc2825a1f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:05.922880 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-188dbb19-5f8d-4678-a609-0e831c3af759 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:05.923364 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-188dbb19-5f8d-4678-a609-0e831c3af759 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:05.925668 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2072a5b6-2fdc-494e-99e0-fd8bc2825a1f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:05.926124 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2072a5b6-2fdc-494e-99e0-fd8bc2825a1f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:05.926896 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2072a5b6-2fdc-494e-99e0-fd8bc2825a1f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:05.927354 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2072a5b6-2fdc-494e-99e0-fd8bc2825a1f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:05.929766 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-188dbb19-5f8d-4678-a609-0e831c3af759 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:05.930215 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-188dbb19-5f8d-4678-a609-0e831c3af759 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:05.930969 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-188dbb19-5f8d-4678-a609-0e831c3af759 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:05.931397 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-188dbb19-5f8d-4678-a609-0e831c3af759 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:05.957177 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-188dbb19-5f8d-4678-a609-0e831c3af759 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Going to try to terminate instance {{(pid=117762) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 19:33:06.037680 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-188dbb19-5f8d-4678-a609-0e831c3af759 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "DELETE /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 204 len: 0 microversion: 2.1 time: 0.119098 Jul 20 19:33:06.038535 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 461/913] 10.222.0.69 () {58 vars in 1238 bytes} [Wed Jul 20 19:33:05 2022] DELETE /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 19:33:06.048664 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-532b85e9-2225-4815-aedb-e28cd305826e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:06.049372 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-532b85e9-2225-4815-aedb-e28cd305826e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:06.055412 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-532b85e9-2225-4815-aedb-e28cd305826e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:06.055865 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-532b85e9-2225-4815-aedb-e28cd305826e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:06.056644 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-532b85e9-2225-4815-aedb-e28cd305826e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:06.057082 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-532b85e9-2225-4815-aedb-e28cd305826e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:06.060403 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-2072a5b6-2fdc-494e-99e0-fd8bc2825a1f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:06.069477 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-2072a5b6-2fdc-494e-99e0-fd8bc2825a1f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:06.070996 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-2072a5b6-2fdc-494e-99e0-fd8bc2825a1f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:06.072153 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-2072a5b6-2fdc-494e-99e0-fd8bc2825a1f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.158617 Jul 20 19:33:06.072711 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 453/914] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:33:05 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:33:06.190395 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-532b85e9-2225-4815-aedb-e28cd305826e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:06.197869 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-532b85e9-2225-4815-aedb-e28cd305826e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1575 microversion: 2.1 time: 0.154926 Jul 20 19:33:06.198435 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 462/915] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:06 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:07.091174 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-da2b672d-cd31-452d-bb1a-ea424dc382f8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:07.091995 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-da2b672d-cd31-452d-bb1a-ea424dc382f8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:07.098444 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-da2b672d-cd31-452d-bb1a-ea424dc382f8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:07.098888 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-da2b672d-cd31-452d-bb1a-ea424dc382f8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:07.099647 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-da2b672d-cd31-452d-bb1a-ea424dc382f8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:07.100073 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-da2b672d-cd31-452d-bb1a-ea424dc382f8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:07.215541 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-7362ab3f-11bc-4ab0-88c6-a44ed4c9e0b2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:07.216186 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-7362ab3f-11bc-4ab0-88c6-a44ed4c9e0b2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:07.222854 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-7362ab3f-11bc-4ab0-88c6-a44ed4c9e0b2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:07.223308 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-7362ab3f-11bc-4ab0-88c6-a44ed4c9e0b2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:07.224079 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-7362ab3f-11bc-4ab0-88c6-a44ed4c9e0b2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:07.224517 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-7362ab3f-11bc-4ab0-88c6-a44ed4c9e0b2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:07.236401 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-da2b672d-cd31-452d-bb1a-ea424dc382f8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:07.244836 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-da2b672d-cd31-452d-bb1a-ea424dc382f8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:07.246447 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-da2b672d-cd31-452d-bb1a-ea424dc382f8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:07.247680 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-da2b672d-cd31-452d-bb1a-ea424dc382f8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.160422 Jul 20 19:33:07.249065 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 454/916] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:33:07 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:33:07.359531 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-7362ab3f-11bc-4ab0-88c6-a44ed4c9e0b2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:07.367339 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-7362ab3f-11bc-4ab0-88c6-a44ed4c9e0b2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1575 microversion: 2.1 time: 0.155372 Jul 20 19:33:07.367895 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 463/917] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:07 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:33:08.267115 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a453a79b-026b-423d-a41d-9a8b0f0ffad3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:08.267727 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a453a79b-026b-423d-a41d-9a8b0f0ffad3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:08.274288 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a453a79b-026b-423d-a41d-9a8b0f0ffad3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:08.274740 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a453a79b-026b-423d-a41d-9a8b0f0ffad3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:08.275507 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a453a79b-026b-423d-a41d-9a8b0f0ffad3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:08.275944 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a453a79b-026b-423d-a41d-9a8b0f0ffad3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:08.385878 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-3da23ec3-9929-4bf5-aa79-ac0d76624749 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:08.386602 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-3da23ec3-9929-4bf5-aa79-ac0d76624749 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:08.394049 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3da23ec3-9929-4bf5-aa79-ac0d76624749 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:08.394496 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3da23ec3-9929-4bf5-aa79-ac0d76624749 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:08.395268 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3da23ec3-9929-4bf5-aa79-ac0d76624749 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:08.395700 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3da23ec3-9929-4bf5-aa79-ac0d76624749 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:08.550444 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-3da23ec3-9929-4bf5-aa79-ac0d76624749 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:08.559527 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-3da23ec3-9929-4bf5-aa79-ac0d76624749 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1575 microversion: 2.1 time: 0.177278 Jul 20 19:33:08.560886 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 464/918] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:08 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1575 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:33:08.707921 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a453a79b-026b-423d-a41d-9a8b0f0ffad3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:08.716484 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a453a79b-026b-423d-a41d-9a8b0f0ffad3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:08.718141 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a453a79b-026b-423d-a41d-9a8b0f0ffad3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:08.719328 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a453a79b-026b-423d-a41d-9a8b0f0ffad3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.456597 Jul 20 19:33:08.719887 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 455/919] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:33:08 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:33:09.522345 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [req-92ddc80a-e346-4067-bc88-10cc94628636 req-73d066ed-992b-4842-92bb-aef095ed9a3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0aee5176-53ab-4288-91da-4284ac2e443e", "name": "network-vif-deleted", "tag": "37f1f157-d172-4459-b70e-8eeade5eea75"}]} {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:33:09.543973 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [req-92ddc80a-e346-4067-bc88-10cc94628636 req-73d066ed-992b-4842-92bb-aef095ed9a3f service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:09.544512 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [req-92ddc80a-e346-4067-bc88-10cc94628636 req-73d066ed-992b-4842-92bb-aef095ed9a3f service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:09.564259 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.compute.server_external_events [req-92ddc80a-e346-4067-bc88-10cc94628636 req-73d066ed-992b-4842-92bb-aef095ed9a3f service nova] Creating event network-vif-deleted:37f1f157-d172-4459-b70e-8eeade5eea75 for instance 0aee5176-53ab-4288-91da-4284ac2e443e on hv-cinder-83538 Jul 20 19:33:09.578585 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-61b1f825-3d82-435e-8536-de5d95408bad tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:09.579119 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-61b1f825-3d82-435e-8536-de5d95408bad tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:09.593011 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-61b1f825-3d82-435e-8536-de5d95408bad tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:09.594269 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [req-92ddc80a-e346-4067-bc88-10cc94628636 req-73d066ed-992b-4842-92bb-aef095ed9a3f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070738 Jul 20 19:33:09.595432 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 465/920] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 19:33:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:33:09.595809 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-61b1f825-3d82-435e-8536-de5d95408bad tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:09.596658 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-61b1f825-3d82-435e-8536-de5d95408bad tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:09.597085 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-61b1f825-3d82-435e-8536-de5d95408bad tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:09.663475 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-61b1f825-3d82-435e-8536-de5d95408bad tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:09.671703 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-61b1f825-3d82-435e-8536-de5d95408bad tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.097806 Jul 20 19:33:09.672284 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 456/921] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:09 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:09.738683 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-c6741b8c-4964-4e90-9cac-c6e6e9743589 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:09.739435 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-c6741b8c-4964-4e90-9cac-c6e6e9743589 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:09.748686 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c6741b8c-4964-4e90-9cac-c6e6e9743589 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:09.749160 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c6741b8c-4964-4e90-9cac-c6e6e9743589 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:09.750600 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c6741b8c-4964-4e90-9cac-c6e6e9743589 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:09.751051 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c6741b8c-4964-4e90-9cac-c6e6e9743589 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:09.890081 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-c6741b8c-4964-4e90-9cac-c6e6e9743589 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:09.898896 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-c6741b8c-4964-4e90-9cac-c6e6e9743589 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:09.900492 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-c6741b8c-4964-4e90-9cac-c6e6e9743589 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:09.901983 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-c6741b8c-4964-4e90-9cac-c6e6e9743589 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.168340 Jul 20 19:33:09.903414 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 466/922] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:33:09 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:33:10.688595 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d936c51a-f12f-4ef0-a48e-afad3fec6aa6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:10.689387 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d936c51a-f12f-4ef0-a48e-afad3fec6aa6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:10.696151 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d936c51a-f12f-4ef0-a48e-afad3fec6aa6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:10.696606 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d936c51a-f12f-4ef0-a48e-afad3fec6aa6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:10.697412 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d936c51a-f12f-4ef0-a48e-afad3fec6aa6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:10.697925 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d936c51a-f12f-4ef0-a48e-afad3fec6aa6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:10.764744 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d936c51a-f12f-4ef0-a48e-afad3fec6aa6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:10.772843 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d936c51a-f12f-4ef0-a48e-afad3fec6aa6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.088243 Jul 20 19:33:10.773439 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 457/923] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:10 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:10.921782 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-6e6f52b2-d3e2-47d1-a7ce-6d8eec173d31 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:10.922553 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-6e6f52b2-d3e2-47d1-a7ce-6d8eec173d31 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:10.929492 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-6e6f52b2-d3e2-47d1-a7ce-6d8eec173d31 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:10.929982 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-6e6f52b2-d3e2-47d1-a7ce-6d8eec173d31 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:10.930760 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-6e6f52b2-d3e2-47d1-a7ce-6d8eec173d31 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:10.931203 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-6e6f52b2-d3e2-47d1-a7ce-6d8eec173d31 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:11.068895 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-6e6f52b2-d3e2-47d1-a7ce-6d8eec173d31 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:11.078293 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-6e6f52b2-d3e2-47d1-a7ce-6d8eec173d31 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:11.079806 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-6e6f52b2-d3e2-47d1-a7ce-6d8eec173d31 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:11.080963 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-6e6f52b2-d3e2-47d1-a7ce-6d8eec173d31 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.163649 Jul 20 19:33:11.081545 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 467/924] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:33:10 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:33:11.790489 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-65598f42-55d8-4ba3-8c1d-7bf41a528062 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:11.791054 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-65598f42-55d8-4ba3-8c1d-7bf41a528062 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:11.798058 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-65598f42-55d8-4ba3-8c1d-7bf41a528062 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:11.798508 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-65598f42-55d8-4ba3-8c1d-7bf41a528062 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:11.799276 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-65598f42-55d8-4ba3-8c1d-7bf41a528062 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:11.799715 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-65598f42-55d8-4ba3-8c1d-7bf41a528062 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:11.860760 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-65598f42-55d8-4ba3-8c1d-7bf41a528062 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:11.868271 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-65598f42-55d8-4ba3-8c1d-7bf41a528062 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.081766 Jul 20 19:33:11.868835 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 458/925] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:11 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:12.099834 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-1d01dcf2-c97b-4f54-843c-40d9bc3d3ee0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:12.100436 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-1d01dcf2-c97b-4f54-843c-40d9bc3d3ee0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:12.106920 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1d01dcf2-c97b-4f54-843c-40d9bc3d3ee0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:12.107353 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1d01dcf2-c97b-4f54-843c-40d9bc3d3ee0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:12.108157 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1d01dcf2-c97b-4f54-843c-40d9bc3d3ee0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:12.109338 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1d01dcf2-c97b-4f54-843c-40d9bc3d3ee0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:12.238739 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-1d01dcf2-c97b-4f54-843c-40d9bc3d3ee0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:12.247063 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-1d01dcf2-c97b-4f54-843c-40d9bc3d3ee0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:12.248574 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-1d01dcf2-c97b-4f54-843c-40d9bc3d3ee0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:12.250110 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-1d01dcf2-c97b-4f54-843c-40d9bc3d3ee0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.154106 Jul 20 19:33:12.250666 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 468/926] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:33:12 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:33:12.885541 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-fffb9d17-708b-403d-8b2a-44b495fee974 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:12.886108 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-fffb9d17-708b-403d-8b2a-44b495fee974 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:12.888346 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_api:SELECT=32 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:12.893834 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fffb9d17-708b-403d-8b2a-44b495fee974 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:12.894279 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fffb9d17-708b-403d-8b2a-44b495fee974 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:12.895044 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fffb9d17-708b-403d-8b2a-44b495fee974 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:12.895476 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fffb9d17-708b-403d-8b2a-44b495fee974 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:12.961904 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-fffb9d17-708b-403d-8b2a-44b495fee974 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:12.970079 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-fffb9d17-708b-403d-8b2a-44b495fee974 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.088481 Jul 20 19:33:12.970632 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 459/927] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:12 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:13.268820 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-2ac6a415-b5d1-40c5-899b-cab94a98d8e0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:13.269454 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-2ac6a415-b5d1-40c5-899b-cab94a98d8e0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:13.275974 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2ac6a415-b5d1-40c5-899b-cab94a98d8e0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:13.276423 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2ac6a415-b5d1-40c5-899b-cab94a98d8e0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:13.277215 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2ac6a415-b5d1-40c5-899b-cab94a98d8e0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:13.277932 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2ac6a415-b5d1-40c5-899b-cab94a98d8e0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:13.405351 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-2ac6a415-b5d1-40c5-899b-cab94a98d8e0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:13.414434 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-2ac6a415-b5d1-40c5-899b-cab94a98d8e0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:13.415945 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-2ac6a415-b5d1-40c5-899b-cab94a98d8e0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:13.417102 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-2ac6a415-b5d1-40c5-899b-cab94a98d8e0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.152750 Jul 20 19:33:13.417689 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 469/928] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:33:13 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:33:13.986647 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-183926b4-ddb0-4130-8b09-0452ff40495d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:13.987254 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-183926b4-ddb0-4130-8b09-0452ff40495d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:13.993742 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-183926b4-ddb0-4130-8b09-0452ff40495d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:13.994200 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-183926b4-ddb0-4130-8b09-0452ff40495d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:13.994971 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-183926b4-ddb0-4130-8b09-0452ff40495d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:13.995411 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-183926b4-ddb0-4130-8b09-0452ff40495d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:14.058312 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-183926b4-ddb0-4130-8b09-0452ff40495d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:14.065829 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-183926b4-ddb0-4130-8b09-0452ff40495d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.083035 Jul 20 19:33:14.066398 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 460/929] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:13 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:14.436389 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-fc7c0f95-b790-4451-bf01-5804e9c390de tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:14.436960 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-fc7c0f95-b790-4451-bf01-5804e9c390de tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:14.443903 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-fc7c0f95-b790-4451-bf01-5804e9c390de tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:14.444346 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-fc7c0f95-b790-4451-bf01-5804e9c390de tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:14.445132 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-fc7c0f95-b790-4451-bf01-5804e9c390de tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:14.445586 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-fc7c0f95-b790-4451-bf01-5804e9c390de tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:14.577165 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-fc7c0f95-b790-4451-bf01-5804e9c390de tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:14.586711 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-fc7c0f95-b790-4451-bf01-5804e9c390de tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:14.588200 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-fc7c0f95-b790-4451-bf01-5804e9c390de tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:14.589336 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-fc7c0f95-b790-4451-bf01-5804e9c390de tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.157396 Jul 20 19:33:14.589919 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 470/930] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:33:14 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:33:15.082802 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-3b94cbd7-d694-4713-93fd-c6441961533c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:15.083411 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-3b94cbd7-d694-4713-93fd-c6441961533c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:15.090091 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3b94cbd7-d694-4713-93fd-c6441961533c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:15.090540 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3b94cbd7-d694-4713-93fd-c6441961533c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:15.091297 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3b94cbd7-d694-4713-93fd-c6441961533c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:15.091729 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3b94cbd7-d694-4713-93fd-c6441961533c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:15.151422 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3b94cbd7-d694-4713-93fd-c6441961533c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:15.159405 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-3b94cbd7-d694-4713-93fd-c6441961533c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080457 Jul 20 19:33:15.159960 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 461/931] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:15 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:15.607620 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-76c90200-cc25-4115-9aa6-30f87ac4eebb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:15.608212 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-76c90200-cc25-4115-9aa6-30f87ac4eebb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:15.615001 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-76c90200-cc25-4115-9aa6-30f87ac4eebb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:15.615450 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-76c90200-cc25-4115-9aa6-30f87ac4eebb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:15.616206 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-76c90200-cc25-4115-9aa6-30f87ac4eebb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:15.616642 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-76c90200-cc25-4115-9aa6-30f87ac4eebb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:15.742664 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-76c90200-cc25-4115-9aa6-30f87ac4eebb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:15.744959 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:15.752833 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-76c90200-cc25-4115-9aa6-30f87ac4eebb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:15.754411 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-76c90200-cc25-4115-9aa6-30f87ac4eebb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:15.755595 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-76c90200-cc25-4115-9aa6-30f87ac4eebb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.151987 Jul 20 19:33:15.756148 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 471/932] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:33:15 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:33:16.175222 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a92e5d14-895c-40f6-a145-9d297cbedca5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:16.175831 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a92e5d14-895c-40f6-a145-9d297cbedca5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:16.182371 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a92e5d14-895c-40f6-a145-9d297cbedca5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:16.182817 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a92e5d14-895c-40f6-a145-9d297cbedca5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:16.183576 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a92e5d14-895c-40f6-a145-9d297cbedca5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:16.184108 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a92e5d14-895c-40f6-a145-9d297cbedca5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:16.245824 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a92e5d14-895c-40f6-a145-9d297cbedca5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:16.248014 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:16.255406 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a92e5d14-895c-40f6-a145-9d297cbedca5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.084245 Jul 20 19:33:16.255963 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 462/933] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:16 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:16.774316 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-45df9c93-ec27-4756-82fa-54f4538859c9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:16.774898 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-45df9c93-ec27-4756-82fa-54f4538859c9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:16.782656 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-45df9c93-ec27-4756-82fa-54f4538859c9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:16.783101 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-45df9c93-ec27-4756-82fa-54f4538859c9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:16.783877 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-45df9c93-ec27-4756-82fa-54f4538859c9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:16.784310 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-45df9c93-ec27-4756-82fa-54f4538859c9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:16.921428 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-45df9c93-ec27-4756-82fa-54f4538859c9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:16.930925 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-45df9c93-ec27-4756-82fa-54f4538859c9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:16.932436 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-45df9c93-ec27-4756-82fa-54f4538859c9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:16.933690 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-45df9c93-ec27-4756-82fa-54f4538859c9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.163182 Jul 20 19:33:16.934282 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 472/934] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:33:16 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:33:17.272203 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-f69b4705-0602-47e0-8480-dc35bd2ce906 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:17.272786 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-f69b4705-0602-47e0-8480-dc35bd2ce906 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:17.279285 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f69b4705-0602-47e0-8480-dc35bd2ce906 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:17.279727 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f69b4705-0602-47e0-8480-dc35bd2ce906 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:17.280482 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f69b4705-0602-47e0-8480-dc35bd2ce906 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:17.280911 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f69b4705-0602-47e0-8480-dc35bd2ce906 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:17.349524 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-f69b4705-0602-47e0-8480-dc35bd2ce906 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:17.357382 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-f69b4705-0602-47e0-8480-dc35bd2ce906 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.088989 Jul 20 19:33:17.357993 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 463/935] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:17 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:17.955214 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-bab7d8f0-461e-4893-9ee0-48cb719bb34b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:17.955802 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-bab7d8f0-461e-4893-9ee0-48cb719bb34b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:17.962714 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-bab7d8f0-461e-4893-9ee0-48cb719bb34b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:17.963161 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-bab7d8f0-461e-4893-9ee0-48cb719bb34b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:17.963925 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-bab7d8f0-461e-4893-9ee0-48cb719bb34b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:17.964361 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-bab7d8f0-461e-4893-9ee0-48cb719bb34b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:18.099537 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-bab7d8f0-461e-4893-9ee0-48cb719bb34b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:18.108001 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-bab7d8f0-461e-4893-9ee0-48cb719bb34b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:18.109533 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-bab7d8f0-461e-4893-9ee0-48cb719bb34b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:18.110709 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-bab7d8f0-461e-4893-9ee0-48cb719bb34b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.161413 Jul 20 19:33:18.111321 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 473/936] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:33:17 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:33:18.374816 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-11d585bb-7b63-42fd-af7b-42e74168d4f0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:18.375974 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-11d585bb-7b63-42fd-af7b-42e74168d4f0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:18.382539 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-11d585bb-7b63-42fd-af7b-42e74168d4f0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:18.382991 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-11d585bb-7b63-42fd-af7b-42e74168d4f0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:18.383760 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-11d585bb-7b63-42fd-af7b-42e74168d4f0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:18.384197 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-11d585bb-7b63-42fd-af7b-42e74168d4f0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:18.445306 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-11d585bb-7b63-42fd-af7b-42e74168d4f0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:18.452805 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-11d585bb-7b63-42fd-af7b-42e74168d4f0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.081888 Jul 20 19:33:18.454251 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 464/937] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:18 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:19.129151 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-8e3c7bc9-7855-4152-ae53-f499979f47e5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:19.129841 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-8e3c7bc9-7855-4152-ae53-f499979f47e5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:19.135810 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8e3c7bc9-7855-4152-ae53-f499979f47e5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:19.136260 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8e3c7bc9-7855-4152-ae53-f499979f47e5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:19.137020 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8e3c7bc9-7855-4152-ae53-f499979f47e5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:19.137457 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8e3c7bc9-7855-4152-ae53-f499979f47e5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:19.268092 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-8e3c7bc9-7855-4152-ae53-f499979f47e5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:19.276464 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-8e3c7bc9-7855-4152-ae53-f499979f47e5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:19.277996 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-8e3c7bc9-7855-4152-ae53-f499979f47e5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:19.279140 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-8e3c7bc9-7855-4152-ae53-f499979f47e5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.154230 Jul 20 19:33:19.279688 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 474/938] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:33:19 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:33:19.471395 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-3387fadd-8695-4d91-8d26-468007287b93 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:19.471998 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-3387fadd-8695-4d91-8d26-468007287b93 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:19.478414 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3387fadd-8695-4d91-8d26-468007287b93 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:19.478857 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3387fadd-8695-4d91-8d26-468007287b93 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:19.479614 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3387fadd-8695-4d91-8d26-468007287b93 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:19.480042 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3387fadd-8695-4d91-8d26-468007287b93 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:19.540854 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3387fadd-8695-4d91-8d26-468007287b93 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:19.548519 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-3387fadd-8695-4d91-8d26-468007287b93 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.081833 Jul 20 19:33:19.549083 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 465/939] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:19 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:20.298722 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-15cbb1b9-b18d-4ac9-9370-2ae3f2bee9a2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:20.299306 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-15cbb1b9-b18d-4ac9-9370-2ae3f2bee9a2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:20.305751 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-15cbb1b9-b18d-4ac9-9370-2ae3f2bee9a2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:20.306192 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-15cbb1b9-b18d-4ac9-9370-2ae3f2bee9a2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:20.306934 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-15cbb1b9-b18d-4ac9-9370-2ae3f2bee9a2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:20.307360 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-15cbb1b9-b18d-4ac9-9370-2ae3f2bee9a2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:20.436248 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-15cbb1b9-b18d-4ac9-9370-2ae3f2bee9a2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:20.445017 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-15cbb1b9-b18d-4ac9-9370-2ae3f2bee9a2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:20.446590 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-15cbb1b9-b18d-4ac9-9370-2ae3f2bee9a2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:20.447745 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-15cbb1b9-b18d-4ac9-9370-2ae3f2bee9a2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.153658 Jul 20 19:33:20.448298 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 475/940] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:33:20 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:33:20.564763 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-0f34e8ba-7dac-43fd-8727-1c6f6e6f71dc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:20.565374 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-0f34e8ba-7dac-43fd-8727-1c6f6e6f71dc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:20.571909 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0f34e8ba-7dac-43fd-8727-1c6f6e6f71dc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:20.572359 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0f34e8ba-7dac-43fd-8727-1c6f6e6f71dc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:20.573125 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0f34e8ba-7dac-43fd-8727-1c6f6e6f71dc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:20.573589 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0f34e8ba-7dac-43fd-8727-1c6f6e6f71dc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:20.634527 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0f34e8ba-7dac-43fd-8727-1c6f6e6f71dc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:20.642761 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-0f34e8ba-7dac-43fd-8727-1c6f6e6f71dc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.082025 Jul 20 19:33:20.643273 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 466/941] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:20 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:21.466806 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-15ccd910-4500-4c54-af0a-47e8fa3b81a2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:21.467413 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-15ccd910-4500-4c54-af0a-47e8fa3b81a2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:21.474594 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-15ccd910-4500-4c54-af0a-47e8fa3b81a2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:21.475044 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-15ccd910-4500-4c54-af0a-47e8fa3b81a2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:21.475807 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-15ccd910-4500-4c54-af0a-47e8fa3b81a2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:21.476241 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-15ccd910-4500-4c54-af0a-47e8fa3b81a2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:21.610331 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-15ccd910-4500-4c54-af0a-47e8fa3b81a2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:21.618938 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-15ccd910-4500-4c54-af0a-47e8fa3b81a2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:21.620440 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-15ccd910-4500-4c54-af0a-47e8fa3b81a2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:21.621604 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-15ccd910-4500-4c54-af0a-47e8fa3b81a2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.158886 Jul 20 19:33:21.622165 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 476/942] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:33:21 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:33:21.660214 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c9e7e58d-3ea2-43a1-9220-2e461741ff2c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:21.660823 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c9e7e58d-3ea2-43a1-9220-2e461741ff2c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:21.667283 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c9e7e58d-3ea2-43a1-9220-2e461741ff2c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:21.667731 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c9e7e58d-3ea2-43a1-9220-2e461741ff2c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:21.668491 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c9e7e58d-3ea2-43a1-9220-2e461741ff2c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:21.668921 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c9e7e58d-3ea2-43a1-9220-2e461741ff2c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:21.734985 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c9e7e58d-3ea2-43a1-9220-2e461741ff2c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:21.742461 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c9e7e58d-3ea2-43a1-9220-2e461741ff2c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.086680 Jul 20 19:33:21.743034 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 467/943] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:21 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:22.639293 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-6cd838bf-4c57-4818-a911-39bed7d640e5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:22.639889 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-6cd838bf-4c57-4818-a911-39bed7d640e5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:22.646687 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-6cd838bf-4c57-4818-a911-39bed7d640e5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:22.647140 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-6cd838bf-4c57-4818-a911-39bed7d640e5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:22.647899 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-6cd838bf-4c57-4818-a911-39bed7d640e5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:22.648335 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-6cd838bf-4c57-4818-a911-39bed7d640e5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:22.758676 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-9a90d175-19ae-4e23-9208-301658feeaec tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:22.759373 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-9a90d175-19ae-4e23-9208-301658feeaec tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:22.765469 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9a90d175-19ae-4e23-9208-301658feeaec tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:22.766684 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9a90d175-19ae-4e23-9208-301658feeaec tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:22.767558 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9a90d175-19ae-4e23-9208-301658feeaec tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:22.768004 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9a90d175-19ae-4e23-9208-301658feeaec tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:22.785131 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-6cd838bf-4c57-4818-a911-39bed7d640e5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:22.793536 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-6cd838bf-4c57-4818-a911-39bed7d640e5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:22.795049 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-6cd838bf-4c57-4818-a911-39bed7d640e5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:22.796201 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-6cd838bf-4c57-4818-a911-39bed7d640e5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.160794 Jul 20 19:33:22.796834 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 477/944] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:33:22 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:33:22.829817 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-9a90d175-19ae-4e23-9208-301658feeaec tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:22.837666 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-9a90d175-19ae-4e23-9208-301658feeaec tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.082781 Jul 20 19:33:22.838231 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 468/945] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:22 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:33:23.813956 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-15e147f1-c58d-4c56-873c-429e506f9b73 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:23.814542 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-15e147f1-c58d-4c56-873c-429e506f9b73 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:23.816865 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:23.822812 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-15e147f1-c58d-4c56-873c-429e506f9b73 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:23.823264 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-15e147f1-c58d-4c56-873c-429e506f9b73 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:23.824048 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-15e147f1-c58d-4c56-873c-429e506f9b73 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:23.824485 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-15e147f1-c58d-4c56-873c-429e506f9b73 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:23.854290 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-db9ec7a3-687c-452c-a06d-bd18f7979665 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:23.855530 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-db9ec7a3-687c-452c-a06d-bd18f7979665 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:23.862272 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-db9ec7a3-687c-452c-a06d-bd18f7979665 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:23.862733 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-db9ec7a3-687c-452c-a06d-bd18f7979665 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:23.863512 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-db9ec7a3-687c-452c-a06d-bd18f7979665 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:23.863947 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-db9ec7a3-687c-452c-a06d-bd18f7979665 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:23.926506 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-db9ec7a3-687c-452c-a06d-bd18f7979665 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:23.934142 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-db9ec7a3-687c-452c-a06d-bd18f7979665 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.083701 Jul 20 19:33:23.934802 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 469/946] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:23 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:33:23.958019 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-15e147f1-c58d-4c56-873c-429e506f9b73 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:23.966692 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-15e147f1-c58d-4c56-873c-429e506f9b73 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:23.968208 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-15e147f1-c58d-4c56-873c-429e506f9b73 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:23.970221 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-15e147f1-c58d-4c56-873c-429e506f9b73 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.160219 Jul 20 19:33:23.970770 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 478/947] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:33:23 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:33:24.951903 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4ab0dce2-e988-4803-9945-7dd11d6e3d08 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:24.952493 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-4ab0dce2-e988-4803-9945-7dd11d6e3d08 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:24.959101 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4ab0dce2-e988-4803-9945-7dd11d6e3d08 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:24.959543 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4ab0dce2-e988-4803-9945-7dd11d6e3d08 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:24.960296 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4ab0dce2-e988-4803-9945-7dd11d6e3d08 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:24.961009 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4ab0dce2-e988-4803-9945-7dd11d6e3d08 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:24.988449 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-a0fa4d3a-bd22-4223-8624-52d7eb9b0467 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:24.989048 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-a0fa4d3a-bd22-4223-8624-52d7eb9b0467 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:24.995879 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a0fa4d3a-bd22-4223-8624-52d7eb9b0467 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:24.996329 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a0fa4d3a-bd22-4223-8624-52d7eb9b0467 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:24.997091 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a0fa4d3a-bd22-4223-8624-52d7eb9b0467 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:24.997537 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a0fa4d3a-bd22-4223-8624-52d7eb9b0467 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:25.022398 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-4ab0dce2-e988-4803-9945-7dd11d6e3d08 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:25.029872 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-4ab0dce2-e988-4803-9945-7dd11d6e3d08 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.081862 Jul 20 19:33:25.030629 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 470/948] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:24 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:25.129693 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-a0fa4d3a-bd22-4223-8624-52d7eb9b0467 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:25.138181 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-a0fa4d3a-bd22-4223-8624-52d7eb9b0467 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:25.139686 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-a0fa4d3a-bd22-4223-8624-52d7eb9b0467 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:25.140958 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-a0fa4d3a-bd22-4223-8624-52d7eb9b0467 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.156731 Jul 20 19:33:25.141610 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 479/949] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:33:24 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:33:26.046776 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e1f176d4-7868-470a-bbb9-3791d4f0201d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:26.047412 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e1f176d4-7868-470a-bbb9-3791d4f0201d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:26.053955 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e1f176d4-7868-470a-bbb9-3791d4f0201d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:26.054407 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e1f176d4-7868-470a-bbb9-3791d4f0201d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:26.055176 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e1f176d4-7868-470a-bbb9-3791d4f0201d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:26.055611 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e1f176d4-7868-470a-bbb9-3791d4f0201d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:26.120294 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e1f176d4-7868-470a-bbb9-3791d4f0201d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:26.127969 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e1f176d4-7868-470a-bbb9-3791d4f0201d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.085065 Jul 20 19:33:26.128530 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 471/950] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:26 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:26.159660 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-322ab387-9ec3-4cb6-99ed-89fc2ce3f574 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:26.160259 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-322ab387-9ec3-4cb6-99ed-89fc2ce3f574 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:26.166757 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-322ab387-9ec3-4cb6-99ed-89fc2ce3f574 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:26.167231 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-322ab387-9ec3-4cb6-99ed-89fc2ce3f574 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:26.167983 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-322ab387-9ec3-4cb6-99ed-89fc2ce3f574 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:26.168441 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-322ab387-9ec3-4cb6-99ed-89fc2ce3f574 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:26.295427 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-322ab387-9ec3-4cb6-99ed-89fc2ce3f574 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:26.303791 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-322ab387-9ec3-4cb6-99ed-89fc2ce3f574 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:26.305328 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-322ab387-9ec3-4cb6-99ed-89fc2ce3f574 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:26.306530 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-322ab387-9ec3-4cb6-99ed-89fc2ce3f574 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.151400 Jul 20 19:33:26.307086 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 480/951] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:33:26 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:33:27.212734 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4c9e826a-b058-4dde-8f6c-69c5aa97975c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:27.213342 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-4c9e826a-b058-4dde-8f6c-69c5aa97975c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:27.219781 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4c9e826a-b058-4dde-8f6c-69c5aa97975c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:27.220221 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4c9e826a-b058-4dde-8f6c-69c5aa97975c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:27.220974 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4c9e826a-b058-4dde-8f6c-69c5aa97975c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:27.221403 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4c9e826a-b058-4dde-8f6c-69c5aa97975c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:27.282244 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-4c9e826a-b058-4dde-8f6c-69c5aa97975c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:27.289810 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-4c9e826a-b058-4dde-8f6c-69c5aa97975c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.149117 Jul 20 19:33:27.290513 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 472/952] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:27 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:27.325077 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-c13b8518-a3c4-4ca9-8fe4-2375b23a64db tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:27.325712 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-c13b8518-a3c4-4ca9-8fe4-2375b23a64db tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:27.332357 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c13b8518-a3c4-4ca9-8fe4-2375b23a64db tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:27.332804 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c13b8518-a3c4-4ca9-8fe4-2375b23a64db tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:27.333600 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c13b8518-a3c4-4ca9-8fe4-2375b23a64db tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:27.334038 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c13b8518-a3c4-4ca9-8fe4-2375b23a64db tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:27.465007 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-c13b8518-a3c4-4ca9-8fe4-2375b23a64db tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:27.474231 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-c13b8518-a3c4-4ca9-8fe4-2375b23a64db tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:27.475813 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-c13b8518-a3c4-4ca9-8fe4-2375b23a64db tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:27.476957 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-c13b8518-a3c4-4ca9-8fe4-2375b23a64db tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.155809 Jul 20 19:33:27.477535 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 481/953] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:33:27 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:33:28.307259 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4dcea576-ba0f-47ce-96ed-bdf1449a29a2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:28.307873 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-4dcea576-ba0f-47ce-96ed-bdf1449a29a2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:28.315157 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4dcea576-ba0f-47ce-96ed-bdf1449a29a2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:28.315607 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4dcea576-ba0f-47ce-96ed-bdf1449a29a2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:28.316387 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4dcea576-ba0f-47ce-96ed-bdf1449a29a2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:28.316819 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4dcea576-ba0f-47ce-96ed-bdf1449a29a2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:28.382487 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-4dcea576-ba0f-47ce-96ed-bdf1449a29a2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:28.389909 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-4dcea576-ba0f-47ce-96ed-bdf1449a29a2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.086483 Jul 20 19:33:28.390493 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 473/954] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:28 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:28.494076 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-2d55b110-8247-4765-9fd7-f704abcdc4f1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:28.494697 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-2d55b110-8247-4765-9fd7-f704abcdc4f1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:28.501780 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2d55b110-8247-4765-9fd7-f704abcdc4f1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:28.502228 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2d55b110-8247-4765-9fd7-f704abcdc4f1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:28.502988 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2d55b110-8247-4765-9fd7-f704abcdc4f1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:28.503424 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2d55b110-8247-4765-9fd7-f704abcdc4f1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:28.633301 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-2d55b110-8247-4765-9fd7-f704abcdc4f1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:28.641889 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-2d55b110-8247-4765-9fd7-f704abcdc4f1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:28.643405 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-2d55b110-8247-4765-9fd7-f704abcdc4f1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:28.644635 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-2d55b110-8247-4765-9fd7-f704abcdc4f1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.154406 Jul 20 19:33:28.645145 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 482/955] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:33:28 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:33:29.406432 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-75a7bbb5-e37f-4a38-9766-5aa55685c3a7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:29.407104 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-75a7bbb5-e37f-4a38-9766-5aa55685c3a7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:29.413526 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-75a7bbb5-e37f-4a38-9766-5aa55685c3a7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:29.413995 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-75a7bbb5-e37f-4a38-9766-5aa55685c3a7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:29.414759 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-75a7bbb5-e37f-4a38-9766-5aa55685c3a7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:29.415195 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-75a7bbb5-e37f-4a38-9766-5aa55685c3a7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:29.476977 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-75a7bbb5-e37f-4a38-9766-5aa55685c3a7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:29.484594 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-75a7bbb5-e37f-4a38-9766-5aa55685c3a7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.081860 Jul 20 19:33:29.485240 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 474/956] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:29 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:29.662855 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-5f65fb9c-4034-4390-8b50-13a6553aaf1e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:29.663464 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-5f65fb9c-4034-4390-8b50-13a6553aaf1e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:29.670039 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-5f65fb9c-4034-4390-8b50-13a6553aaf1e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:29.670492 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-5f65fb9c-4034-4390-8b50-13a6553aaf1e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:29.671249 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-5f65fb9c-4034-4390-8b50-13a6553aaf1e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:29.671682 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-5f65fb9c-4034-4390-8b50-13a6553aaf1e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:29.804522 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-5f65fb9c-4034-4390-8b50-13a6553aaf1e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:29.813557 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-5f65fb9c-4034-4390-8b50-13a6553aaf1e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:29.815102 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-5f65fb9c-4034-4390-8b50-13a6553aaf1e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:29.816256 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-5f65fb9c-4034-4390-8b50-13a6553aaf1e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.157290 Jul 20 19:33:29.816812 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 483/957] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:33:29 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:33:30.501759 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-8bda186a-3264-403a-a8d7-1bd692d48c9f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:30.502361 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-8bda186a-3264-403a-a8d7-1bd692d48c9f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:30.508749 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8bda186a-3264-403a-a8d7-1bd692d48c9f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:30.509196 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8bda186a-3264-403a-a8d7-1bd692d48c9f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:30.509987 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8bda186a-3264-403a-a8d7-1bd692d48c9f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:30.510422 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8bda186a-3264-403a-a8d7-1bd692d48c9f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:30.575108 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8bda186a-3264-403a-a8d7-1bd692d48c9f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:30.583574 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-8bda186a-3264-403a-a8d7-1bd692d48c9f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.085725 Jul 20 19:33:30.584139 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 475/958] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:30 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:30.835012 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-c071c393-e90a-4385-a522-7ff15cbb5afa tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:30.835556 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-c071c393-e90a-4385-a522-7ff15cbb5afa tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:30.842449 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c071c393-e90a-4385-a522-7ff15cbb5afa tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:30.842902 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c071c393-e90a-4385-a522-7ff15cbb5afa tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:30.843666 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c071c393-e90a-4385-a522-7ff15cbb5afa tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:30.844111 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c071c393-e90a-4385-a522-7ff15cbb5afa tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:30.976363 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-c071c393-e90a-4385-a522-7ff15cbb5afa tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:30.985132 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-c071c393-e90a-4385-a522-7ff15cbb5afa tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:30.986694 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-c071c393-e90a-4385-a522-7ff15cbb5afa tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:30.987848 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-c071c393-e90a-4385-a522-7ff15cbb5afa tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.156808 Jul 20 19:33:30.988411 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 484/959] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:33:30 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:33:31.600966 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-b67fdb33-b8fc-4b0f-8feb-58893e321819 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:31.601491 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-b67fdb33-b8fc-4b0f-8feb-58893e321819 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:31.607995 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b67fdb33-b8fc-4b0f-8feb-58893e321819 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:31.608444 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b67fdb33-b8fc-4b0f-8feb-58893e321819 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:31.609200 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b67fdb33-b8fc-4b0f-8feb-58893e321819 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:31.610323 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b67fdb33-b8fc-4b0f-8feb-58893e321819 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:31.670808 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-b67fdb33-b8fc-4b0f-8feb-58893e321819 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:31.679031 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-b67fdb33-b8fc-4b0f-8feb-58893e321819 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.082056 Jul 20 19:33:31.679596 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 476/960] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:31 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:32.006450 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-4c06fc95-f098-48fd-a64b-e9118cc7dbd2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:32.007116 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-4c06fc95-f098-48fd-a64b-e9118cc7dbd2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:32.013581 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4c06fc95-f098-48fd-a64b-e9118cc7dbd2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:32.014033 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4c06fc95-f098-48fd-a64b-e9118cc7dbd2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:32.014796 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4c06fc95-f098-48fd-a64b-e9118cc7dbd2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:32.015226 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4c06fc95-f098-48fd-a64b-e9118cc7dbd2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:32.157023 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-4c06fc95-f098-48fd-a64b-e9118cc7dbd2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:32.165568 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-4c06fc95-f098-48fd-a64b-e9118cc7dbd2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:32.167084 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-4c06fc95-f098-48fd-a64b-e9118cc7dbd2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:32.168245 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-4c06fc95-f098-48fd-a64b-e9118cc7dbd2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.165716 Jul 20 19:33:32.168803 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 485/961] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:33:32 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:33:32.696171 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ffe83691-5f4f-4006-b402-880c41cacd84 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:32.696912 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ffe83691-5f4f-4006-b402-880c41cacd84 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:32.704216 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ffe83691-5f4f-4006-b402-880c41cacd84 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:32.704670 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ffe83691-5f4f-4006-b402-880c41cacd84 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:32.705447 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ffe83691-5f4f-4006-b402-880c41cacd84 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:32.705915 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ffe83691-5f4f-4006-b402-880c41cacd84 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:32.773906 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ffe83691-5f4f-4006-b402-880c41cacd84 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:32.781790 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ffe83691-5f4f-4006-b402-880c41cacd84 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.089398 Jul 20 19:33:32.782378 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 477/962] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:32 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:33.186324 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-d56a6752-c863-444d-94b7-0fc9df13d74e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:33.186925 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-d56a6752-c863-444d-94b7-0fc9df13d74e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:33.193974 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d56a6752-c863-444d-94b7-0fc9df13d74e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:33.194458 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d56a6752-c863-444d-94b7-0fc9df13d74e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:33.195221 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d56a6752-c863-444d-94b7-0fc9df13d74e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:33.195657 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d56a6752-c863-444d-94b7-0fc9df13d74e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:33.341020 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-d56a6752-c863-444d-94b7-0fc9df13d74e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:33.350090 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-d56a6752-c863-444d-94b7-0fc9df13d74e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:33.351627 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-d56a6752-c863-444d-94b7-0fc9df13d74e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:33.352816 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-d56a6752-c863-444d-94b7-0fc9df13d74e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.170410 Jul 20 19:33:33.353367 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 486/963] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:33:33 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:33:33.800271 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-939acde2-bd5d-40d3-9509-9b8278cdf355 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:33.800859 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-939acde2-bd5d-40d3-9509-9b8278cdf355 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:33.806919 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-939acde2-bd5d-40d3-9509-9b8278cdf355 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:33.807366 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-939acde2-bd5d-40d3-9509-9b8278cdf355 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:33.808144 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-939acde2-bd5d-40d3-9509-9b8278cdf355 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:33.808572 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-939acde2-bd5d-40d3-9509-9b8278cdf355 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:33.872260 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-939acde2-bd5d-40d3-9509-9b8278cdf355 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:33.881347 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-939acde2-bd5d-40d3-9509-9b8278cdf355 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.086317 Jul 20 19:33:33.882053 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 478/964] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:33 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:34.370970 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-fbbd7fa6-1bdf-47d6-915a-d7ebfd055c39 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:34.371570 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-fbbd7fa6-1bdf-47d6-915a-d7ebfd055c39 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:34.378702 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-fbbd7fa6-1bdf-47d6-915a-d7ebfd055c39 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:34.379078 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-fbbd7fa6-1bdf-47d6-915a-d7ebfd055c39 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:34.379830 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-fbbd7fa6-1bdf-47d6-915a-d7ebfd055c39 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:34.380258 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-fbbd7fa6-1bdf-47d6-915a-d7ebfd055c39 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:34.522414 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-fbbd7fa6-1bdf-47d6-915a-d7ebfd055c39 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:34.530947 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-fbbd7fa6-1bdf-47d6-915a-d7ebfd055c39 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:34.533091 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-fbbd7fa6-1bdf-47d6-915a-d7ebfd055c39 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:34.534276 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-fbbd7fa6-1bdf-47d6-915a-d7ebfd055c39 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.167231 Jul 20 19:33:34.534825 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 487/965] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:33:34 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:33:34.898802 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-6dddda66-9342-4540-9a48-126dba3306dd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:34.899416 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-6dddda66-9342-4540-9a48-126dba3306dd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:34.906221 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6dddda66-9342-4540-9a48-126dba3306dd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:34.906678 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6dddda66-9342-4540-9a48-126dba3306dd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:34.907452 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6dddda66-9342-4540-9a48-126dba3306dd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:34.907891 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6dddda66-9342-4540-9a48-126dba3306dd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:34.923720 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:34.978797 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6dddda66-9342-4540-9a48-126dba3306dd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:34.987492 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-6dddda66-9342-4540-9a48-126dba3306dd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.092427 Jul 20 19:33:34.988079 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 479/966] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:34 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:35.552420 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-d6aa9a53-86e7-4d8d-90b0-bb4b949589ef tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:35.553028 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-d6aa9a53-86e7-4d8d-90b0-bb4b949589ef tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:35.559783 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d6aa9a53-86e7-4d8d-90b0-bb4b949589ef tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:35.560239 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d6aa9a53-86e7-4d8d-90b0-bb4b949589ef tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:35.561023 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d6aa9a53-86e7-4d8d-90b0-bb4b949589ef tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:35.561459 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d6aa9a53-86e7-4d8d-90b0-bb4b949589ef tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:35.579302 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_cell1:SELECT=100 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:35.697826 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-d6aa9a53-86e7-4d8d-90b0-bb4b949589ef tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:35.707283 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-d6aa9a53-86e7-4d8d-90b0-bb4b949589ef tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:35.709036 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-d6aa9a53-86e7-4d8d-90b0-bb4b949589ef tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:35.710304 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-d6aa9a53-86e7-4d8d-90b0-bb4b949589ef tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.161767 Jul 20 19:33:35.711139 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 488/967] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:33:35 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:33:36.006139 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c2bed975-423d-4f74-aab5-a42eb09fb84a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:36.006738 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c2bed975-423d-4f74-aab5-a42eb09fb84a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:36.013225 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c2bed975-423d-4f74-aab5-a42eb09fb84a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:36.013712 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c2bed975-423d-4f74-aab5-a42eb09fb84a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:36.014480 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c2bed975-423d-4f74-aab5-a42eb09fb84a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:36.014917 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c2bed975-423d-4f74-aab5-a42eb09fb84a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:36.082674 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c2bed975-423d-4f74-aab5-a42eb09fb84a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:36.090502 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c2bed975-423d-4f74-aab5-a42eb09fb84a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.088974 Jul 20 19:33:36.091077 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 480/968] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:35 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:36.729389 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-cf47b924-9413-4304-b79e-30316f7ccc06 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:36.730185 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-cf47b924-9413-4304-b79e-30316f7ccc06 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:36.736875 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-cf47b924-9413-4304-b79e-30316f7ccc06 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:36.737320 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-cf47b924-9413-4304-b79e-30316f7ccc06 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:36.738109 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-cf47b924-9413-4304-b79e-30316f7ccc06 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:36.738544 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-cf47b924-9413-4304-b79e-30316f7ccc06 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:36.879530 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-cf47b924-9413-4304-b79e-30316f7ccc06 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:36.887966 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-cf47b924-9413-4304-b79e-30316f7ccc06 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:36.889475 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-cf47b924-9413-4304-b79e-30316f7ccc06 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:36.891320 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-cf47b924-9413-4304-b79e-30316f7ccc06 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.165202 Jul 20 19:33:36.891880 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 489/969] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:33:36 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:33:37.108056 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-7bc823c8-ce11-423d-b113-165a5e0ffc09 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:37.108626 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-7bc823c8-ce11-423d-b113-165a5e0ffc09 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:37.115338 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7bc823c8-ce11-423d-b113-165a5e0ffc09 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:37.115795 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7bc823c8-ce11-423d-b113-165a5e0ffc09 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:37.116557 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7bc823c8-ce11-423d-b113-165a5e0ffc09 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:37.116990 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7bc823c8-ce11-423d-b113-165a5e0ffc09 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:37.183249 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-7bc823c8-ce11-423d-b113-165a5e0ffc09 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:37.192142 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-7bc823c8-ce11-423d-b113-165a5e0ffc09 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.087878 Jul 20 19:33:37.193030 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 481/970] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:37 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:37.919954 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-6f4f3b1c-ed45-419b-9ea0-c55434a2549b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:37.920583 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-6f4f3b1c-ed45-419b-9ea0-c55434a2549b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:37.928969 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-6f4f3b1c-ed45-419b-9ea0-c55434a2549b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:37.929740 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-6f4f3b1c-ed45-419b-9ea0-c55434a2549b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:37.931039 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-6f4f3b1c-ed45-419b-9ea0-c55434a2549b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:37.931764 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-6f4f3b1c-ed45-419b-9ea0-c55434a2549b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:38.075967 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-6f4f3b1c-ed45-419b-9ea0-c55434a2549b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:38.087295 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-6f4f3b1c-ed45-419b-9ea0-c55434a2549b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:38.089068 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-6f4f3b1c-ed45-419b-9ea0-c55434a2549b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:38.092036 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-6f4f3b1c-ed45-419b-9ea0-c55434a2549b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.175484 Jul 20 19:33:38.094656 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 490/971] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:33:37 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:33:38.209145 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-87d4528c-8ff9-4bcd-9066-6f3c371ba9c8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:38.209703 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-87d4528c-8ff9-4bcd-9066-6f3c371ba9c8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:38.216508 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-87d4528c-8ff9-4bcd-9066-6f3c371ba9c8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:38.216961 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-87d4528c-8ff9-4bcd-9066-6f3c371ba9c8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:38.217769 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-87d4528c-8ff9-4bcd-9066-6f3c371ba9c8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:38.218207 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-87d4528c-8ff9-4bcd-9066-6f3c371ba9c8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:38.281681 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-87d4528c-8ff9-4bcd-9066-6f3c371ba9c8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:38.290077 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-87d4528c-8ff9-4bcd-9066-6f3c371ba9c8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.084730 Jul 20 19:33:38.290670 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 482/972] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:38 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:39.113115 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-f25470f6-d63a-4e3f-ada5-fd2f36a6419c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:39.113747 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-f25470f6-d63a-4e3f-ada5-fd2f36a6419c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:39.120733 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f25470f6-d63a-4e3f-ada5-fd2f36a6419c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:39.121174 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f25470f6-d63a-4e3f-ada5-fd2f36a6419c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:39.121980 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f25470f6-d63a-4e3f-ada5-fd2f36a6419c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:39.122411 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f25470f6-d63a-4e3f-ada5-fd2f36a6419c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:39.260874 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-f25470f6-d63a-4e3f-ada5-fd2f36a6419c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:39.272069 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-f25470f6-d63a-4e3f-ada5-fd2f36a6419c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:39.273628 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-f25470f6-d63a-4e3f-ada5-fd2f36a6419c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:39.274778 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-f25470f6-d63a-4e3f-ada5-fd2f36a6419c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.166359 Jul 20 19:33:39.275352 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 491/973] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:33:39 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:33:39.307066 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c7398edf-d4db-41b3-9eed-6b00657f6a24 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:39.307744 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c7398edf-d4db-41b3-9eed-6b00657f6a24 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:39.314771 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c7398edf-d4db-41b3-9eed-6b00657f6a24 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:39.315882 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c7398edf-d4db-41b3-9eed-6b00657f6a24 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:39.316700 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c7398edf-d4db-41b3-9eed-6b00657f6a24 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:39.317136 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c7398edf-d4db-41b3-9eed-6b00657f6a24 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:39.385647 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c7398edf-d4db-41b3-9eed-6b00657f6a24 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:39.394350 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c7398edf-d4db-41b3-9eed-6b00657f6a24 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.091122 Jul 20 19:33:39.394931 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 483/974] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:39 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:40.294544 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-b406eb89-2166-472b-8407-fe6e21ec7360 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:40.295125 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-b406eb89-2166-472b-8407-fe6e21ec7360 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:40.301742 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b406eb89-2166-472b-8407-fe6e21ec7360 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:40.302184 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b406eb89-2166-472b-8407-fe6e21ec7360 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:40.302926 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b406eb89-2166-472b-8407-fe6e21ec7360 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:40.303352 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b406eb89-2166-472b-8407-fe6e21ec7360 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:40.411410 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-809e35fc-e95d-4394-b8c2-fa030f949663 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:40.412127 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-809e35fc-e95d-4394-b8c2-fa030f949663 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:40.418746 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-809e35fc-e95d-4394-b8c2-fa030f949663 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:40.419190 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-809e35fc-e95d-4394-b8c2-fa030f949663 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:40.419951 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-809e35fc-e95d-4394-b8c2-fa030f949663 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:40.420379 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-809e35fc-e95d-4394-b8c2-fa030f949663 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:40.433228 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-b406eb89-2166-472b-8407-fe6e21ec7360 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:40.442643 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-b406eb89-2166-472b-8407-fe6e21ec7360 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:40.444144 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-b406eb89-2166-472b-8407-fe6e21ec7360 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:40.445290 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-b406eb89-2166-472b-8407-fe6e21ec7360 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.154618 Jul 20 19:33:40.445920 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 492/975] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:33:40 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:33:40.486625 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-809e35fc-e95d-4394-b8c2-fa030f949663 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:40.494074 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-809e35fc-e95d-4394-b8c2-fa030f949663 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.086517 Jul 20 19:33:40.494636 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 484/976] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:40 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:41.463476 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-92911f69-1833-4dca-aad2-18dc036bae1b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:41.464312 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-92911f69-1833-4dca-aad2-18dc036bae1b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:41.470837 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-92911f69-1833-4dca-aad2-18dc036bae1b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:41.471285 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-92911f69-1833-4dca-aad2-18dc036bae1b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:41.472051 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-92911f69-1833-4dca-aad2-18dc036bae1b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:41.472482 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-92911f69-1833-4dca-aad2-18dc036bae1b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:41.511849 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-940ad156-ea9e-40fe-b585-22c2495a9085 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:41.512801 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-940ad156-ea9e-40fe-b585-22c2495a9085 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:41.519823 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-940ad156-ea9e-40fe-b585-22c2495a9085 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:41.520268 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-940ad156-ea9e-40fe-b585-22c2495a9085 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:41.521123 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-940ad156-ea9e-40fe-b585-22c2495a9085 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:41.521583 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-940ad156-ea9e-40fe-b585-22c2495a9085 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:41.585941 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-940ad156-ea9e-40fe-b585-22c2495a9085 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:41.593992 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-940ad156-ea9e-40fe-b585-22c2495a9085 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.086093 Jul 20 19:33:41.594788 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 485/977] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:41 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:33:41.621662 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-92911f69-1833-4dca-aad2-18dc036bae1b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:41.631804 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-92911f69-1833-4dca-aad2-18dc036bae1b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:41.633448 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-92911f69-1833-4dca-aad2-18dc036bae1b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:41.634530 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-92911f69-1833-4dca-aad2-18dc036bae1b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.175265 Jul 20 19:33:41.635103 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 493/978] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:33:41 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:33:42.611163 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-1b1d5dbe-1409-4833-99c5-1a95e527231f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:42.611805 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-1b1d5dbe-1409-4833-99c5-1a95e527231f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:42.618519 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1b1d5dbe-1409-4833-99c5-1a95e527231f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:42.618964 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1b1d5dbe-1409-4833-99c5-1a95e527231f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:42.619750 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1b1d5dbe-1409-4833-99c5-1a95e527231f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:42.620178 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1b1d5dbe-1409-4833-99c5-1a95e527231f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:42.652422 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-348d502d-4fb6-4b38-a324-94ba07572647 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:42.653105 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-348d502d-4fb6-4b38-a324-94ba07572647 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:42.659836 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-348d502d-4fb6-4b38-a324-94ba07572647 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:42.660296 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-348d502d-4fb6-4b38-a324-94ba07572647 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:42.661066 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-348d502d-4fb6-4b38-a324-94ba07572647 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:42.661542 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-348d502d-4fb6-4b38-a324-94ba07572647 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:42.681653 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1b1d5dbe-1409-4833-99c5-1a95e527231f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:42.690062 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-1b1d5dbe-1409-4833-99c5-1a95e527231f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.082851 Jul 20 19:33:42.690637 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 486/979] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:42 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:42.795083 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-348d502d-4fb6-4b38-a324-94ba07572647 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:42.804077 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-348d502d-4fb6-4b38-a324-94ba07572647 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:42.805587 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-348d502d-4fb6-4b38-a324-94ba07572647 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:42.806730 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-348d502d-4fb6-4b38-a324-94ba07572647 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.158211 Jul 20 19:33:42.807279 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 494/980] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:33:42 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:33:43.707560 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-0683ea09-cdda-4504-8337-1e8a3f5179ed tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:43.708180 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-0683ea09-cdda-4504-8337-1e8a3f5179ed tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:43.710497 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_api:SELECT=56 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:43.716219 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0683ea09-cdda-4504-8337-1e8a3f5179ed tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:43.716670 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0683ea09-cdda-4504-8337-1e8a3f5179ed tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:43.717446 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0683ea09-cdda-4504-8337-1e8a3f5179ed tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:43.717912 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0683ea09-cdda-4504-8337-1e8a3f5179ed tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:43.825478 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-453fd167-3048-436d-a8b4-b2731ab6fadd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:43.826215 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-453fd167-3048-436d-a8b4-b2731ab6fadd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:43.833657 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-453fd167-3048-436d-a8b4-b2731ab6fadd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:43.834186 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-453fd167-3048-436d-a8b4-b2731ab6fadd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:43.835020 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-453fd167-3048-436d-a8b4-b2731ab6fadd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:43.835526 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-453fd167-3048-436d-a8b4-b2731ab6fadd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:43.843366 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0683ea09-cdda-4504-8337-1e8a3f5179ed tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:43.851973 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-0683ea09-cdda-4504-8337-1e8a3f5179ed tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.148921 Jul 20 19:33:43.852550 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 487/981] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:43 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:43.967465 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-453fd167-3048-436d-a8b4-b2731ab6fadd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:43.976994 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-453fd167-3048-436d-a8b4-b2731ab6fadd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:43.978515 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-453fd167-3048-436d-a8b4-b2731ab6fadd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:43.979947 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-453fd167-3048-436d-a8b4-b2731ab6fadd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.158359 Jul 20 19:33:43.980509 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 495/982] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:33:43 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:33:44.871228 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-0bf2945b-541d-4883-aa4c-719206433b34 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:44.871846 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-0bf2945b-541d-4883-aa4c-719206433b34 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:44.878677 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0bf2945b-541d-4883-aa4c-719206433b34 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:44.879117 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0bf2945b-541d-4883-aa4c-719206433b34 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:44.879880 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0bf2945b-541d-4883-aa4c-719206433b34 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:44.880309 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0bf2945b-541d-4883-aa4c-719206433b34 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:44.942341 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0bf2945b-541d-4883-aa4c-719206433b34 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:44.952266 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-0bf2945b-541d-4883-aa4c-719206433b34 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.086637 Jul 20 19:33:44.953169 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 488/983] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:44 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:44.998479 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-2dc6a0df-8d92-4975-8694-f4a3efea70bd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:44.999140 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-2dc6a0df-8d92-4975-8694-f4a3efea70bd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:45.006003 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2dc6a0df-8d92-4975-8694-f4a3efea70bd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:45.006455 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2dc6a0df-8d92-4975-8694-f4a3efea70bd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:45.007260 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2dc6a0df-8d92-4975-8694-f4a3efea70bd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:45.007664 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2dc6a0df-8d92-4975-8694-f4a3efea70bd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:45.158733 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-2dc6a0df-8d92-4975-8694-f4a3efea70bd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:45.167640 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-2dc6a0df-8d92-4975-8694-f4a3efea70bd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:45.169156 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-2dc6a0df-8d92-4975-8694-f4a3efea70bd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:45.170369 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-2dc6a0df-8d92-4975-8694-f4a3efea70bd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.175867 Jul 20 19:33:45.170927 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 496/984] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:33:44 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:33:45.969710 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-2558f452-8dbd-462d-a098-eed572ab3c3e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:45.970326 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-2558f452-8dbd-462d-a098-eed572ab3c3e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:45.976779 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2558f452-8dbd-462d-a098-eed572ab3c3e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:45.977228 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2558f452-8dbd-462d-a098-eed572ab3c3e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:45.978023 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2558f452-8dbd-462d-a098-eed572ab3c3e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:45.978482 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2558f452-8dbd-462d-a098-eed572ab3c3e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:46.038893 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-2558f452-8dbd-462d-a098-eed572ab3c3e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:46.046410 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-2558f452-8dbd-462d-a098-eed572ab3c3e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080761 Jul 20 19:33:46.047534 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 489/985] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:45 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:46.188250 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-a60ab278-8ba9-421c-9242-df33b37ccadd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:46.188850 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-a60ab278-8ba9-421c-9242-df33b37ccadd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:46.195422 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a60ab278-8ba9-421c-9242-df33b37ccadd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:46.195873 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a60ab278-8ba9-421c-9242-df33b37ccadd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:46.196627 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a60ab278-8ba9-421c-9242-df33b37ccadd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:46.197060 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a60ab278-8ba9-421c-9242-df33b37ccadd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:46.326177 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-a60ab278-8ba9-421c-9242-df33b37ccadd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:46.335267 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-a60ab278-8ba9-421c-9242-df33b37ccadd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:46.337018 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-a60ab278-8ba9-421c-9242-df33b37ccadd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:46.338193 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-a60ab278-8ba9-421c-9242-df33b37ccadd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.154033 Jul 20 19:33:46.338740 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 497/986] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:33:46 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:33:47.064229 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-29dc3357-1237-4d76-a8e7-e0aeb4dd9e93 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:47.064825 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-29dc3357-1237-4d76-a8e7-e0aeb4dd9e93 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:47.072155 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-29dc3357-1237-4d76-a8e7-e0aeb4dd9e93 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:47.072625 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-29dc3357-1237-4d76-a8e7-e0aeb4dd9e93 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:47.073415 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-29dc3357-1237-4d76-a8e7-e0aeb4dd9e93 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:47.074083 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-29dc3357-1237-4d76-a8e7-e0aeb4dd9e93 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:47.138993 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-29dc3357-1237-4d76-a8e7-e0aeb4dd9e93 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:47.146633 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-29dc3357-1237-4d76-a8e7-e0aeb4dd9e93 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.086602 Jul 20 19:33:47.147214 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 490/987] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:47 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:47.356257 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-00d536d3-bc20-42d3-a590-51b860865d7a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:47.356860 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-00d536d3-bc20-42d3-a590-51b860865d7a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:47.364424 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-00d536d3-bc20-42d3-a590-51b860865d7a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:47.364874 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-00d536d3-bc20-42d3-a590-51b860865d7a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:47.365671 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-00d536d3-bc20-42d3-a590-51b860865d7a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:47.366110 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-00d536d3-bc20-42d3-a590-51b860865d7a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:47.502776 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-00d536d3-bc20-42d3-a590-51b860865d7a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:47.511474 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-00d536d3-bc20-42d3-a590-51b860865d7a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:47.513031 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-00d536d3-bc20-42d3-a590-51b860865d7a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:47.514229 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-00d536d3-bc20-42d3-a590-51b860865d7a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.161901 Jul 20 19:33:47.514790 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 498/988] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:33:47 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:33:48.163499 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-3168692b-7bac-4424-a76d-ccbbc7080926 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:48.164455 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-3168692b-7bac-4424-a76d-ccbbc7080926 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:48.173976 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3168692b-7bac-4424-a76d-ccbbc7080926 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:48.174611 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3168692b-7bac-4424-a76d-ccbbc7080926 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:48.175442 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3168692b-7bac-4424-a76d-ccbbc7080926 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:48.175875 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3168692b-7bac-4424-a76d-ccbbc7080926 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:48.242414 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3168692b-7bac-4424-a76d-ccbbc7080926 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:48.251856 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-3168692b-7bac-4424-a76d-ccbbc7080926 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.092131 Jul 20 19:33:48.252436 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 491/989] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:48 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:48.533519 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-a764d27f-b995-4ea0-8ff3-7507dbb21de7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:48.534145 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-a764d27f-b995-4ea0-8ff3-7507dbb21de7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:48.540377 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a764d27f-b995-4ea0-8ff3-7507dbb21de7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:48.540827 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a764d27f-b995-4ea0-8ff3-7507dbb21de7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:48.541620 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a764d27f-b995-4ea0-8ff3-7507dbb21de7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:48.542057 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a764d27f-b995-4ea0-8ff3-7507dbb21de7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:48.715635 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-a764d27f-b995-4ea0-8ff3-7507dbb21de7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:48.724685 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-a764d27f-b995-4ea0-8ff3-7507dbb21de7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:48.726236 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-a764d27f-b995-4ea0-8ff3-7507dbb21de7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:48.727370 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-a764d27f-b995-4ea0-8ff3-7507dbb21de7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.198452 Jul 20 19:33:48.727924 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 499/990] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:33:48 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:33:49.269595 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-793b76df-5589-41b4-b71b-e94d329eba95 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:49.270200 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-793b76df-5589-41b4-b71b-e94d329eba95 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:49.277187 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-793b76df-5589-41b4-b71b-e94d329eba95 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:49.277655 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-793b76df-5589-41b4-b71b-e94d329eba95 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:49.278412 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-793b76df-5589-41b4-b71b-e94d329eba95 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:49.278878 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-793b76df-5589-41b4-b71b-e94d329eba95 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:49.340820 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-793b76df-5589-41b4-b71b-e94d329eba95 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:49.348340 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-793b76df-5589-41b4-b71b-e94d329eba95 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.083571 Jul 20 19:33:49.348902 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 492/991] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:49 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:49.746929 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-8d884642-efa9-4e5b-9898-fbbc7461056b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:49.747534 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-8d884642-efa9-4e5b-9898-fbbc7461056b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:49.754877 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8d884642-efa9-4e5b-9898-fbbc7461056b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:49.755324 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8d884642-efa9-4e5b-9898-fbbc7461056b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:49.756085 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8d884642-efa9-4e5b-9898-fbbc7461056b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:49.756513 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8d884642-efa9-4e5b-9898-fbbc7461056b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:49.888690 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-8d884642-efa9-4e5b-9898-fbbc7461056b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:49.897315 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-8d884642-efa9-4e5b-9898-fbbc7461056b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:49.898855 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-8d884642-efa9-4e5b-9898-fbbc7461056b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:49.900039 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-8d884642-efa9-4e5b-9898-fbbc7461056b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.157118 Jul 20 19:33:49.900602 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 500/992] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:33:49 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:33:50.364684 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c6ad9a21-303a-4366-be57-2c9d6c7e6fbe tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:50.365295 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c6ad9a21-303a-4366-be57-2c9d6c7e6fbe tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:50.371763 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c6ad9a21-303a-4366-be57-2c9d6c7e6fbe tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:50.372210 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c6ad9a21-303a-4366-be57-2c9d6c7e6fbe tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:50.372973 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c6ad9a21-303a-4366-be57-2c9d6c7e6fbe tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:50.373411 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c6ad9a21-303a-4366-be57-2c9d6c7e6fbe tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:50.438372 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c6ad9a21-303a-4366-be57-2c9d6c7e6fbe tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:50.445888 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c6ad9a21-303a-4366-be57-2c9d6c7e6fbe tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.085043 Jul 20 19:33:50.446483 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 493/993] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:50 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:50.918202 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-e461c39e-b11b-497d-9dcf-470a13010b55 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:50.918824 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-e461c39e-b11b-497d-9dcf-470a13010b55 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:50.925901 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e461c39e-b11b-497d-9dcf-470a13010b55 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:50.926351 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e461c39e-b11b-497d-9dcf-470a13010b55 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:50.927140 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e461c39e-b11b-497d-9dcf-470a13010b55 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:50.927578 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e461c39e-b11b-497d-9dcf-470a13010b55 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:51.061099 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-e461c39e-b11b-497d-9dcf-470a13010b55 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:51.069586 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-e461c39e-b11b-497d-9dcf-470a13010b55 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:51.071105 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-e461c39e-b11b-497d-9dcf-470a13010b55 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:51.072263 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-e461c39e-b11b-497d-9dcf-470a13010b55 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.157960 Jul 20 19:33:51.072824 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 501/994] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:33:50 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:33:51.463537 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-35a38ed8-a5c1-45bf-9598-ee4d50391bcc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:51.464221 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-35a38ed8-a5c1-45bf-9598-ee4d50391bcc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:51.471376 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-35a38ed8-a5c1-45bf-9598-ee4d50391bcc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:51.471821 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-35a38ed8-a5c1-45bf-9598-ee4d50391bcc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:51.472585 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-35a38ed8-a5c1-45bf-9598-ee4d50391bcc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:51.473049 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-35a38ed8-a5c1-45bf-9598-ee4d50391bcc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:51.533610 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-35a38ed8-a5c1-45bf-9598-ee4d50391bcc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:51.541116 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-35a38ed8-a5c1-45bf-9598-ee4d50391bcc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.081804 Jul 20 19:33:51.541696 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 494/995] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:51 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:51.784255 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 19:33:51.784541 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: Wed Jul 20 19:33:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 19:33:52.090644 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-ac24dde4-9910-47b1-ac34-99bb3e9b374d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:52.091286 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-ac24dde4-9910-47b1-ac34-99bb3e9b374d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:52.097805 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-ac24dde4-9910-47b1-ac34-99bb3e9b374d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:52.098262 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-ac24dde4-9910-47b1-ac34-99bb3e9b374d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:52.099028 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-ac24dde4-9910-47b1-ac34-99bb3e9b374d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:52.099465 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-ac24dde4-9910-47b1-ac34-99bb3e9b374d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:52.228173 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-ac24dde4-9910-47b1-ac34-99bb3e9b374d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:52.237096 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-ac24dde4-9910-47b1-ac34-99bb3e9b374d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:52.238648 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-ac24dde4-9910-47b1-ac34-99bb3e9b374d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:52.239812 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-ac24dde4-9910-47b1-ac34-99bb3e9b374d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.153447 Jul 20 19:33:52.240379 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 502/996] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:33:52 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:33:52.557749 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-b9342a85-08be-4581-b8ca-2b9546654d1a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:52.558351 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-b9342a85-08be-4581-b8ca-2b9546654d1a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:52.564974 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b9342a85-08be-4581-b8ca-2b9546654d1a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:52.565421 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b9342a85-08be-4581-b8ca-2b9546654d1a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:52.566218 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b9342a85-08be-4581-b8ca-2b9546654d1a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:52.566650 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b9342a85-08be-4581-b8ca-2b9546654d1a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:52.631075 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-b9342a85-08be-4581-b8ca-2b9546654d1a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:52.638853 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-b9342a85-08be-4581-b8ca-2b9546654d1a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.084962 Jul 20 19:33:52.639418 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 495/997] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:52 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:53.258111 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-555ac7b9-f95c-4cbf-9917-a087a12f5a5d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:53.258705 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-555ac7b9-f95c-4cbf-9917-a087a12f5a5d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:53.265180 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-555ac7b9-f95c-4cbf-9917-a087a12f5a5d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:53.265693 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-555ac7b9-f95c-4cbf-9917-a087a12f5a5d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:53.266436 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-555ac7b9-f95c-4cbf-9917-a087a12f5a5d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:53.266862 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-555ac7b9-f95c-4cbf-9917-a087a12f5a5d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:53.405400 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-555ac7b9-f95c-4cbf-9917-a087a12f5a5d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:53.414749 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-555ac7b9-f95c-4cbf-9917-a087a12f5a5d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:53.416257 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-555ac7b9-f95c-4cbf-9917-a087a12f5a5d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:53.417569 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-555ac7b9-f95c-4cbf-9917-a087a12f5a5d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.163318 Jul 20 19:33:53.418135 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 503/998] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:33:53 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:33:53.656329 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-3b7a0aa0-035c-441a-932f-c87811bb65c7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:53.657744 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-3b7a0aa0-035c-441a-932f-c87811bb65c7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:53.664474 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3b7a0aa0-035c-441a-932f-c87811bb65c7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:53.664917 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3b7a0aa0-035c-441a-932f-c87811bb65c7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:53.665725 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3b7a0aa0-035c-441a-932f-c87811bb65c7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:53.666161 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3b7a0aa0-035c-441a-932f-c87811bb65c7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:53.668690 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:53.727371 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3b7a0aa0-035c-441a-932f-c87811bb65c7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:53.734903 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-3b7a0aa0-035c-441a-932f-c87811bb65c7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.082556 Jul 20 19:33:53.735466 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 496/999] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:53 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:54.499680 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-488451f3-9f6a-433b-9e2b-9086c39ac61a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:54.500291 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-488451f3-9f6a-433b-9e2b-9086c39ac61a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:54.502210 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_api:SELECT=52 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:54.508063 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-488451f3-9f6a-433b-9e2b-9086c39ac61a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:54.508513 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-488451f3-9f6a-433b-9e2b-9086c39ac61a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:54.509278 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-488451f3-9f6a-433b-9e2b-9086c39ac61a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:54.509746 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-488451f3-9f6a-433b-9e2b-9086c39ac61a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:54.637834 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-488451f3-9f6a-433b-9e2b-9086c39ac61a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:54.646265 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-488451f3-9f6a-433b-9e2b-9086c39ac61a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:54.647859 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-488451f3-9f6a-433b-9e2b-9086c39ac61a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:54.649045 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-488451f3-9f6a-433b-9e2b-9086c39ac61a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.217202 Jul 20 19:33:54.649618 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 504/1000] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:33:54 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:33:54.753687 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-0db42178-9818-43da-a983-43b3743ec19d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:54.754220 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-0db42178-9818-43da-a983-43b3743ec19d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:54.760531 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0db42178-9818-43da-a983-43b3743ec19d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:54.760978 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0db42178-9818-43da-a983-43b3743ec19d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:54.761771 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0db42178-9818-43da-a983-43b3743ec19d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:54.762199 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0db42178-9818-43da-a983-43b3743ec19d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:54.822892 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0db42178-9818-43da-a983-43b3743ec19d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:54.830449 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-0db42178-9818-43da-a983-43b3743ec19d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080794 Jul 20 19:33:54.831001 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 497/1001] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:54 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:55.666830 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-e94b3323-e392-4d5b-9783-a7ede9752aaa tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:55.667466 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-e94b3323-e392-4d5b-9783-a7ede9752aaa tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:55.674500 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e94b3323-e392-4d5b-9783-a7ede9752aaa tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:55.674944 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e94b3323-e392-4d5b-9783-a7ede9752aaa tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:55.675694 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e94b3323-e392-4d5b-9783-a7ede9752aaa tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:55.676128 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e94b3323-e392-4d5b-9783-a7ede9752aaa tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:55.678820 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_cell1:SELECT=100 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:55.805190 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-e94b3323-e392-4d5b-9783-a7ede9752aaa tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:55.814263 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-e94b3323-e392-4d5b-9783-a7ede9752aaa tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:55.815761 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-e94b3323-e392-4d5b-9783-a7ede9752aaa tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:55.816899 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-e94b3323-e392-4d5b-9783-a7ede9752aaa tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.153940 Jul 20 19:33:55.817440 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 505/1002] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:33:55 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:33:55.850675 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-49f5404b-28b5-4ce7-a2e4-8d11507a3086 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:55.852508 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-49f5404b-28b5-4ce7-a2e4-8d11507a3086 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:55.859052 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-49f5404b-28b5-4ce7-a2e4-8d11507a3086 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:55.860172 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-49f5404b-28b5-4ce7-a2e4-8d11507a3086 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:55.861052 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-49f5404b-28b5-4ce7-a2e4-8d11507a3086 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:55.861482 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-49f5404b-28b5-4ce7-a2e4-8d11507a3086 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:55.923477 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-49f5404b-28b5-4ce7-a2e4-8d11507a3086 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:55.931162 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-49f5404b-28b5-4ce7-a2e4-8d11507a3086 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.086717 Jul 20 19:33:55.931717 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 498/1003] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:55 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:56.837728 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-3a0886a4-983f-45d0-9487-0dcb9d712a9d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:56.838331 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-3a0886a4-983f-45d0-9487-0dcb9d712a9d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:56.845455 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3a0886a4-983f-45d0-9487-0dcb9d712a9d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:56.845928 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3a0886a4-983f-45d0-9487-0dcb9d712a9d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:56.846688 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3a0886a4-983f-45d0-9487-0dcb9d712a9d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:56.847123 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3a0886a4-983f-45d0-9487-0dcb9d712a9d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:56.948115 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ad31ebcc-5063-479f-b125-d355ec2d5bcf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:56.948724 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ad31ebcc-5063-479f-b125-d355ec2d5bcf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:56.957287 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ad31ebcc-5063-479f-b125-d355ec2d5bcf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:56.957764 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ad31ebcc-5063-479f-b125-d355ec2d5bcf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:56.958530 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ad31ebcc-5063-479f-b125-d355ec2d5bcf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:56.958958 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ad31ebcc-5063-479f-b125-d355ec2d5bcf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:56.981236 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-3a0886a4-983f-45d0-9487-0dcb9d712a9d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:56.990567 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-3a0886a4-983f-45d0-9487-0dcb9d712a9d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:56.992096 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-3a0886a4-983f-45d0-9487-0dcb9d712a9d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:56.993252 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-3a0886a4-983f-45d0-9487-0dcb9d712a9d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.161792 Jul 20 19:33:56.993860 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 506/1004] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:33:56 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:33:57.025047 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ad31ebcc-5063-479f-b125-d355ec2d5bcf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:57.033359 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ad31ebcc-5063-479f-b125-d355ec2d5bcf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.089045 Jul 20 19:33:57.033964 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 499/1005] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:56 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:33:58.012299 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-c5123e4d-140e-4e56-a3fd-fa00c4b49a19 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:58.012949 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-c5123e4d-140e-4e56-a3fd-fa00c4b49a19 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:58.019807 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c5123e4d-140e-4e56-a3fd-fa00c4b49a19 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:58.020253 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c5123e4d-140e-4e56-a3fd-fa00c4b49a19 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:58.021009 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c5123e4d-140e-4e56-a3fd-fa00c4b49a19 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:58.021439 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c5123e4d-140e-4e56-a3fd-fa00c4b49a19 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:58.050522 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-3861df2b-15f8-4df5-968c-44a0e45bcadf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:58.051140 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-3861df2b-15f8-4df5-968c-44a0e45bcadf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:58.057780 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3861df2b-15f8-4df5-968c-44a0e45bcadf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:58.058236 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3861df2b-15f8-4df5-968c-44a0e45bcadf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:58.059013 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3861df2b-15f8-4df5-968c-44a0e45bcadf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:58.059451 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3861df2b-15f8-4df5-968c-44a0e45bcadf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:58.123354 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3861df2b-15f8-4df5-968c-44a0e45bcadf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:58.131791 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-3861df2b-15f8-4df5-968c-44a0e45bcadf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.085621 Jul 20 19:33:58.132683 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 500/1006] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:58 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:33:58.165695 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-c5123e4d-140e-4e56-a3fd-fa00c4b49a19 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:58.175149 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-c5123e4d-140e-4e56-a3fd-fa00c4b49a19 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:58.176662 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-c5123e4d-140e-4e56-a3fd-fa00c4b49a19 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:58.177846 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-c5123e4d-140e-4e56-a3fd-fa00c4b49a19 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.169460 Jul 20 19:33:58.178396 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 507/1007] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:33:58 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:33:59.148420 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-1e806a7b-7030-4066-80de-dc5e2bb9ebb1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:59.149056 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-1e806a7b-7030-4066-80de-dc5e2bb9ebb1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:59.155926 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1e806a7b-7030-4066-80de-dc5e2bb9ebb1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:59.156377 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1e806a7b-7030-4066-80de-dc5e2bb9ebb1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:59.157147 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1e806a7b-7030-4066-80de-dc5e2bb9ebb1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:59.157606 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1e806a7b-7030-4066-80de-dc5e2bb9ebb1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:59.196535 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-23eb1dd1-590b-4c3a-8a1f-147582f01353 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:59.197134 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-23eb1dd1-590b-4c3a-8a1f-147582f01353 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:59.204590 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-23eb1dd1-590b-4c3a-8a1f-147582f01353 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:59.205041 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-23eb1dd1-590b-4c3a-8a1f-147582f01353 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:59.205841 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-23eb1dd1-590b-4c3a-8a1f-147582f01353 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:59.206271 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-23eb1dd1-590b-4c3a-8a1f-147582f01353 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:59.221338 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1e806a7b-7030-4066-80de-dc5e2bb9ebb1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:59.229805 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-1e806a7b-7030-4066-80de-dc5e2bb9ebb1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.085131 Jul 20 19:33:59.230397 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 501/1008] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:59 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:59.344789 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-23eb1dd1-590b-4c3a-8a1f-147582f01353 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:59.353562 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-23eb1dd1-590b-4c3a-8a1f-147582f01353 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:59.355077 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-23eb1dd1-590b-4c3a-8a1f-147582f01353 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:59.356229 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-23eb1dd1-590b-4c3a-8a1f-147582f01353 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.163534 Jul 20 19:33:59.356784 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 508/1009] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:33:59 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:34:00.246268 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-eed23b36-8db8-456c-a90f-c44aff8f2caa tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:00.246881 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-eed23b36-8db8-456c-a90f-c44aff8f2caa tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:00.254746 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-eed23b36-8db8-456c-a90f-c44aff8f2caa tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:00.255200 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-eed23b36-8db8-456c-a90f-c44aff8f2caa tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:00.255971 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-eed23b36-8db8-456c-a90f-c44aff8f2caa tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:00.256410 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-eed23b36-8db8-456c-a90f-c44aff8f2caa tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:00.318393 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-eed23b36-8db8-456c-a90f-c44aff8f2caa tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:00.326194 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-eed23b36-8db8-456c-a90f-c44aff8f2caa tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.083788 Jul 20 19:34:00.326759 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 502/1010] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:00 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:00.376589 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-6f27ee8c-98d5-4c49-8a4a-e615544512c8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:00.377184 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-6f27ee8c-98d5-4c49-8a4a-e615544512c8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:00.384202 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-6f27ee8c-98d5-4c49-8a4a-e615544512c8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:00.384638 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-6f27ee8c-98d5-4c49-8a4a-e615544512c8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:00.385398 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-6f27ee8c-98d5-4c49-8a4a-e615544512c8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:00.385854 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-6f27ee8c-98d5-4c49-8a4a-e615544512c8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:00.515634 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-6f27ee8c-98d5-4c49-8a4a-e615544512c8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:00.524301 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-6f27ee8c-98d5-4c49-8a4a-e615544512c8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:00.525845 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-6f27ee8c-98d5-4c49-8a4a-e615544512c8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:00.526988 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-6f27ee8c-98d5-4c49-8a4a-e615544512c8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.155541 Jul 20 19:34:00.527536 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 509/1011] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:34:00 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:34:01.344755 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-dcd2bcae-70d6-4a36-af40-f3ae063d107e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:01.345360 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-dcd2bcae-70d6-4a36-af40-f3ae063d107e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:01.351970 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-dcd2bcae-70d6-4a36-af40-f3ae063d107e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:01.352419 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-dcd2bcae-70d6-4a36-af40-f3ae063d107e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:01.353190 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-dcd2bcae-70d6-4a36-af40-f3ae063d107e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:01.353657 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-dcd2bcae-70d6-4a36-af40-f3ae063d107e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:01.419144 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-dcd2bcae-70d6-4a36-af40-f3ae063d107e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:01.427424 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-dcd2bcae-70d6-4a36-af40-f3ae063d107e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.087103 Jul 20 19:34:01.427989 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 503/1012] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:01 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:01.545236 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-099aca5e-cd3c-45a9-8678-55f2d0ce4dc0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:01.545840 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-099aca5e-cd3c-45a9-8678-55f2d0ce4dc0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:01.553217 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-099aca5e-cd3c-45a9-8678-55f2d0ce4dc0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:01.553692 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-099aca5e-cd3c-45a9-8678-55f2d0ce4dc0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:01.554443 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-099aca5e-cd3c-45a9-8678-55f2d0ce4dc0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:01.554871 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-099aca5e-cd3c-45a9-8678-55f2d0ce4dc0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:01.689318 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-099aca5e-cd3c-45a9-8678-55f2d0ce4dc0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:01.697699 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-099aca5e-cd3c-45a9-8678-55f2d0ce4dc0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:01.699217 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-099aca5e-cd3c-45a9-8678-55f2d0ce4dc0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:01.700363 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-099aca5e-cd3c-45a9-8678-55f2d0ce4dc0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.159038 Jul 20 19:34:01.700912 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 510/1013] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:34:01 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:34:02.444952 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-6d3d06e1-1359-4339-8357-ad932092efdd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:02.445582 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-6d3d06e1-1359-4339-8357-ad932092efdd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:02.452311 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6d3d06e1-1359-4339-8357-ad932092efdd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:02.452755 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6d3d06e1-1359-4339-8357-ad932092efdd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:02.453649 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6d3d06e1-1359-4339-8357-ad932092efdd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:02.454098 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6d3d06e1-1359-4339-8357-ad932092efdd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:02.516570 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6d3d06e1-1359-4339-8357-ad932092efdd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:02.524347 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-6d3d06e1-1359-4339-8357-ad932092efdd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.083197 Jul 20 19:34:02.524854 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 504/1014] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:02 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:02.719686 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-f9b26737-623a-4443-967b-9e08919f6f15 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:02.720361 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-f9b26737-623a-4443-967b-9e08919f6f15 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:02.727362 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f9b26737-623a-4443-967b-9e08919f6f15 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:02.727807 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f9b26737-623a-4443-967b-9e08919f6f15 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:02.728561 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f9b26737-623a-4443-967b-9e08919f6f15 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:02.728987 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f9b26737-623a-4443-967b-9e08919f6f15 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:02.862705 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-f9b26737-623a-4443-967b-9e08919f6f15 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:02.871164 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-f9b26737-623a-4443-967b-9e08919f6f15 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:02.872684 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-f9b26737-623a-4443-967b-9e08919f6f15 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:02.873880 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-f9b26737-623a-4443-967b-9e08919f6f15 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.158910 Jul 20 19:34:02.874441 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 511/1015] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:34:02 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:34:03.107985 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 19:34:03.108187 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Wed Jul 20 19:34:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 19:34:03.541169 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e503f1bb-d0f3-4eab-be47-fd6bae93331d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:03.541895 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e503f1bb-d0f3-4eab-be47-fd6bae93331d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:03.549192 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e503f1bb-d0f3-4eab-be47-fd6bae93331d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:03.549673 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e503f1bb-d0f3-4eab-be47-fd6bae93331d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:03.550455 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e503f1bb-d0f3-4eab-be47-fd6bae93331d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:03.550886 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e503f1bb-d0f3-4eab-be47-fd6bae93331d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:03.612794 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e503f1bb-d0f3-4eab-be47-fd6bae93331d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:03.620367 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e503f1bb-d0f3-4eab-be47-fd6bae93331d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.083066 Jul 20 19:34:03.620929 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 505/1016] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:03 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:03.893306 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-12a6669f-117c-48a1-a189-656fd3729e3d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:03.893909 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-12a6669f-117c-48a1-a189-656fd3729e3d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:03.900580 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-12a6669f-117c-48a1-a189-656fd3729e3d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:03.901008 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-12a6669f-117c-48a1-a189-656fd3729e3d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:03.901859 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-12a6669f-117c-48a1-a189-656fd3729e3d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:03.902296 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-12a6669f-117c-48a1-a189-656fd3729e3d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:04.034384 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-12a6669f-117c-48a1-a189-656fd3729e3d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:04.042910 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-12a6669f-117c-48a1-a189-656fd3729e3d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:04.044419 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-12a6669f-117c-48a1-a189-656fd3729e3d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:04.045599 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-12a6669f-117c-48a1-a189-656fd3729e3d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.156985 Jul 20 19:34:04.046160 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 512/1017] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:34:03 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:34:04.636359 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a9a46859-84d0-4853-9c5e-615062149714 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:04.636961 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a9a46859-84d0-4853-9c5e-615062149714 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:04.643928 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a9a46859-84d0-4853-9c5e-615062149714 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:04.644372 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a9a46859-84d0-4853-9c5e-615062149714 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:04.645140 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a9a46859-84d0-4853-9c5e-615062149714 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:04.645601 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a9a46859-84d0-4853-9c5e-615062149714 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:04.708837 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-85b3d21e-4452-4f21-bcc1-5896e8318e12 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:34:04.709446 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-85b3d21e-4452-4f21-bcc1-5896e8318e12 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:04.716152 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-85b3d21e-4452-4f21-bcc1-5896e8318e12 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:04.716613 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-85b3d21e-4452-4f21-bcc1-5896e8318e12 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:04.717431 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-85b3d21e-4452-4f21-bcc1-5896e8318e12 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:04.717726 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a9a46859-84d0-4853-9c5e-615062149714 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:04.717892 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-85b3d21e-4452-4f21-bcc1-5896e8318e12 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:04.726494 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a9a46859-84d0-4853-9c5e-615062149714 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.094012 Jul 20 19:34:04.727170 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 506/1018] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:04 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:04.743432 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.objects.instance [None req-85b3d21e-4452-4f21-bcc1-5896e8318e12 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lazy-loading 'flavor' on Instance uuid 239cb0b6-54d7-4cc2-945a-1f026a015992 {{(pid=117762) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:34:04.819292 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-85b3d21e-4452-4f21-bcc1-5896e8318e12 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "POST /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992/action" status: 202 len: 0 microversion: 2.1 time: 0.160652 Jul 20 19:34:04.819874 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 513/1019] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Jul 20 19:34:04 2022] POST /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 19:34:04.828014 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-f1b2be6a-0582-42f2-92e0-f2f45f041cef tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:04.828852 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-f1b2be6a-0582-42f2-92e0-f2f45f041cef tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:04.836078 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f1b2be6a-0582-42f2-92e0-f2f45f041cef tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:04.836588 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f1b2be6a-0582-42f2-92e0-f2f45f041cef tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:04.837696 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f1b2be6a-0582-42f2-92e0-f2f45f041cef tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:04.838160 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f1b2be6a-0582-42f2-92e0-f2f45f041cef tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:04.983734 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-f1b2be6a-0582-42f2-92e0-f2f45f041cef tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:04.992303 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-f1b2be6a-0582-42f2-92e0-f2f45f041cef tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.168147 Jul 20 19:34:04.992862 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 507/1020] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:04 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:05.066240 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-aaf918a4-646c-4145-8b3e-a889dd5a2461 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:05.066953 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-aaf918a4-646c-4145-8b3e-a889dd5a2461 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:05.074240 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-aaf918a4-646c-4145-8b3e-a889dd5a2461 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:05.074747 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-aaf918a4-646c-4145-8b3e-a889dd5a2461 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:05.075657 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-aaf918a4-646c-4145-8b3e-a889dd5a2461 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:05.076147 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-aaf918a4-646c-4145-8b3e-a889dd5a2461 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:05.365304 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-aaf918a4-646c-4145-8b3e-a889dd5a2461 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:05.375412 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-aaf918a4-646c-4145-8b3e-a889dd5a2461 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:05.376934 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-aaf918a4-646c-4145-8b3e-a889dd5a2461 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:05.378136 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-aaf918a4-646c-4145-8b3e-a889dd5a2461 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.318069 Jul 20 19:34:05.378687 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 514/1021] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:34:05 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:34:05.745277 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a7e91a0e-cacc-439e-9573-f0a665a58a03 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:05.745994 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a7e91a0e-cacc-439e-9573-f0a665a58a03 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:05.752392 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a7e91a0e-cacc-439e-9573-f0a665a58a03 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:05.752848 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a7e91a0e-cacc-439e-9573-f0a665a58a03 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:05.753667 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a7e91a0e-cacc-439e-9573-f0a665a58a03 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:05.754106 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a7e91a0e-cacc-439e-9573-f0a665a58a03 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:05.823881 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a7e91a0e-cacc-439e-9573-f0a665a58a03 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:05.831800 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a7e91a0e-cacc-439e-9573-f0a665a58a03 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.091297 Jul 20 19:34:05.832373 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 508/1022] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:05 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:34:06.011220 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-9f6b8a6c-4f86-4d23-a130-0e7ea8ef420e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:06.011745 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-9f6b8a6c-4f86-4d23-a130-0e7ea8ef420e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:06.017822 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9f6b8a6c-4f86-4d23-a130-0e7ea8ef420e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:06.018273 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9f6b8a6c-4f86-4d23-a130-0e7ea8ef420e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:06.019077 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9f6b8a6c-4f86-4d23-a130-0e7ea8ef420e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:06.019471 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9f6b8a6c-4f86-4d23-a130-0e7ea8ef420e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:06.166978 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-9f6b8a6c-4f86-4d23-a130-0e7ea8ef420e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:06.175411 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-9f6b8a6c-4f86-4d23-a130-0e7ea8ef420e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.168808 Jul 20 19:34:06.175965 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 515/1023] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:06 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:06.397695 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-818269b5-4434-4a02-b627-d6f89b36dcac tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:06.398338 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-818269b5-4434-4a02-b627-d6f89b36dcac tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:06.404550 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-818269b5-4434-4a02-b627-d6f89b36dcac tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:06.405002 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-818269b5-4434-4a02-b627-d6f89b36dcac tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:06.405798 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-818269b5-4434-4a02-b627-d6f89b36dcac tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:06.406968 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-818269b5-4434-4a02-b627-d6f89b36dcac tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:06.537393 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-818269b5-4434-4a02-b627-d6f89b36dcac tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:06.545846 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-818269b5-4434-4a02-b627-d6f89b36dcac tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:06.548014 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-818269b5-4434-4a02-b627-d6f89b36dcac tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:06.549185 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-818269b5-4434-4a02-b627-d6f89b36dcac tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.155438 Jul 20 19:34:06.549770 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 509/1024] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:34:06 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:34:06.848969 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-36b972a7-00c7-48f0-85bd-584c058d5d26 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:06.849596 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-36b972a7-00c7-48f0-85bd-584c058d5d26 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:06.855851 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-36b972a7-00c7-48f0-85bd-584c058d5d26 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:06.856306 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-36b972a7-00c7-48f0-85bd-584c058d5d26 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:06.857071 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-36b972a7-00c7-48f0-85bd-584c058d5d26 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:06.857530 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-36b972a7-00c7-48f0-85bd-584c058d5d26 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:06.919346 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-36b972a7-00c7-48f0-85bd-584c058d5d26 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:06.927703 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-36b972a7-00c7-48f0-85bd-584c058d5d26 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.082142 Jul 20 19:34:06.927703 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 516/1025] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:06 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:07.192893 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-110669b3-0fff-4729-82f1-cbdd764f443f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:07.193647 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-110669b3-0fff-4729-82f1-cbdd764f443f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:07.200062 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-110669b3-0fff-4729-82f1-cbdd764f443f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:07.200502 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-110669b3-0fff-4729-82f1-cbdd764f443f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:07.201264 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-110669b3-0fff-4729-82f1-cbdd764f443f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:07.201747 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-110669b3-0fff-4729-82f1-cbdd764f443f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:07.339488 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-110669b3-0fff-4729-82f1-cbdd764f443f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:07.347540 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-110669b3-0fff-4729-82f1-cbdd764f443f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.158435 Jul 20 19:34:07.348120 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 510/1026] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:07 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:34:07.568520 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-2baa5847-46d0-43d7-b9c6-5ac84e2880e7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:07.569070 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-2baa5847-46d0-43d7-b9c6-5ac84e2880e7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:07.575608 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2baa5847-46d0-43d7-b9c6-5ac84e2880e7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:07.576047 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2baa5847-46d0-43d7-b9c6-5ac84e2880e7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:07.576800 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2baa5847-46d0-43d7-b9c6-5ac84e2880e7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:07.577233 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2baa5847-46d0-43d7-b9c6-5ac84e2880e7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:07.713672 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-2baa5847-46d0-43d7-b9c6-5ac84e2880e7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:07.722562 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-2baa5847-46d0-43d7-b9c6-5ac84e2880e7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:07.724079 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-2baa5847-46d0-43d7-b9c6-5ac84e2880e7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:07.725258 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-2baa5847-46d0-43d7-b9c6-5ac84e2880e7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.160798 Jul 20 19:34:07.725848 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 517/1027] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:34:07 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:34:07.944783 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-82a1ce5f-f281-4274-80b6-39105f3e82ed tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:07.945386 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-82a1ce5f-f281-4274-80b6-39105f3e82ed tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:07.951399 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-82a1ce5f-f281-4274-80b6-39105f3e82ed tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:07.951842 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-82a1ce5f-f281-4274-80b6-39105f3e82ed tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:07.952602 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-82a1ce5f-f281-4274-80b6-39105f3e82ed tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:07.953064 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-82a1ce5f-f281-4274-80b6-39105f3e82ed tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:08.015672 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-82a1ce5f-f281-4274-80b6-39105f3e82ed tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:08.023433 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-82a1ce5f-f281-4274-80b6-39105f3e82ed tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.082434 Jul 20 19:34:08.024014 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 511/1028] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:07 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:08.365755 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-c35a7de1-185f-4739-ada8-137f0bfcf9cc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:08.366361 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-c35a7de1-185f-4739-ada8-137f0bfcf9cc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:08.372833 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c35a7de1-185f-4739-ada8-137f0bfcf9cc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:08.373281 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c35a7de1-185f-4739-ada8-137f0bfcf9cc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:08.374093 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c35a7de1-185f-4739-ada8-137f0bfcf9cc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:08.374531 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c35a7de1-185f-4739-ada8-137f0bfcf9cc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:08.507268 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-c35a7de1-185f-4739-ada8-137f0bfcf9cc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:08.514944 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-c35a7de1-185f-4739-ada8-137f0bfcf9cc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.153079 Jul 20 19:34:08.516048 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 518/1029] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:08 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:08.743847 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-f3b496fd-488d-4fa1-b7e9-37289a7104ee tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:08.744470 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-f3b496fd-488d-4fa1-b7e9-37289a7104ee tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:08.751867 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f3b496fd-488d-4fa1-b7e9-37289a7104ee tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:08.752308 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f3b496fd-488d-4fa1-b7e9-37289a7104ee tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:08.753079 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f3b496fd-488d-4fa1-b7e9-37289a7104ee tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:08.753529 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f3b496fd-488d-4fa1-b7e9-37289a7104ee tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:08.887724 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-f3b496fd-488d-4fa1-b7e9-37289a7104ee tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:08.890199 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:34:08.898464 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-f3b496fd-488d-4fa1-b7e9-37289a7104ee tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:08.899962 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-f3b496fd-488d-4fa1-b7e9-37289a7104ee tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:08.901125 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-f3b496fd-488d-4fa1-b7e9-37289a7104ee tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.161262 Jul 20 19:34:08.901722 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 512/1030] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:34:08 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:34:09.040259 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-a3c874b5-a02a-488b-802d-1f4f9163828a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:09.040869 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-a3c874b5-a02a-488b-802d-1f4f9163828a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:09.047591 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a3c874b5-a02a-488b-802d-1f4f9163828a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:09.048043 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a3c874b5-a02a-488b-802d-1f4f9163828a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:09.048812 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a3c874b5-a02a-488b-802d-1f4f9163828a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:09.049251 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a3c874b5-a02a-488b-802d-1f4f9163828a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:09.118193 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-a3c874b5-a02a-488b-802d-1f4f9163828a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:09.120694 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:34:09.129146 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-a3c874b5-a02a-488b-802d-1f4f9163828a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.092669 Jul 20 19:34:09.129975 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 519/1031] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:09 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:09.533163 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-b2230ab6-5c01-474e-ae60-508ab7fa091d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:09.533791 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-b2230ab6-5c01-474e-ae60-508ab7fa091d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:09.539990 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b2230ab6-5c01-474e-ae60-508ab7fa091d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:09.540430 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b2230ab6-5c01-474e-ae60-508ab7fa091d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:09.541192 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b2230ab6-5c01-474e-ae60-508ab7fa091d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:09.541652 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b2230ab6-5c01-474e-ae60-508ab7fa091d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:09.679379 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-b2230ab6-5c01-474e-ae60-508ab7fa091d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:09.687125 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-b2230ab6-5c01-474e-ae60-508ab7fa091d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.158329 Jul 20 19:34:09.687688 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 513/1032] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:09 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:09.918972 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-1cae294a-c4c9-46bd-9f58-2009f4285b0e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:09.919570 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-1cae294a-c4c9-46bd-9f58-2009f4285b0e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:09.926814 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1cae294a-c4c9-46bd-9f58-2009f4285b0e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:09.927249 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1cae294a-c4c9-46bd-9f58-2009f4285b0e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:09.928018 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1cae294a-c4c9-46bd-9f58-2009f4285b0e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:09.928446 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1cae294a-c4c9-46bd-9f58-2009f4285b0e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:10.071187 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-1cae294a-c4c9-46bd-9f58-2009f4285b0e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:10.080192 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-1cae294a-c4c9-46bd-9f58-2009f4285b0e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:10.081719 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-1cae294a-c4c9-46bd-9f58-2009f4285b0e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:10.082858 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-1cae294a-c4c9-46bd-9f58-2009f4285b0e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.168329 Jul 20 19:34:10.083392 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 520/1033] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:34:09 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:34:10.146439 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-1e77264d-c670-4f9b-83ac-440c4d54eb6a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:10.147087 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-1e77264d-c670-4f9b-83ac-440c4d54eb6a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:10.153736 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1e77264d-c670-4f9b-83ac-440c4d54eb6a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:10.154223 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1e77264d-c670-4f9b-83ac-440c4d54eb6a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:10.154975 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1e77264d-c670-4f9b-83ac-440c4d54eb6a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:10.155411 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1e77264d-c670-4f9b-83ac-440c4d54eb6a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:10.222522 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1e77264d-c670-4f9b-83ac-440c4d54eb6a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:10.230245 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-1e77264d-c670-4f9b-83ac-440c4d54eb6a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.087642 Jul 20 19:34:10.230780 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 514/1034] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:10 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:10.704703 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-aa99e905-16c5-4738-95a7-1a3425fbde2f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:10.705365 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-aa99e905-16c5-4738-95a7-1a3425fbde2f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:10.712681 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-aa99e905-16c5-4738-95a7-1a3425fbde2f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:10.713131 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-aa99e905-16c5-4738-95a7-1a3425fbde2f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:10.713932 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-aa99e905-16c5-4738-95a7-1a3425fbde2f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:10.714393 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-aa99e905-16c5-4738-95a7-1a3425fbde2f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:10.850835 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-aa99e905-16c5-4738-95a7-1a3425fbde2f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:10.859018 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-aa99e905-16c5-4738-95a7-1a3425fbde2f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.158829 Jul 20 19:34:10.860295 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 521/1035] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:10 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:11.101665 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-8ff6d7b4-3916-4c11-848a-18eb2bed005b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:11.102183 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-8ff6d7b4-3916-4c11-848a-18eb2bed005b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:11.108520 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8ff6d7b4-3916-4c11-848a-18eb2bed005b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:11.109156 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8ff6d7b4-3916-4c11-848a-18eb2bed005b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:11.110555 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8ff6d7b4-3916-4c11-848a-18eb2bed005b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:11.110988 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8ff6d7b4-3916-4c11-848a-18eb2bed005b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:11.247615 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-85b5bcb4-d799-4296-93e0-a31c6273acc2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:11.248231 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-85b5bcb4-d799-4296-93e0-a31c6273acc2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:11.254995 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-85b5bcb4-d799-4296-93e0-a31c6273acc2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:11.255440 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-85b5bcb4-d799-4296-93e0-a31c6273acc2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:11.256234 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-85b5bcb4-d799-4296-93e0-a31c6273acc2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:11.257032 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-85b5bcb4-d799-4296-93e0-a31c6273acc2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:11.260480 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8ff6d7b4-3916-4c11-848a-18eb2bed005b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:11.270945 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8ff6d7b4-3916-4c11-848a-18eb2bed005b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:11.272800 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8ff6d7b4-3916-4c11-848a-18eb2bed005b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:11.274323 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-8ff6d7b4-3916-4c11-848a-18eb2bed005b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.176559 Jul 20 19:34:11.275408 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 515/1036] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:34:11 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:34:11.323189 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-85b5bcb4-d799-4296-93e0-a31c6273acc2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:11.330970 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-85b5bcb4-d799-4296-93e0-a31c6273acc2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.087417 Jul 20 19:34:11.331521 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 522/1037] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:11 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:34:11.877238 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-44d6a606-29f4-4304-aaca-256f4fa90330 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:11.877889 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-44d6a606-29f4-4304-aaca-256f4fa90330 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:11.883912 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-44d6a606-29f4-4304-aaca-256f4fa90330 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:11.884362 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-44d6a606-29f4-4304-aaca-256f4fa90330 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:11.885133 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-44d6a606-29f4-4304-aaca-256f4fa90330 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:11.885723 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-44d6a606-29f4-4304-aaca-256f4fa90330 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:12.021106 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-44d6a606-29f4-4304-aaca-256f4fa90330 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:12.028780 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-44d6a606-29f4-4304-aaca-256f4fa90330 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.155913 Jul 20 19:34:12.029356 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 516/1038] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:11 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:12.296341 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-5d6a8398-bdfb-42d1-91ca-dadcf66e1603 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:12.297546 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-5d6a8398-bdfb-42d1-91ca-dadcf66e1603 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:12.304176 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-5d6a8398-bdfb-42d1-91ca-dadcf66e1603 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:12.304614 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-5d6a8398-bdfb-42d1-91ca-dadcf66e1603 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:12.305368 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-5d6a8398-bdfb-42d1-91ca-dadcf66e1603 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:12.305822 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-5d6a8398-bdfb-42d1-91ca-dadcf66e1603 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:12.347880 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-54298da4-0eb9-4851-9e62-70e8571dbf2b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:12.348592 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-54298da4-0eb9-4851-9e62-70e8571dbf2b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:12.355319 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-54298da4-0eb9-4851-9e62-70e8571dbf2b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:12.355769 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-54298da4-0eb9-4851-9e62-70e8571dbf2b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:12.356550 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-54298da4-0eb9-4851-9e62-70e8571dbf2b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:12.357005 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-54298da4-0eb9-4851-9e62-70e8571dbf2b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:12.419469 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-54298da4-0eb9-4851-9e62-70e8571dbf2b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:12.427707 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-54298da4-0eb9-4851-9e62-70e8571dbf2b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.083713 Jul 20 19:34:12.428491 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 517/1039] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:12 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:34:12.438744 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-5d6a8398-bdfb-42d1-91ca-dadcf66e1603 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:12.447773 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-5d6a8398-bdfb-42d1-91ca-dadcf66e1603 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:12.449264 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-5d6a8398-bdfb-42d1-91ca-dadcf66e1603 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:12.450683 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-5d6a8398-bdfb-42d1-91ca-dadcf66e1603 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.158300 Jul 20 19:34:12.451257 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 523/1040] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:34:12 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:34:13.045969 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-2e8c1486-75f9-4a41-959e-7cdfd66f76f0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:13.046603 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-2e8c1486-75f9-4a41-959e-7cdfd66f76f0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:13.052694 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2e8c1486-75f9-4a41-959e-7cdfd66f76f0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:13.053143 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2e8c1486-75f9-4a41-959e-7cdfd66f76f0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:13.053943 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2e8c1486-75f9-4a41-959e-7cdfd66f76f0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:13.054410 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2e8c1486-75f9-4a41-959e-7cdfd66f76f0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:13.187508 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-2e8c1486-75f9-4a41-959e-7cdfd66f76f0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:13.195081 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-2e8c1486-75f9-4a41-959e-7cdfd66f76f0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.153158 Jul 20 19:34:13.195651 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 518/1041] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:13 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:13.444618 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-b24311dd-77d0-4759-99e4-6bff85c29ab6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:13.445158 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-b24311dd-77d0-4759-99e4-6bff85c29ab6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:13.452059 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b24311dd-77d0-4759-99e4-6bff85c29ab6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:13.452503 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b24311dd-77d0-4759-99e4-6bff85c29ab6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:13.453882 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b24311dd-77d0-4759-99e4-6bff85c29ab6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:13.454315 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b24311dd-77d0-4759-99e4-6bff85c29ab6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:13.469219 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-8b48be19-445e-4f45-9b79-bf383e5524e2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:13.470008 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-8b48be19-445e-4f45-9b79-bf383e5524e2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:13.476549 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8b48be19-445e-4f45-9b79-bf383e5524e2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:13.477003 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8b48be19-445e-4f45-9b79-bf383e5524e2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:13.477815 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8b48be19-445e-4f45-9b79-bf383e5524e2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:13.478263 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8b48be19-445e-4f45-9b79-bf383e5524e2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:13.519415 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-b24311dd-77d0-4759-99e4-6bff85c29ab6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:13.527308 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-b24311dd-77d0-4759-99e4-6bff85c29ab6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.086676 Jul 20 19:34:13.527877 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 524/1042] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:13 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:13.616120 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8b48be19-445e-4f45-9b79-bf383e5524e2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:13.626094 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8b48be19-445e-4f45-9b79-bf383e5524e2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:13.627808 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8b48be19-445e-4f45-9b79-bf383e5524e2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:13.629166 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-8b48be19-445e-4f45-9b79-bf383e5524e2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.164544 Jul 20 19:34:13.629765 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 519/1043] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:34:13 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:34:14.213071 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-23056cae-0ada-465c-a055-3f72a25ecc52 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:14.213801 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-23056cae-0ada-465c-a055-3f72a25ecc52 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:14.220181 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-23056cae-0ada-465c-a055-3f72a25ecc52 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:14.220621 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-23056cae-0ada-465c-a055-3f72a25ecc52 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:14.221376 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-23056cae-0ada-465c-a055-3f72a25ecc52 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:14.221849 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-23056cae-0ada-465c-a055-3f72a25ecc52 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:14.360368 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-23056cae-0ada-465c-a055-3f72a25ecc52 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:14.367888 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-23056cae-0ada-465c-a055-3f72a25ecc52 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.158899 Jul 20 19:34:14.368442 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 525/1044] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:14 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:14.544757 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-1c6007f1-fbae-406e-a0a6-835e29ec6cb9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:14.545419 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-1c6007f1-fbae-406e-a0a6-835e29ec6cb9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:14.548172 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_api:SELECT=66 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:34:14.553762 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1c6007f1-fbae-406e-a0a6-835e29ec6cb9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:14.554242 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1c6007f1-fbae-406e-a0a6-835e29ec6cb9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:14.555035 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1c6007f1-fbae-406e-a0a6-835e29ec6cb9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:14.555462 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1c6007f1-fbae-406e-a0a6-835e29ec6cb9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:14.620386 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1c6007f1-fbae-406e-a0a6-835e29ec6cb9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:14.629012 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-1c6007f1-fbae-406e-a0a6-835e29ec6cb9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.088382 Jul 20 19:34:14.629724 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 520/1045] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:14 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:14.649327 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-15dc0b6d-da3f-4234-b6e8-6ed56da1c960 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:14.649974 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-15dc0b6d-da3f-4234-b6e8-6ed56da1c960 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:14.657268 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-15dc0b6d-da3f-4234-b6e8-6ed56da1c960 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:14.657833 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-15dc0b6d-da3f-4234-b6e8-6ed56da1c960 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:14.658608 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-15dc0b6d-da3f-4234-b6e8-6ed56da1c960 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:14.659044 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-15dc0b6d-da3f-4234-b6e8-6ed56da1c960 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:14.795989 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-15dc0b6d-da3f-4234-b6e8-6ed56da1c960 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:14.805650 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-15dc0b6d-da3f-4234-b6e8-6ed56da1c960 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:14.807176 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-15dc0b6d-da3f-4234-b6e8-6ed56da1c960 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:14.808406 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-15dc0b6d-da3f-4234-b6e8-6ed56da1c960 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.164427 Jul 20 19:34:14.808958 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 526/1046] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:34:14 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:34:15.386633 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-7fdeeafe-fe3f-4338-ad2d-11ecc3b13000 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:15.387393 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-7fdeeafe-fe3f-4338-ad2d-11ecc3b13000 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:15.394981 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7fdeeafe-fe3f-4338-ad2d-11ecc3b13000 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:15.395596 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7fdeeafe-fe3f-4338-ad2d-11ecc3b13000 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:15.396453 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7fdeeafe-fe3f-4338-ad2d-11ecc3b13000 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:15.397082 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7fdeeafe-fe3f-4338-ad2d-11ecc3b13000 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:15.538048 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-7fdeeafe-fe3f-4338-ad2d-11ecc3b13000 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:15.546237 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-7fdeeafe-fe3f-4338-ad2d-11ecc3b13000 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.164489 Jul 20 19:34:15.546879 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 521/1047] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:15 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:15.646735 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-3d704cf4-bf5b-4782-98e1-5ddcafa7c783 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:15.647256 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-3d704cf4-bf5b-4782-98e1-5ddcafa7c783 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:15.653926 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3d704cf4-bf5b-4782-98e1-5ddcafa7c783 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:15.654507 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3d704cf4-bf5b-4782-98e1-5ddcafa7c783 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:15.655129 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3d704cf4-bf5b-4782-98e1-5ddcafa7c783 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:15.655566 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3d704cf4-bf5b-4782-98e1-5ddcafa7c783 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:15.719082 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-3d704cf4-bf5b-4782-98e1-5ddcafa7c783 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:15.726547 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-3d704cf4-bf5b-4782-98e1-5ddcafa7c783 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.083728 Jul 20 19:34:15.727095 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 527/1048] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:15 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:15.826809 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-dac32290-604d-471f-b5f6-be5111649eb8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:15.827427 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-dac32290-604d-471f-b5f6-be5111649eb8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:15.834542 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-dac32290-604d-471f-b5f6-be5111649eb8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:15.834997 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-dac32290-604d-471f-b5f6-be5111649eb8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:15.835762 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-dac32290-604d-471f-b5f6-be5111649eb8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:15.836199 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-dac32290-604d-471f-b5f6-be5111649eb8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:15.970038 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-dac32290-604d-471f-b5f6-be5111649eb8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:15.978290 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-dac32290-604d-471f-b5f6-be5111649eb8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:15.979777 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-dac32290-604d-471f-b5f6-be5111649eb8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:15.981012 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-dac32290-604d-471f-b5f6-be5111649eb8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.158122 Jul 20 19:34:15.981576 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 522/1049] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:34:15 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:34:16.564761 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-462f6031-c05a-4b1c-9038-bd7786ad44dd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:16.565346 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-462f6031-c05a-4b1c-9038-bd7786ad44dd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:16.571548 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-462f6031-c05a-4b1c-9038-bd7786ad44dd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:16.571993 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-462f6031-c05a-4b1c-9038-bd7786ad44dd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:16.572767 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-462f6031-c05a-4b1c-9038-bd7786ad44dd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:16.573198 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-462f6031-c05a-4b1c-9038-bd7786ad44dd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:16.713905 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-462f6031-c05a-4b1c-9038-bd7786ad44dd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:16.722455 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-462f6031-c05a-4b1c-9038-bd7786ad44dd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.161582 Jul 20 19:34:16.723018 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 528/1050] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:16 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:16.743480 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4048aa4d-efa9-4d59-92b6-70e452f00e4a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:16.744090 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-4048aa4d-efa9-4d59-92b6-70e452f00e4a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:16.750034 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4048aa4d-efa9-4d59-92b6-70e452f00e4a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:16.750629 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4048aa4d-efa9-4d59-92b6-70e452f00e4a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:16.751389 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4048aa4d-efa9-4d59-92b6-70e452f00e4a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:16.751925 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4048aa4d-efa9-4d59-92b6-70e452f00e4a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:16.813427 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-4048aa4d-efa9-4d59-92b6-70e452f00e4a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:16.821328 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-4048aa4d-efa9-4d59-92b6-70e452f00e4a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.082080 Jul 20 19:34:16.821918 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 523/1051] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:16 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:34:16.999712 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-4c209395-e4bf-4801-b1cd-fdccbb0c0861 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:17.000316 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-4c209395-e4bf-4801-b1cd-fdccbb0c0861 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:17.007043 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4c209395-e4bf-4801-b1cd-fdccbb0c0861 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:17.007495 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4c209395-e4bf-4801-b1cd-fdccbb0c0861 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:17.008262 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4c209395-e4bf-4801-b1cd-fdccbb0c0861 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:17.008713 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4c209395-e4bf-4801-b1cd-fdccbb0c0861 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:17.139606 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-4c209395-e4bf-4801-b1cd-fdccbb0c0861 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:17.148824 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-4c209395-e4bf-4801-b1cd-fdccbb0c0861 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:17.150358 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-4c209395-e4bf-4801-b1cd-fdccbb0c0861 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:17.151502 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-4c209395-e4bf-4801-b1cd-fdccbb0c0861 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.155710 Jul 20 19:34:17.152043 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 529/1052] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:34:16 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:34:17.739592 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e3c0fe58-9270-45fa-8cdb-4f057f65edcf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:17.740193 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e3c0fe58-9270-45fa-8cdb-4f057f65edcf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:17.746769 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e3c0fe58-9270-45fa-8cdb-4f057f65edcf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:17.747366 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e3c0fe58-9270-45fa-8cdb-4f057f65edcf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:17.747948 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e3c0fe58-9270-45fa-8cdb-4f057f65edcf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:17.748381 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e3c0fe58-9270-45fa-8cdb-4f057f65edcf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:17.839027 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-7bb59407-1407-4780-a8a1-56847961a50f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:17.839641 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-7bb59407-1407-4780-a8a1-56847961a50f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:17.846425 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-7bb59407-1407-4780-a8a1-56847961a50f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:17.846891 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-7bb59407-1407-4780-a8a1-56847961a50f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:17.847677 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-7bb59407-1407-4780-a8a1-56847961a50f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:17.848149 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-7bb59407-1407-4780-a8a1-56847961a50f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:17.887414 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e3c0fe58-9270-45fa-8cdb-4f057f65edcf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:17.895674 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e3c0fe58-9270-45fa-8cdb-4f057f65edcf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.160094 Jul 20 19:34:17.896262 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 524/1053] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:17 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:17.910660 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-7bb59407-1407-4780-a8a1-56847961a50f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:17.918164 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-7bb59407-1407-4780-a8a1-56847961a50f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.083272 Jul 20 19:34:17.918718 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 530/1054] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:17 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:34:18.171051 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-732cf986-8cbb-4ee1-babf-b36494d24b1c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:18.171660 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-732cf986-8cbb-4ee1-babf-b36494d24b1c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:18.178519 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-732cf986-8cbb-4ee1-babf-b36494d24b1c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:18.178965 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-732cf986-8cbb-4ee1-babf-b36494d24b1c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:18.179873 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-732cf986-8cbb-4ee1-babf-b36494d24b1c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:18.180360 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-732cf986-8cbb-4ee1-babf-b36494d24b1c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:18.315525 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-732cf986-8cbb-4ee1-babf-b36494d24b1c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:18.324873 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-732cf986-8cbb-4ee1-babf-b36494d24b1c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:18.327081 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-732cf986-8cbb-4ee1-babf-b36494d24b1c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:18.328271 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-732cf986-8cbb-4ee1-babf-b36494d24b1c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.161312 Jul 20 19:34:18.328821 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 525/1055] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:34:18 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:34:18.916783 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-4d82368f-ea83-47fa-b9b3-ad2f7a268e43 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:18.917951 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-4d82368f-ea83-47fa-b9b3-ad2f7a268e43 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:18.925871 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4d82368f-ea83-47fa-b9b3-ad2f7a268e43 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:18.926317 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4d82368f-ea83-47fa-b9b3-ad2f7a268e43 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:18.927113 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4d82368f-ea83-47fa-b9b3-ad2f7a268e43 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:18.927549 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4d82368f-ea83-47fa-b9b3-ad2f7a268e43 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:18.936014 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-12ec28aa-1452-43ed-9cd3-5b01328670ba tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:18.936629 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-12ec28aa-1452-43ed-9cd3-5b01328670ba tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:18.944464 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-12ec28aa-1452-43ed-9cd3-5b01328670ba tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:18.945553 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-12ec28aa-1452-43ed-9cd3-5b01328670ba tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:18.945727 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-12ec28aa-1452-43ed-9cd3-5b01328670ba tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:18.946165 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-12ec28aa-1452-43ed-9cd3-5b01328670ba tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:19.023506 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-12ec28aa-1452-43ed-9cd3-5b01328670ba tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:19.033029 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-12ec28aa-1452-43ed-9cd3-5b01328670ba tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.100918 Jul 20 19:34:19.033828 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 526/1056] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:18 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:19.078565 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-4d82368f-ea83-47fa-b9b3-ad2f7a268e43 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:19.086498 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-4d82368f-ea83-47fa-b9b3-ad2f7a268e43 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.176332 Jul 20 19:34:19.087089 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 531/1057] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:18 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:19.347106 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-fbdce9da-d481-4719-bf9b-283855088fe4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:19.347736 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-fbdce9da-d481-4719-bf9b-283855088fe4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:19.353768 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fbdce9da-d481-4719-bf9b-283855088fe4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:19.354210 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fbdce9da-d481-4719-bf9b-283855088fe4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:19.354983 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fbdce9da-d481-4719-bf9b-283855088fe4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:19.355405 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fbdce9da-d481-4719-bf9b-283855088fe4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:19.491920 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-fbdce9da-d481-4719-bf9b-283855088fe4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:19.500560 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-fbdce9da-d481-4719-bf9b-283855088fe4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:19.502204 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-fbdce9da-d481-4719-bf9b-283855088fe4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:19.504045 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-fbdce9da-d481-4719-bf9b-283855088fe4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.161392 Jul 20 19:34:19.504627 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 527/1058] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:34:19 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:34:20.052377 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-3c1afeb8-7d79-4054-85ad-57d4278a377b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:20.052782 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-3c1afeb8-7d79-4054-85ad-57d4278a377b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:20.059587 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3c1afeb8-7d79-4054-85ad-57d4278a377b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:20.060090 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3c1afeb8-7d79-4054-85ad-57d4278a377b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:20.060813 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3c1afeb8-7d79-4054-85ad-57d4278a377b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:20.061247 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3c1afeb8-7d79-4054-85ad-57d4278a377b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:20.112924 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-47510f80-9197-4bc3-9690-255049b200a0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:20.113808 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-47510f80-9197-4bc3-9690-255049b200a0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:20.120213 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-47510f80-9197-4bc3-9690-255049b200a0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:20.120761 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-47510f80-9197-4bc3-9690-255049b200a0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:20.121561 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-47510f80-9197-4bc3-9690-255049b200a0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:20.122338 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-47510f80-9197-4bc3-9690-255049b200a0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:20.127435 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-3c1afeb8-7d79-4054-85ad-57d4278a377b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:20.136212 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-3c1afeb8-7d79-4054-85ad-57d4278a377b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.088572 Jul 20 19:34:20.136783 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 532/1059] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:20 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:20.358898 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-47510f80-9197-4bc3-9690-255049b200a0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:20.366851 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-47510f80-9197-4bc3-9690-255049b200a0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.264970 Jul 20 19:34:20.367430 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 528/1060] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:20 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:20.522855 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-3e0e035c-70df-4d3f-8550-3bbedf501bfb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:20.523457 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-3e0e035c-70df-4d3f-8550-3bbedf501bfb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:20.529413 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3e0e035c-70df-4d3f-8550-3bbedf501bfb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:20.529883 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3e0e035c-70df-4d3f-8550-3bbedf501bfb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:20.530638 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3e0e035c-70df-4d3f-8550-3bbedf501bfb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:20.531060 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3e0e035c-70df-4d3f-8550-3bbedf501bfb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:20.667224 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-3e0e035c-70df-4d3f-8550-3bbedf501bfb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:20.678040 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-3e0e035c-70df-4d3f-8550-3bbedf501bfb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:20.679558 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-3e0e035c-70df-4d3f-8550-3bbedf501bfb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:20.680733 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-3e0e035c-70df-4d3f-8550-3bbedf501bfb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.161854 Jul 20 19:34:20.681320 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 533/1061] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:34:20 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:34:21.152921 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-3242fa32-e386-4b2e-a0d4-f6cf2c3d7d2a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:21.153746 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-3242fa32-e386-4b2e-a0d4-f6cf2c3d7d2a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:21.160567 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3242fa32-e386-4b2e-a0d4-f6cf2c3d7d2a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:21.161014 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3242fa32-e386-4b2e-a0d4-f6cf2c3d7d2a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:21.161803 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3242fa32-e386-4b2e-a0d4-f6cf2c3d7d2a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:21.162240 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3242fa32-e386-4b2e-a0d4-f6cf2c3d7d2a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:21.179490 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:34:21.231558 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3242fa32-e386-4b2e-a0d4-f6cf2c3d7d2a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:21.239334 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-3242fa32-e386-4b2e-a0d4-f6cf2c3d7d2a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.090284 Jul 20 19:34:21.239903 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 529/1062] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:21 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:21.384379 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-f8b052f3-e144-4647-ab46-e3392a9e758a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:21.384981 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-f8b052f3-e144-4647-ab46-e3392a9e758a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:21.391621 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f8b052f3-e144-4647-ab46-e3392a9e758a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:21.392568 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f8b052f3-e144-4647-ab46-e3392a9e758a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:21.393373 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f8b052f3-e144-4647-ab46-e3392a9e758a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:21.393835 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f8b052f3-e144-4647-ab46-e3392a9e758a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:21.550783 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-f8b052f3-e144-4647-ab46-e3392a9e758a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:21.558412 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-f8b052f3-e144-4647-ab46-e3392a9e758a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.178030 Jul 20 19:34:21.558974 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 534/1063] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:21 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:34:21.699267 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-50d50856-21a3-4f52-86c4-9802a21e29e1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:21.699878 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-50d50856-21a3-4f52-86c4-9802a21e29e1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:21.706579 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-50d50856-21a3-4f52-86c4-9802a21e29e1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:21.707030 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-50d50856-21a3-4f52-86c4-9802a21e29e1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:21.707806 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-50d50856-21a3-4f52-86c4-9802a21e29e1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:21.708239 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-50d50856-21a3-4f52-86c4-9802a21e29e1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:22.078811 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-50d50856-21a3-4f52-86c4-9802a21e29e1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:22.088104 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-50d50856-21a3-4f52-86c4-9802a21e29e1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:22.089632 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-50d50856-21a3-4f52-86c4-9802a21e29e1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:22.090804 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-50d50856-21a3-4f52-86c4-9802a21e29e1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.395473 Jul 20 19:34:22.091358 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 530/1064] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:34:21 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:34:22.256924 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-afe0091b-cd0b-4313-a3f5-16b89b57ab9b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:22.257533 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-afe0091b-cd0b-4313-a3f5-16b89b57ab9b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:22.263581 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-afe0091b-cd0b-4313-a3f5-16b89b57ab9b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:22.264022 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-afe0091b-cd0b-4313-a3f5-16b89b57ab9b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:22.264780 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-afe0091b-cd0b-4313-a3f5-16b89b57ab9b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:22.265210 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-afe0091b-cd0b-4313-a3f5-16b89b57ab9b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:22.328352 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-afe0091b-cd0b-4313-a3f5-16b89b57ab9b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:22.335904 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-afe0091b-cd0b-4313-a3f5-16b89b57ab9b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.082897 Jul 20 19:34:22.336452 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 535/1065] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:22 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:22.575921 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c9d14fb5-9732-4311-b96d-346ee9eff99b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:22.576502 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c9d14fb5-9732-4311-b96d-346ee9eff99b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:22.584199 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c9d14fb5-9732-4311-b96d-346ee9eff99b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:22.584777 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c9d14fb5-9732-4311-b96d-346ee9eff99b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:22.585584 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c9d14fb5-9732-4311-b96d-346ee9eff99b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:22.586052 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c9d14fb5-9732-4311-b96d-346ee9eff99b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:22.722149 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c9d14fb5-9732-4311-b96d-346ee9eff99b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:22.730222 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c9d14fb5-9732-4311-b96d-346ee9eff99b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.158277 Jul 20 19:34:22.730878 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 531/1066] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:22 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:23.109064 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-da34e3e8-6fb4-470b-b6e2-936c4458d90b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:23.109793 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-da34e3e8-6fb4-470b-b6e2-936c4458d90b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:23.117055 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-da34e3e8-6fb4-470b-b6e2-936c4458d90b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:23.117500 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-da34e3e8-6fb4-470b-b6e2-936c4458d90b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:23.118283 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-da34e3e8-6fb4-470b-b6e2-936c4458d90b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:23.118712 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-da34e3e8-6fb4-470b-b6e2-936c4458d90b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:23.136125 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_cell1:SELECT=100 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:34:23.260645 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-da34e3e8-6fb4-470b-b6e2-936c4458d90b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:23.271806 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-da34e3e8-6fb4-470b-b6e2-936c4458d90b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:23.273324 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-da34e3e8-6fb4-470b-b6e2-936c4458d90b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:23.274536 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-da34e3e8-6fb4-470b-b6e2-936c4458d90b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.169447 Jul 20 19:34:23.275233 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 536/1067] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:34:23 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:34:23.354344 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-0aa180a6-c3a9-4f39-bd24-d5533c8d5042 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:23.354953 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-0aa180a6-c3a9-4f39-bd24-d5533c8d5042 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:23.361704 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0aa180a6-c3a9-4f39-bd24-d5533c8d5042 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:23.362144 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0aa180a6-c3a9-4f39-bd24-d5533c8d5042 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:23.362914 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0aa180a6-c3a9-4f39-bd24-d5533c8d5042 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:23.363345 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0aa180a6-c3a9-4f39-bd24-d5533c8d5042 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:23.429996 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0aa180a6-c3a9-4f39-bd24-d5533c8d5042 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:23.438290 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-0aa180a6-c3a9-4f39-bd24-d5533c8d5042 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.087951 Jul 20 19:34:23.438864 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 532/1068] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:23 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:23.747808 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-4f2ad415-cea4-4e87-b142-a63daf3d447d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:23.748414 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-4f2ad415-cea4-4e87-b142-a63daf3d447d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:23.754688 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4f2ad415-cea4-4e87-b142-a63daf3d447d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:23.755136 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4f2ad415-cea4-4e87-b142-a63daf3d447d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:23.755897 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4f2ad415-cea4-4e87-b142-a63daf3d447d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:23.756329 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4f2ad415-cea4-4e87-b142-a63daf3d447d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:23.889751 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-4f2ad415-cea4-4e87-b142-a63daf3d447d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:23.897475 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-4f2ad415-cea4-4e87-b142-a63daf3d447d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.153528 Jul 20 19:34:23.898139 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 537/1069] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:23 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:24.293530 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-f9fe304e-789d-490f-bd12-21bc48909280 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:24.294139 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-f9fe304e-789d-490f-bd12-21bc48909280 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:24.301357 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f9fe304e-789d-490f-bd12-21bc48909280 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:24.301845 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f9fe304e-789d-490f-bd12-21bc48909280 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:24.302617 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f9fe304e-789d-490f-bd12-21bc48909280 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:24.303058 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f9fe304e-789d-490f-bd12-21bc48909280 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:24.432670 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-f9fe304e-789d-490f-bd12-21bc48909280 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:24.441829 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-f9fe304e-789d-490f-bd12-21bc48909280 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:24.443345 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-f9fe304e-789d-490f-bd12-21bc48909280 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:24.444512 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-f9fe304e-789d-490f-bd12-21bc48909280 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.154913 Jul 20 19:34:24.445073 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 533/1070] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:34:24 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:34:24.455708 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-48c44243-fc51-422b-a3b5-c8f0879485e7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:24.456309 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-48c44243-fc51-422b-a3b5-c8f0879485e7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:24.463116 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-48c44243-fc51-422b-a3b5-c8f0879485e7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:24.463570 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-48c44243-fc51-422b-a3b5-c8f0879485e7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:24.464341 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-48c44243-fc51-422b-a3b5-c8f0879485e7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:24.464778 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-48c44243-fc51-422b-a3b5-c8f0879485e7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:24.526319 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-48c44243-fc51-422b-a3b5-c8f0879485e7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:24.534369 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-48c44243-fc51-422b-a3b5-c8f0879485e7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.082616 Jul 20 19:34:24.534936 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 538/1071] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:24 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:34:24.915197 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-443594cc-3400-46d0-97d3-4d97bfbec1aa tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:24.915840 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-443594cc-3400-46d0-97d3-4d97bfbec1aa tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:24.921905 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-443594cc-3400-46d0-97d3-4d97bfbec1aa tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:24.922359 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-443594cc-3400-46d0-97d3-4d97bfbec1aa tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:24.923121 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-443594cc-3400-46d0-97d3-4d97bfbec1aa tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:24.923701 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-443594cc-3400-46d0-97d3-4d97bfbec1aa tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:25.057437 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-443594cc-3400-46d0-97d3-4d97bfbec1aa tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:25.065368 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-443594cc-3400-46d0-97d3-4d97bfbec1aa tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.154066 Jul 20 19:34:25.065979 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 534/1072] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:24 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:25.463888 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-2ea1ca8b-2dc5-4b01-a646-85a6e33f0830 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:25.464522 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-2ea1ca8b-2dc5-4b01-a646-85a6e33f0830 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:25.466927 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_api:SELECT=70 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:34:25.472771 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2ea1ca8b-2dc5-4b01-a646-85a6e33f0830 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:25.473214 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2ea1ca8b-2dc5-4b01-a646-85a6e33f0830 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:25.474032 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2ea1ca8b-2dc5-4b01-a646-85a6e33f0830 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:25.474457 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2ea1ca8b-2dc5-4b01-a646-85a6e33f0830 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:25.552008 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-fdb13685-4a8d-4278-ad55-c303ba2b8fa4 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:25.552604 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-fdb13685-4a8d-4278-ad55-c303ba2b8fa4 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:25.559273 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fdb13685-4a8d-4278-ad55-c303ba2b8fa4 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:25.559731 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fdb13685-4a8d-4278-ad55-c303ba2b8fa4 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:25.560512 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fdb13685-4a8d-4278-ad55-c303ba2b8fa4 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:25.560951 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fdb13685-4a8d-4278-ad55-c303ba2b8fa4 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:25.612284 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-2ea1ca8b-2dc5-4b01-a646-85a6e33f0830 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:25.624303 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-fdb13685-4a8d-4278-ad55-c303ba2b8fa4 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:25.625949 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-2ea1ca8b-2dc5-4b01-a646-85a6e33f0830 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:25.629610 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-2ea1ca8b-2dc5-4b01-a646-85a6e33f0830 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:25.631676 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-2ea1ca8b-2dc5-4b01-a646-85a6e33f0830 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.171753 Jul 20 19:34:25.632669 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 539/1073] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:34:25 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:34:25.633053 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-fdb13685-4a8d-4278-ad55-c303ba2b8fa4 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.085644 Jul 20 19:34:25.633881 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 535/1074] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:25 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:34:25.945191 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [req-1400fac3-dcb8-4279-9fac-5be7c257a0bd req-ffb7d616-3cc5-47e1-9b90-9857f0930019 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "239cb0b6-54d7-4cc2-945a-1f026a015992", "name": "network-vif-unplugged", "status": "completed", "tag": "761fbace-90da-4e61-bc51-77b19745762a"}]} {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:34:25.953379 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [req-1400fac3-dcb8-4279-9fac-5be7c257a0bd req-ffb7d616-3cc5-47e1-9b90-9857f0930019 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:25.953855 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [req-1400fac3-dcb8-4279-9fac-5be7c257a0bd req-ffb7d616-3cc5-47e1-9b90-9857f0930019 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:25.965153 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.compute.server_external_events [req-1400fac3-dcb8-4279-9fac-5be7c257a0bd req-ffb7d616-3cc5-47e1-9b90-9857f0930019 service nova] Creating event network-vif-unplugged:761fbace-90da-4e61-bc51-77b19745762a for instance 239cb0b6-54d7-4cc2-945a-1f026a015992 on hv-cinder-83538 Jul 20 19:34:25.971177 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [req-1400fac3-dcb8-4279-9fac-5be7c257a0bd req-ffb7d616-3cc5-47e1-9b90-9857f0930019 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081566 Jul 20 19:34:25.971732 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 540/1075] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 19:34:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:34:26.082790 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-0181a77f-1d0a-4c75-8eb8-197911131356 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:26.083396 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-0181a77f-1d0a-4c75-8eb8-197911131356 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:26.090474 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0181a77f-1d0a-4c75-8eb8-197911131356 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:26.090911 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0181a77f-1d0a-4c75-8eb8-197911131356 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:26.091666 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0181a77f-1d0a-4c75-8eb8-197911131356 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:26.092100 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0181a77f-1d0a-4c75-8eb8-197911131356 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:26.232677 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0181a77f-1d0a-4c75-8eb8-197911131356 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:26.240768 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-0181a77f-1d0a-4c75-8eb8-197911131356 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.162364 Jul 20 19:34:26.241553 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 536/1076] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:26 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:26.649845 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-be438427-3838-4da0-826b-eab8f1ffbd0d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:26.650472 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-b00b829d-0cf5-43df-9588-e88e3ed8cf57 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:26.650852 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-be438427-3838-4da0-826b-eab8f1ffbd0d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:26.650958 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-b00b829d-0cf5-43df-9588-e88e3ed8cf57 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:26.656895 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-be438427-3838-4da0-826b-eab8f1ffbd0d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:26.657346 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-be438427-3838-4da0-826b-eab8f1ffbd0d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:26.657519 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b00b829d-0cf5-43df-9588-e88e3ed8cf57 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:26.658765 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-be438427-3838-4da0-826b-eab8f1ffbd0d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:26.658938 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b00b829d-0cf5-43df-9588-e88e3ed8cf57 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:26.659227 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-be438427-3838-4da0-826b-eab8f1ffbd0d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:26.659667 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b00b829d-0cf5-43df-9588-e88e3ed8cf57 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:26.660100 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-b00b829d-0cf5-43df-9588-e88e3ed8cf57 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:26.724473 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-be438427-3838-4da0-826b-eab8f1ffbd0d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:26.732017 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-be438427-3838-4da0-826b-eab8f1ffbd0d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.086136 Jul 20 19:34:26.733211 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 537/1077] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:26 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:26.796336 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-b00b829d-0cf5-43df-9588-e88e3ed8cf57 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:26.805158 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-b00b829d-0cf5-43df-9588-e88e3ed8cf57 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:26.806705 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-b00b829d-0cf5-43df-9588-e88e3ed8cf57 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:26.807870 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-b00b829d-0cf5-43df-9588-e88e3ed8cf57 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.161855 Jul 20 19:34:26.808423 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 541/1078] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:34:26 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:34:27.257057 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-7aa04704-ed7c-4629-ab1b-995df0b6ef6c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:27.257706 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-7aa04704-ed7c-4629-ab1b-995df0b6ef6c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:27.263923 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7aa04704-ed7c-4629-ab1b-995df0b6ef6c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:27.264376 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7aa04704-ed7c-4629-ab1b-995df0b6ef6c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:27.265174 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7aa04704-ed7c-4629-ab1b-995df0b6ef6c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:27.265639 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7aa04704-ed7c-4629-ab1b-995df0b6ef6c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:27.401712 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-7aa04704-ed7c-4629-ab1b-995df0b6ef6c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:27.409894 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-7aa04704-ed7c-4629-ab1b-995df0b6ef6c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.156674 Jul 20 19:34:27.410466 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 538/1079] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:27 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:27.748952 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-390b0cc0-c969-463c-8aa1-61bdcdfaa7d5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:27.749584 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-390b0cc0-c969-463c-8aa1-61bdcdfaa7d5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:27.756806 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-390b0cc0-c969-463c-8aa1-61bdcdfaa7d5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:27.757261 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-390b0cc0-c969-463c-8aa1-61bdcdfaa7d5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:27.758065 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-390b0cc0-c969-463c-8aa1-61bdcdfaa7d5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:27.758517 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-390b0cc0-c969-463c-8aa1-61bdcdfaa7d5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:27.823181 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-390b0cc0-c969-463c-8aa1-61bdcdfaa7d5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:27.826409 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-712c76af-91ac-4fa2-bb33-db251249e98a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:27.827017 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-712c76af-91ac-4fa2-bb33-db251249e98a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:27.831366 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-390b0cc0-c969-463c-8aa1-61bdcdfaa7d5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.086214 Jul 20 19:34:27.832138 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 542/1080] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:27 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:34:27.833685 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-712c76af-91ac-4fa2-bb33-db251249e98a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:27.834127 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-712c76af-91ac-4fa2-bb33-db251249e98a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:27.834902 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-712c76af-91ac-4fa2-bb33-db251249e98a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:27.835333 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-712c76af-91ac-4fa2-bb33-db251249e98a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:27.966103 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-712c76af-91ac-4fa2-bb33-db251249e98a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:27.975128 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-712c76af-91ac-4fa2-bb33-db251249e98a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:27.976623 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-712c76af-91ac-4fa2-bb33-db251249e98a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:27.977890 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-712c76af-91ac-4fa2-bb33-db251249e98a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.155249 Jul 20 19:34:27.978381 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 539/1081] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:34:27 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:34:28.428306 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-c4014438-f89c-4c93-9713-1fc897d8a95f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:28.428830 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-c4014438-f89c-4c93-9713-1fc897d8a95f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:28.435114 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c4014438-f89c-4c93-9713-1fc897d8a95f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:28.435554 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c4014438-f89c-4c93-9713-1fc897d8a95f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:28.436308 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c4014438-f89c-4c93-9713-1fc897d8a95f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:28.436734 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c4014438-f89c-4c93-9713-1fc897d8a95f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:28.569421 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-c4014438-f89c-4c93-9713-1fc897d8a95f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:28.577239 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-c4014438-f89c-4c93-9713-1fc897d8a95f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.153749 Jul 20 19:34:28.577831 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 543/1082] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:28 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:34:28.848915 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-0f259478-6fcf-4f11-9240-a3c80db7910d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:28.849447 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-0f259478-6fcf-4f11-9240-a3c80db7910d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:28.856218 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0f259478-6fcf-4f11-9240-a3c80db7910d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:28.856669 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0f259478-6fcf-4f11-9240-a3c80db7910d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:28.857444 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0f259478-6fcf-4f11-9240-a3c80db7910d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:28.857905 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0f259478-6fcf-4f11-9240-a3c80db7910d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:28.921587 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0f259478-6fcf-4f11-9240-a3c80db7910d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:28.929569 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-0f259478-6fcf-4f11-9240-a3c80db7910d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.085248 Jul 20 19:34:28.930400 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 540/1083] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:28 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:28.995919 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-738ec669-c093-4f29-a3d9-fcf2d6939110 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:28.996482 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-738ec669-c093-4f29-a3d9-fcf2d6939110 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:29.003602 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-738ec669-c093-4f29-a3d9-fcf2d6939110 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:29.004039 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-738ec669-c093-4f29-a3d9-fcf2d6939110 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:29.004782 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-738ec669-c093-4f29-a3d9-fcf2d6939110 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:29.005210 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-738ec669-c093-4f29-a3d9-fcf2d6939110 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:29.132336 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-738ec669-c093-4f29-a3d9-fcf2d6939110 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:29.148958 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-738ec669-c093-4f29-a3d9-fcf2d6939110 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:29.150490 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-738ec669-c093-4f29-a3d9-fcf2d6939110 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:29.151641 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-738ec669-c093-4f29-a3d9-fcf2d6939110 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.159618 Jul 20 19:34:29.152189 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 544/1084] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:34:28 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:34:29.594881 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-46132f4a-5680-4b06-ace0-6eb3f62bb014 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:29.595643 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-46132f4a-5680-4b06-ace0-6eb3f62bb014 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:29.602011 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-46132f4a-5680-4b06-ace0-6eb3f62bb014 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:29.602458 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-46132f4a-5680-4b06-ace0-6eb3f62bb014 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:29.603214 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-46132f4a-5680-4b06-ace0-6eb3f62bb014 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:29.603672 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-46132f4a-5680-4b06-ace0-6eb3f62bb014 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:29.736788 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-46132f4a-5680-4b06-ace0-6eb3f62bb014 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:29.744254 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-46132f4a-5680-4b06-ace0-6eb3f62bb014 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.153319 Jul 20 19:34:29.744806 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 541/1085] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:29 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:29.946570 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-3f22533b-1449-49cb-b26b-30cc346b9514 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:29.947171 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-3f22533b-1449-49cb-b26b-30cc346b9514 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:29.953536 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3f22533b-1449-49cb-b26b-30cc346b9514 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:29.953999 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3f22533b-1449-49cb-b26b-30cc346b9514 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:29.955680 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3f22533b-1449-49cb-b26b-30cc346b9514 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:29.956113 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3f22533b-1449-49cb-b26b-30cc346b9514 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:30.017723 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-3f22533b-1449-49cb-b26b-30cc346b9514 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:30.025740 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-3f22533b-1449-49cb-b26b-30cc346b9514 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.083220 Jul 20 19:34:30.026318 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 545/1086] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:29 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:30.170401 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-7bfa00d7-87bd-4f18-8bfc-d7c467992c63 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:30.171014 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-7bfa00d7-87bd-4f18-8bfc-d7c467992c63 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:30.178483 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7bfa00d7-87bd-4f18-8bfc-d7c467992c63 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:30.178933 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7bfa00d7-87bd-4f18-8bfc-d7c467992c63 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:30.179699 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7bfa00d7-87bd-4f18-8bfc-d7c467992c63 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:30.180138 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7bfa00d7-87bd-4f18-8bfc-d7c467992c63 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:30.317647 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-7bfa00d7-87bd-4f18-8bfc-d7c467992c63 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:30.326286 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-7bfa00d7-87bd-4f18-8bfc-d7c467992c63 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:30.327788 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-7bfa00d7-87bd-4f18-8bfc-d7c467992c63 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:30.328950 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-7bfa00d7-87bd-4f18-8bfc-d7c467992c63 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.162477 Jul 20 19:34:30.329617 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 542/1087] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:34:30 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:34:30.761932 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-48b51485-f741-41ee-b60e-8333f6128050 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:30.762526 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-48b51485-f741-41ee-b60e-8333f6128050 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:30.768668 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-48b51485-f741-41ee-b60e-8333f6128050 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:30.769105 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-48b51485-f741-41ee-b60e-8333f6128050 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:30.769874 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-48b51485-f741-41ee-b60e-8333f6128050 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:30.770302 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-48b51485-f741-41ee-b60e-8333f6128050 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:30.907195 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-48b51485-f741-41ee-b60e-8333f6128050 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:30.915617 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-48b51485-f741-41ee-b60e-8333f6128050 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.157579 Jul 20 19:34:30.916182 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 546/1088] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:30 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:31.042852 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-01b588a1-d4a8-47f9-9f44-9e62ea8dfc13 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:31.043381 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-01b588a1-d4a8-47f9-9f44-9e62ea8dfc13 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:31.050269 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-01b588a1-d4a8-47f9-9f44-9e62ea8dfc13 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:31.050707 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-01b588a1-d4a8-47f9-9f44-9e62ea8dfc13 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:31.051464 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-01b588a1-d4a8-47f9-9f44-9e62ea8dfc13 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:31.051893 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-01b588a1-d4a8-47f9-9f44-9e62ea8dfc13 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:31.119241 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-01b588a1-d4a8-47f9-9f44-9e62ea8dfc13 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:31.131100 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-01b588a1-d4a8-47f9-9f44-9e62ea8dfc13 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.091960 Jul 20 19:34:31.131867 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 543/1089] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:31 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:31.348684 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-90259b26-b324-4c65-8a23-78365906eb47 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:31.349400 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-90259b26-b324-4c65-8a23-78365906eb47 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:31.355929 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-90259b26-b324-4c65-8a23-78365906eb47 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:31.356367 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-90259b26-b324-4c65-8a23-78365906eb47 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:31.357130 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-90259b26-b324-4c65-8a23-78365906eb47 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:31.357586 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-90259b26-b324-4c65-8a23-78365906eb47 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:31.486292 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-90259b26-b324-4c65-8a23-78365906eb47 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:31.494719 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-90259b26-b324-4c65-8a23-78365906eb47 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:31.496242 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-90259b26-b324-4c65-8a23-78365906eb47 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:31.497391 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-90259b26-b324-4c65-8a23-78365906eb47 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.152720 Jul 20 19:34:31.497988 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 547/1090] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:34:31 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:34:31.933272 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a8a89bbf-eacf-40e7-b53d-48dc8f78f4d8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:31.933916 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a8a89bbf-eacf-40e7-b53d-48dc8f78f4d8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:31.941172 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a8a89bbf-eacf-40e7-b53d-48dc8f78f4d8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:31.941655 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a8a89bbf-eacf-40e7-b53d-48dc8f78f4d8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:31.942422 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a8a89bbf-eacf-40e7-b53d-48dc8f78f4d8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:31.942856 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a8a89bbf-eacf-40e7-b53d-48dc8f78f4d8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:32.073116 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a8a89bbf-eacf-40e7-b53d-48dc8f78f4d8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:32.080703 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a8a89bbf-eacf-40e7-b53d-48dc8f78f4d8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.151207 Jul 20 19:34:32.081362 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 544/1091] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:31 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:32.152290 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-20be2c9c-a82b-443a-b644-06ff1dc79d36 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:32.152888 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-20be2c9c-a82b-443a-b644-06ff1dc79d36 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:32.159785 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-20be2c9c-a82b-443a-b644-06ff1dc79d36 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:32.160233 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-20be2c9c-a82b-443a-b644-06ff1dc79d36 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:32.160989 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-20be2c9c-a82b-443a-b644-06ff1dc79d36 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:32.161425 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-20be2c9c-a82b-443a-b644-06ff1dc79d36 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:32.222701 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-20be2c9c-a82b-443a-b644-06ff1dc79d36 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:32.230161 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-20be2c9c-a82b-443a-b644-06ff1dc79d36 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.081737 Jul 20 19:34:32.230724 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 548/1092] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:32 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:32.516771 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-391cdfcd-c6f2-4304-9e19-a7069635429d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:32.517301 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-391cdfcd-c6f2-4304-9e19-a7069635429d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:32.523885 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-391cdfcd-c6f2-4304-9e19-a7069635429d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:32.524334 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-391cdfcd-c6f2-4304-9e19-a7069635429d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:32.525094 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-391cdfcd-c6f2-4304-9e19-a7069635429d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:32.525541 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-391cdfcd-c6f2-4304-9e19-a7069635429d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:32.654764 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-391cdfcd-c6f2-4304-9e19-a7069635429d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:32.664001 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-391cdfcd-c6f2-4304-9e19-a7069635429d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:32.665537 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-391cdfcd-c6f2-4304-9e19-a7069635429d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:32.666709 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-391cdfcd-c6f2-4304-9e19-a7069635429d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.154215 Jul 20 19:34:32.667266 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 545/1093] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:34:32 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:34:33.098442 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-ebc292cf-5ebf-45be-8c2b-6b0c716a7f16 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:33.099041 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-ebc292cf-5ebf-45be-8c2b-6b0c716a7f16 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:33.105502 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-ebc292cf-5ebf-45be-8c2b-6b0c716a7f16 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:33.105969 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-ebc292cf-5ebf-45be-8c2b-6b0c716a7f16 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:33.106722 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-ebc292cf-5ebf-45be-8c2b-6b0c716a7f16 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:33.107150 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-ebc292cf-5ebf-45be-8c2b-6b0c716a7f16 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:33.238590 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-ebc292cf-5ebf-45be-8c2b-6b0c716a7f16 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:33.246304 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-ebc292cf-5ebf-45be-8c2b-6b0c716a7f16 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.152454 Jul 20 19:34:33.246868 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 549/1094] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:33 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:33.247160 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d11fda92-1578-41bc-9d9a-247fc05002ca tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:33.247773 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d11fda92-1578-41bc-9d9a-247fc05002ca tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:33.254400 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d11fda92-1578-41bc-9d9a-247fc05002ca tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:33.254843 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d11fda92-1578-41bc-9d9a-247fc05002ca tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:33.255606 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d11fda92-1578-41bc-9d9a-247fc05002ca tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:33.256040 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d11fda92-1578-41bc-9d9a-247fc05002ca tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:33.259923 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:34:33.321372 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d11fda92-1578-41bc-9d9a-247fc05002ca tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:33.329026 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d11fda92-1578-41bc-9d9a-247fc05002ca tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.085657 Jul 20 19:34:33.329618 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 546/1095] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:33 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:34:33.684889 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-d8389ce4-48b8-4027-90c0-a9d09c66fad3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:33.685495 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-d8389ce4-48b8-4027-90c0-a9d09c66fad3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:33.693349 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d8389ce4-48b8-4027-90c0-a9d09c66fad3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:33.693952 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d8389ce4-48b8-4027-90c0-a9d09c66fad3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:33.694967 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d8389ce4-48b8-4027-90c0-a9d09c66fad3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:33.695491 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d8389ce4-48b8-4027-90c0-a9d09c66fad3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:33.836681 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-d8389ce4-48b8-4027-90c0-a9d09c66fad3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:33.845498 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-d8389ce4-48b8-4027-90c0-a9d09c66fad3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:33.847075 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-d8389ce4-48b8-4027-90c0-a9d09c66fad3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:33.848232 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-d8389ce4-48b8-4027-90c0-a9d09c66fad3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.167329 Jul 20 19:34:33.848790 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 550/1096] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:34:33 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:34:34.263216 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a1056c19-303d-44aa-b081-445ec435ea4d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:34.263832 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a1056c19-303d-44aa-b081-445ec435ea4d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:34.270231 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a1056c19-303d-44aa-b081-445ec435ea4d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:34.270680 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a1056c19-303d-44aa-b081-445ec435ea4d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:34.271450 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a1056c19-303d-44aa-b081-445ec435ea4d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:34.271914 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a1056c19-303d-44aa-b081-445ec435ea4d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:34.347957 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-31f39781-b483-4566-84ee-1e1cc8dce8a3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:34.348570 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-31f39781-b483-4566-84ee-1e1cc8dce8a3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:34.357031 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-31f39781-b483-4566-84ee-1e1cc8dce8a3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:34.357647 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-31f39781-b483-4566-84ee-1e1cc8dce8a3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:34.358427 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-31f39781-b483-4566-84ee-1e1cc8dce8a3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:34.358865 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-31f39781-b483-4566-84ee-1e1cc8dce8a3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:34.409056 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a1056c19-303d-44aa-b081-445ec435ea4d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:34.416697 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a1056c19-303d-44aa-b081-445ec435ea4d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.157452 Jul 20 19:34:34.417270 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 547/1097] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:34 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:34.424726 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-31f39781-b483-4566-84ee-1e1cc8dce8a3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:34.432485 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-31f39781-b483-4566-84ee-1e1cc8dce8a3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.089188 Jul 20 19:34:34.433043 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 551/1098] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:34 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:34:34.867951 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-facf4498-5b60-4fc2-a691-f773f39dbbf6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:34.868476 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-facf4498-5b60-4fc2-a691-f773f39dbbf6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:34.874613 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-facf4498-5b60-4fc2-a691-f773f39dbbf6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:34.875061 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-facf4498-5b60-4fc2-a691-f773f39dbbf6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:34.875818 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-facf4498-5b60-4fc2-a691-f773f39dbbf6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:34.876250 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-facf4498-5b60-4fc2-a691-f773f39dbbf6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:35.004657 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-facf4498-5b60-4fc2-a691-f773f39dbbf6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:35.013002 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-facf4498-5b60-4fc2-a691-f773f39dbbf6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:35.014548 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-facf4498-5b60-4fc2-a691-f773f39dbbf6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:35.015716 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-facf4498-5b60-4fc2-a691-f773f39dbbf6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.151801 Jul 20 19:34:35.016278 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 548/1099] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:34:34 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:34:35.435143 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-df49306e-ae45-4e68-b98e-828a55671a59 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:35.435749 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-df49306e-ae45-4e68-b98e-828a55671a59 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:35.443149 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-df49306e-ae45-4e68-b98e-828a55671a59 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:35.443599 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-df49306e-ae45-4e68-b98e-828a55671a59 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:35.444467 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-df49306e-ae45-4e68-b98e-828a55671a59 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:35.444903 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-df49306e-ae45-4e68-b98e-828a55671a59 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:35.449108 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-9e8e88c7-ccd1-4526-92d6-28494103fb56 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:35.449794 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-9e8e88c7-ccd1-4526-92d6-28494103fb56 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:35.456178 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9e8e88c7-ccd1-4526-92d6-28494103fb56 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:35.456623 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9e8e88c7-ccd1-4526-92d6-28494103fb56 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:35.457390 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9e8e88c7-ccd1-4526-92d6-28494103fb56 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:35.457858 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9e8e88c7-ccd1-4526-92d6-28494103fb56 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:35.523228 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-9e8e88c7-ccd1-4526-92d6-28494103fb56 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:35.530830 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-9e8e88c7-ccd1-4526-92d6-28494103fb56 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.085540 Jul 20 19:34:35.531403 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 549/1100] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:35 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:34:35.577670 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-df49306e-ae45-4e68-b98e-828a55671a59 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:35.585157 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-df49306e-ae45-4e68-b98e-828a55671a59 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.153924 Jul 20 19:34:35.585753 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 552/1101] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:35 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:36.034577 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e11e8bae-1f85-4a58-9e20-de77f3c6b880 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:36.035185 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e11e8bae-1f85-4a58-9e20-de77f3c6b880 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:36.041230 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e11e8bae-1f85-4a58-9e20-de77f3c6b880 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:36.041722 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e11e8bae-1f85-4a58-9e20-de77f3c6b880 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:36.042492 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e11e8bae-1f85-4a58-9e20-de77f3c6b880 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:36.042928 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e11e8bae-1f85-4a58-9e20-de77f3c6b880 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:36.171126 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e11e8bae-1f85-4a58-9e20-de77f3c6b880 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:36.180080 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e11e8bae-1f85-4a58-9e20-de77f3c6b880 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:36.181618 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e11e8bae-1f85-4a58-9e20-de77f3c6b880 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:36.182777 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e11e8bae-1f85-4a58-9e20-de77f3c6b880 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.152134 Jul 20 19:34:36.183333 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 550/1102] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:34:36 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:34:36.547757 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-43a7e82a-5303-4668-a24f-8ecc588d9309 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:36.548366 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-43a7e82a-5303-4668-a24f-8ecc588d9309 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:36.554896 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-43a7e82a-5303-4668-a24f-8ecc588d9309 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:36.555345 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-43a7e82a-5303-4668-a24f-8ecc588d9309 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:36.556102 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-43a7e82a-5303-4668-a24f-8ecc588d9309 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:36.556538 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-43a7e82a-5303-4668-a24f-8ecc588d9309 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:36.603104 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-f1d1851a-ad2a-42a7-bc39-3f3e46aa3eac tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:36.603642 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-f1d1851a-ad2a-42a7-bc39-3f3e46aa3eac tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:36.610273 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f1d1851a-ad2a-42a7-bc39-3f3e46aa3eac tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:36.610721 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f1d1851a-ad2a-42a7-bc39-3f3e46aa3eac tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:36.611564 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f1d1851a-ad2a-42a7-bc39-3f3e46aa3eac tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:36.611998 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f1d1851a-ad2a-42a7-bc39-3f3e46aa3eac tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:36.618165 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-43a7e82a-5303-4668-a24f-8ecc588d9309 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:36.620508 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_cell1:SELECT=100 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:34:36.626891 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-43a7e82a-5303-4668-a24f-8ecc588d9309 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.082993 Jul 20 19:34:36.628278 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 553/1103] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:36 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:36.743145 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-f1d1851a-ad2a-42a7-bc39-3f3e46aa3eac tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:36.750665 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-f1d1851a-ad2a-42a7-bc39-3f3e46aa3eac tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.151481 Jul 20 19:34:36.751437 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 551/1104] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:36 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:34:37.201519 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-31fafe30-9cda-44c5-af3a-26e23f765d5a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:37.202173 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-31fafe30-9cda-44c5-af3a-26e23f765d5a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:37.209278 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-31fafe30-9cda-44c5-af3a-26e23f765d5a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:37.209752 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-31fafe30-9cda-44c5-af3a-26e23f765d5a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:37.210517 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-31fafe30-9cda-44c5-af3a-26e23f765d5a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:37.210950 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-31fafe30-9cda-44c5-af3a-26e23f765d5a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:37.341782 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-31fafe30-9cda-44c5-af3a-26e23f765d5a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:37.350339 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-31fafe30-9cda-44c5-af3a-26e23f765d5a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:37.351858 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-31fafe30-9cda-44c5-af3a-26e23f765d5a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:37.353020 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-31fafe30-9cda-44c5-af3a-26e23f765d5a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.155601 Jul 20 19:34:37.353581 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 554/1105] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:34:37 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:34:37.644583 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e5f64a36-b668-4c44-b118-16356f6a3b4d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:37.645117 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e5f64a36-b668-4c44-b118-16356f6a3b4d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:37.651597 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e5f64a36-b668-4c44-b118-16356f6a3b4d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:37.652042 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e5f64a36-b668-4c44-b118-16356f6a3b4d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:37.652802 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e5f64a36-b668-4c44-b118-16356f6a3b4d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:37.653238 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e5f64a36-b668-4c44-b118-16356f6a3b4d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:37.718801 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e5f64a36-b668-4c44-b118-16356f6a3b4d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:37.726633 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e5f64a36-b668-4c44-b118-16356f6a3b4d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.086236 Jul 20 19:34:37.727198 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 552/1106] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:37 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:37.768045 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-9447f459-c811-4052-898a-650ba377edcf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:37.768642 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-9447f459-c811-4052-898a-650ba377edcf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:37.775034 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9447f459-c811-4052-898a-650ba377edcf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:37.775470 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9447f459-c811-4052-898a-650ba377edcf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:37.776215 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9447f459-c811-4052-898a-650ba377edcf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:37.776640 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9447f459-c811-4052-898a-650ba377edcf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:37.904761 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-9447f459-c811-4052-898a-650ba377edcf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:37.912767 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-9447f459-c811-4052-898a-650ba377edcf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.148621 Jul 20 19:34:37.913327 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 555/1107] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:37 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:38.371364 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-91f09859-55dc-4ce9-bf89-e3d020101dcf tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:38.371967 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-91f09859-55dc-4ce9-bf89-e3d020101dcf tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:38.378143 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-91f09859-55dc-4ce9-bf89-e3d020101dcf tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:38.378594 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-91f09859-55dc-4ce9-bf89-e3d020101dcf tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:38.379358 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-91f09859-55dc-4ce9-bf89-e3d020101dcf tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:38.379794 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-91f09859-55dc-4ce9-bf89-e3d020101dcf tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:38.509067 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-91f09859-55dc-4ce9-bf89-e3d020101dcf tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:38.517303 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-91f09859-55dc-4ce9-bf89-e3d020101dcf tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:38.519489 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-91f09859-55dc-4ce9-bf89-e3d020101dcf tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:38.520633 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-91f09859-55dc-4ce9-bf89-e3d020101dcf tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.153199 Jul 20 19:34:38.521190 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 553/1108] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:34:38 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:34:38.743687 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-55ebf217-3334-4491-a609-1a64c0c0e143 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:38.744218 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-55ebf217-3334-4491-a609-1a64c0c0e143 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:38.750301 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-55ebf217-3334-4491-a609-1a64c0c0e143 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:38.750750 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-55ebf217-3334-4491-a609-1a64c0c0e143 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:38.751515 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-55ebf217-3334-4491-a609-1a64c0c0e143 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:38.751953 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-55ebf217-3334-4491-a609-1a64c0c0e143 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:38.815707 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-55ebf217-3334-4491-a609-1a64c0c0e143 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:38.823298 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-55ebf217-3334-4491-a609-1a64c0c0e143 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.083608 Jul 20 19:34:38.823864 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 556/1109] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:38 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:38.929742 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-72932cb0-f40e-486d-a543-373f719ee5e9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:38.930383 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-72932cb0-f40e-486d-a543-373f719ee5e9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:38.936788 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-72932cb0-f40e-486d-a543-373f719ee5e9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:38.937236 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-72932cb0-f40e-486d-a543-373f719ee5e9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:38.938034 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-72932cb0-f40e-486d-a543-373f719ee5e9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:38.938470 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-72932cb0-f40e-486d-a543-373f719ee5e9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:39.070089 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-72932cb0-f40e-486d-a543-373f719ee5e9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:39.077601 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-72932cb0-f40e-486d-a543-373f719ee5e9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.151687 Jul 20 19:34:39.078166 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 554/1110] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:38 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:39.537659 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-03d8289d-a87a-4e89-a418-e0b822621fa7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:39.538255 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-03d8289d-a87a-4e89-a418-e0b822621fa7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:39.544361 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-03d8289d-a87a-4e89-a418-e0b822621fa7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:39.544802 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-03d8289d-a87a-4e89-a418-e0b822621fa7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:39.545647 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-03d8289d-a87a-4e89-a418-e0b822621fa7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:39.546083 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-03d8289d-a87a-4e89-a418-e0b822621fa7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:39.675373 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-03d8289d-a87a-4e89-a418-e0b822621fa7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:39.683660 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-03d8289d-a87a-4e89-a418-e0b822621fa7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:39.685157 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-03d8289d-a87a-4e89-a418-e0b822621fa7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:39.686315 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-03d8289d-a87a-4e89-a418-e0b822621fa7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.152608 Jul 20 19:34:39.686861 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 557/1111] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:34:39 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:34:39.840620 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c6e86f2d-0365-4183-b4ff-c2c283f1893c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:39.841227 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c6e86f2d-0365-4183-b4ff-c2c283f1893c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:39.847498 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c6e86f2d-0365-4183-b4ff-c2c283f1893c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:39.847946 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c6e86f2d-0365-4183-b4ff-c2c283f1893c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:39.848716 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c6e86f2d-0365-4183-b4ff-c2c283f1893c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:39.849148 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c6e86f2d-0365-4183-b4ff-c2c283f1893c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:39.922728 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c6e86f2d-0365-4183-b4ff-c2c283f1893c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:39.931484 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c6e86f2d-0365-4183-b4ff-c2c283f1893c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.094949 Jul 20 19:34:39.932074 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 555/1112] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:39 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:40.094953 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-3e164d49-b8fe-4211-a82d-817b454366ad tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:40.095554 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-3e164d49-b8fe-4211-a82d-817b454366ad tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:40.102409 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3e164d49-b8fe-4211-a82d-817b454366ad tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:40.102853 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3e164d49-b8fe-4211-a82d-817b454366ad tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:40.103607 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3e164d49-b8fe-4211-a82d-817b454366ad tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:40.104038 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3e164d49-b8fe-4211-a82d-817b454366ad tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:40.237772 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-3e164d49-b8fe-4211-a82d-817b454366ad tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:40.245277 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-3e164d49-b8fe-4211-a82d-817b454366ad tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.154146 Jul 20 19:34:40.245862 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 558/1113] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:40 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:34:40.704926 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-da53c05c-7635-4900-8aa0-20a09707e2f6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:40.705663 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-da53c05c-7635-4900-8aa0-20a09707e2f6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:40.712194 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-da53c05c-7635-4900-8aa0-20a09707e2f6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:40.712631 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-da53c05c-7635-4900-8aa0-20a09707e2f6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:40.713680 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-da53c05c-7635-4900-8aa0-20a09707e2f6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:40.714108 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-da53c05c-7635-4900-8aa0-20a09707e2f6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:40.844460 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-da53c05c-7635-4900-8aa0-20a09707e2f6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:40.853011 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-da53c05c-7635-4900-8aa0-20a09707e2f6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:40.854546 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-da53c05c-7635-4900-8aa0-20a09707e2f6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:40.855738 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-da53c05c-7635-4900-8aa0-20a09707e2f6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.154852 Jul 20 19:34:40.856288 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 556/1114] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:34:40 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:34:40.948058 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-8e608e40-daa4-4005-b27c-c04f7a1649dd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:40.948663 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-8e608e40-daa4-4005-b27c-c04f7a1649dd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:40.954772 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8e608e40-daa4-4005-b27c-c04f7a1649dd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:40.955367 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8e608e40-daa4-4005-b27c-c04f7a1649dd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:40.956255 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8e608e40-daa4-4005-b27c-c04f7a1649dd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:40.956687 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8e608e40-daa4-4005-b27c-c04f7a1649dd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:41.016721 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-8e608e40-daa4-4005-b27c-c04f7a1649dd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:41.024205 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-8e608e40-daa4-4005-b27c-c04f7a1649dd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.079990 Jul 20 19:34:41.024752 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 559/1115] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:40 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:41.262544 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-8de8ec10-0f86-453b-bd82-72676c12bf0f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:41.263064 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-8de8ec10-0f86-453b-bd82-72676c12bf0f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:41.269898 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8de8ec10-0f86-453b-bd82-72676c12bf0f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:41.270351 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8de8ec10-0f86-453b-bd82-72676c12bf0f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:41.271115 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8de8ec10-0f86-453b-bd82-72676c12bf0f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:41.271555 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8de8ec10-0f86-453b-bd82-72676c12bf0f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:41.403531 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8de8ec10-0f86-453b-bd82-72676c12bf0f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:41.411213 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-8de8ec10-0f86-453b-bd82-72676c12bf0f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.152649 Jul 20 19:34:41.411776 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 557/1116] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:41 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:41.874462 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-3f6d2ec1-96e1-4649-aa7d-05cbaaeb994c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:41.875047 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-3f6d2ec1-96e1-4649-aa7d-05cbaaeb994c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:41.881697 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3f6d2ec1-96e1-4649-aa7d-05cbaaeb994c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:41.882142 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3f6d2ec1-96e1-4649-aa7d-05cbaaeb994c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:41.882890 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3f6d2ec1-96e1-4649-aa7d-05cbaaeb994c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:41.883318 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3f6d2ec1-96e1-4649-aa7d-05cbaaeb994c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:42.014706 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-3f6d2ec1-96e1-4649-aa7d-05cbaaeb994c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:42.023226 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-3f6d2ec1-96e1-4649-aa7d-05cbaaeb994c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:42.024831 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-3f6d2ec1-96e1-4649-aa7d-05cbaaeb994c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:42.026058 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-3f6d2ec1-96e1-4649-aa7d-05cbaaeb994c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.155555 Jul 20 19:34:42.026617 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 560/1117] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:34:41 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:34:42.040430 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-cd2e08a2-0164-41a1-b199-e542f423394d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:42.041035 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-cd2e08a2-0164-41a1-b199-e542f423394d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:42.047609 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cd2e08a2-0164-41a1-b199-e542f423394d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:42.048053 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cd2e08a2-0164-41a1-b199-e542f423394d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:42.048805 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cd2e08a2-0164-41a1-b199-e542f423394d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:42.049873 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cd2e08a2-0164-41a1-b199-e542f423394d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:42.115421 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-cd2e08a2-0164-41a1-b199-e542f423394d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:42.122937 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-cd2e08a2-0164-41a1-b199-e542f423394d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.086357 Jul 20 19:34:42.123499 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 558/1118] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:42 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:42.428252 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-d84c9d6b-f3d0-4b20-b568-2759a847a628 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:42.428798 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-d84c9d6b-f3d0-4b20-b568-2759a847a628 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:42.435356 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d84c9d6b-f3d0-4b20-b568-2759a847a628 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:42.435803 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d84c9d6b-f3d0-4b20-b568-2759a847a628 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:42.436558 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d84c9d6b-f3d0-4b20-b568-2759a847a628 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:42.436991 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d84c9d6b-f3d0-4b20-b568-2759a847a628 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:42.571359 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-d84c9d6b-f3d0-4b20-b568-2759a847a628 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:42.578943 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-d84c9d6b-f3d0-4b20-b568-2759a847a628 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.154673 Jul 20 19:34:42.579509 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 561/1119] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:42 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:43.044907 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e8630e6d-ff58-4c3d-a14b-d53b57211ad9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:43.045532 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e8630e6d-ff58-4c3d-a14b-d53b57211ad9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:43.052577 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e8630e6d-ff58-4c3d-a14b-d53b57211ad9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:43.053019 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e8630e6d-ff58-4c3d-a14b-d53b57211ad9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:43.053836 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e8630e6d-ff58-4c3d-a14b-d53b57211ad9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:43.054266 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e8630e6d-ff58-4c3d-a14b-d53b57211ad9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:43.139663 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-0868ae93-81fb-4414-ba95-2b5b5144b852 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:43.140270 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-0868ae93-81fb-4414-ba95-2b5b5144b852 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:43.147957 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-0868ae93-81fb-4414-ba95-2b5b5144b852 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:43.148414 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-0868ae93-81fb-4414-ba95-2b5b5144b852 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:43.149198 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-0868ae93-81fb-4414-ba95-2b5b5144b852 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:43.149837 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-0868ae93-81fb-4414-ba95-2b5b5144b852 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:43.218244 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e8630e6d-ff58-4c3d-a14b-d53b57211ad9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:43.220240 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-0868ae93-81fb-4414-ba95-2b5b5144b852 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:43.228521 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e8630e6d-ff58-4c3d-a14b-d53b57211ad9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:43.230195 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e8630e6d-ff58-4c3d-a14b-d53b57211ad9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:43.231486 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e8630e6d-ff58-4c3d-a14b-d53b57211ad9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.190634 Jul 20 19:34:43.232255 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 559/1120] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:34:43 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:34:43.234898 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-0868ae93-81fb-4414-ba95-2b5b5144b852 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.099094 Jul 20 19:34:43.244464 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 562/1121] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:43 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:34:43.597430 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-181567b9-67f9-4644-97d2-68a72a94086d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:43.598065 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-181567b9-67f9-4644-97d2-68a72a94086d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:43.604286 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-181567b9-67f9-4644-97d2-68a72a94086d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:43.604738 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-181567b9-67f9-4644-97d2-68a72a94086d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:43.605543 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-181567b9-67f9-4644-97d2-68a72a94086d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:43.605980 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-181567b9-67f9-4644-97d2-68a72a94086d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:43.787925 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-181567b9-67f9-4644-97d2-68a72a94086d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:43.796387 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-181567b9-67f9-4644-97d2-68a72a94086d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.203351 Jul 20 19:34:43.797007 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 560/1122] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:43 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:44.249575 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-725c8fd9-98ae-4d56-b247-e2e82d76ca89 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:44.250163 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-725c8fd9-98ae-4d56-b247-e2e82d76ca89 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:44.251825 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-8d71138a-c04a-4c46-8fd1-d666d1f98ed9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:44.253197 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-8d71138a-c04a-4c46-8fd1-d666d1f98ed9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:44.257364 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-725c8fd9-98ae-4d56-b247-e2e82d76ca89 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:44.257840 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-725c8fd9-98ae-4d56-b247-e2e82d76ca89 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:44.258626 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-725c8fd9-98ae-4d56-b247-e2e82d76ca89 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:44.259049 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-725c8fd9-98ae-4d56-b247-e2e82d76ca89 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:44.259643 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8d71138a-c04a-4c46-8fd1-d666d1f98ed9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:44.260096 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8d71138a-c04a-4c46-8fd1-d666d1f98ed9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:44.260867 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8d71138a-c04a-4c46-8fd1-d666d1f98ed9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:44.261309 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8d71138a-c04a-4c46-8fd1-d666d1f98ed9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:44.324693 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8d71138a-c04a-4c46-8fd1-d666d1f98ed9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:44.332529 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-8d71138a-c04a-4c46-8fd1-d666d1f98ed9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.084475 Jul 20 19:34:44.333110 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 561/1123] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:44 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:34:44.415972 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-725c8fd9-98ae-4d56-b247-e2e82d76ca89 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:44.424939 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-725c8fd9-98ae-4d56-b247-e2e82d76ca89 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:44.426697 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-725c8fd9-98ae-4d56-b247-e2e82d76ca89 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:44.427854 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-725c8fd9-98ae-4d56-b247-e2e82d76ca89 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.182295 Jul 20 19:34:44.428408 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 563/1124] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:34:44 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:34:44.816986 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-896ef5ea-e9ab-44ca-8189-42133d37f7a9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:44.817874 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-896ef5ea-e9ab-44ca-8189-42133d37f7a9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:44.820504 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_api:SELECT=84 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:34:44.828089 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-896ef5ea-e9ab-44ca-8189-42133d37f7a9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:44.828851 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-896ef5ea-e9ab-44ca-8189-42133d37f7a9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:44.829970 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-896ef5ea-e9ab-44ca-8189-42133d37f7a9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:44.830620 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-896ef5ea-e9ab-44ca-8189-42133d37f7a9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:44.970651 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-896ef5ea-e9ab-44ca-8189-42133d37f7a9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:44.973388 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:34:44.979940 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-896ef5ea-e9ab-44ca-8189-42133d37f7a9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.169394 Jul 20 19:34:44.980508 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 562/1125] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:44 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:34:45.349898 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-86417165-f33e-47d3-af0d-40420daf2d14 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:45.350433 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-86417165-f33e-47d3-af0d-40420daf2d14 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:45.357420 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-86417165-f33e-47d3-af0d-40420daf2d14 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:45.357898 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-86417165-f33e-47d3-af0d-40420daf2d14 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:45.358679 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-86417165-f33e-47d3-af0d-40420daf2d14 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:45.359113 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-86417165-f33e-47d3-af0d-40420daf2d14 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:45.424360 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-86417165-f33e-47d3-af0d-40420daf2d14 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:45.432500 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-86417165-f33e-47d3-af0d-40420daf2d14 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.086691 Jul 20 19:34:45.433063 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 564/1126] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:45 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:45.446601 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-5a0345de-a9b9-4e90-a2f8-fe7d8f04db10 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:45.447212 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-5a0345de-a9b9-4e90-a2f8-fe7d8f04db10 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:45.453740 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5a0345de-a9b9-4e90-a2f8-fe7d8f04db10 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:45.454188 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5a0345de-a9b9-4e90-a2f8-fe7d8f04db10 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:45.454951 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5a0345de-a9b9-4e90-a2f8-fe7d8f04db10 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:45.456212 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5a0345de-a9b9-4e90-a2f8-fe7d8f04db10 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:45.595637 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-5a0345de-a9b9-4e90-a2f8-fe7d8f04db10 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:45.604535 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-5a0345de-a9b9-4e90-a2f8-fe7d8f04db10 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:45.606023 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-5a0345de-a9b9-4e90-a2f8-fe7d8f04db10 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:45.607190 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-5a0345de-a9b9-4e90-a2f8-fe7d8f04db10 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.164535 Jul 20 19:34:45.607743 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 563/1127] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:34:45 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:34:45.997689 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-d9401c67-5178-426c-92fb-6b22f91144e0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:45.998274 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-d9401c67-5178-426c-92fb-6b22f91144e0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:46.005127 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d9401c67-5178-426c-92fb-6b22f91144e0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:46.005599 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d9401c67-5178-426c-92fb-6b22f91144e0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:46.006358 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d9401c67-5178-426c-92fb-6b22f91144e0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:46.006797 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d9401c67-5178-426c-92fb-6b22f91144e0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:46.145953 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-d9401c67-5178-426c-92fb-6b22f91144e0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:46.153724 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-d9401c67-5178-426c-92fb-6b22f91144e0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.160005 Jul 20 19:34:46.154295 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 565/1128] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:45 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:46.449766 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-03e3622b-cca2-4bc2-a171-40543360a387 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:46.450664 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-03e3622b-cca2-4bc2-a171-40543360a387 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:46.457118 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-03e3622b-cca2-4bc2-a171-40543360a387 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:46.457585 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-03e3622b-cca2-4bc2-a171-40543360a387 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:46.458342 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-03e3622b-cca2-4bc2-a171-40543360a387 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:46.458767 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-03e3622b-cca2-4bc2-a171-40543360a387 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:46.524933 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-03e3622b-cca2-4bc2-a171-40543360a387 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:46.532532 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-03e3622b-cca2-4bc2-a171-40543360a387 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.086623 Jul 20 19:34:46.533089 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 564/1129] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:46 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:46.626374 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-79b42d76-51c8-435f-9666-72203aae6ce3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:46.626908 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-79b42d76-51c8-435f-9666-72203aae6ce3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:46.633583 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-79b42d76-51c8-435f-9666-72203aae6ce3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:46.634031 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-79b42d76-51c8-435f-9666-72203aae6ce3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:46.634788 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-79b42d76-51c8-435f-9666-72203aae6ce3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:46.635225 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-79b42d76-51c8-435f-9666-72203aae6ce3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:46.766858 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-79b42d76-51c8-435f-9666-72203aae6ce3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:46.776153 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-79b42d76-51c8-435f-9666-72203aae6ce3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:46.777782 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-79b42d76-51c8-435f-9666-72203aae6ce3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:46.778970 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-79b42d76-51c8-435f-9666-72203aae6ce3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.156694 Jul 20 19:34:46.779533 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 566/1130] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:34:46 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:34:47.171507 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-9501001e-7364-42e5-9188-3fe867762d54 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:47.172115 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-9501001e-7364-42e5-9188-3fe867762d54 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:47.178160 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9501001e-7364-42e5-9188-3fe867762d54 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:47.178607 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9501001e-7364-42e5-9188-3fe867762d54 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:47.179373 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9501001e-7364-42e5-9188-3fe867762d54 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:47.179805 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9501001e-7364-42e5-9188-3fe867762d54 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:47.313333 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-9501001e-7364-42e5-9188-3fe867762d54 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:47.321676 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-9501001e-7364-42e5-9188-3fe867762d54 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.153995 Jul 20 19:34:47.322252 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 565/1131] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:47 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:47.550090 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-01283dff-474c-4c2e-8477-664d93a7bd67 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:47.550779 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-01283dff-474c-4c2e-8477-664d93a7bd67 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:47.556892 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-01283dff-474c-4c2e-8477-664d93a7bd67 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:47.557339 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-01283dff-474c-4c2e-8477-664d93a7bd67 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:47.558148 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-01283dff-474c-4c2e-8477-664d93a7bd67 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:47.558583 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-01283dff-474c-4c2e-8477-664d93a7bd67 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:47.620076 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-01283dff-474c-4c2e-8477-664d93a7bd67 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:47.628780 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-01283dff-474c-4c2e-8477-664d93a7bd67 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.083154 Jul 20 19:34:47.629414 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 567/1132] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:47 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:47.797708 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-1d10d731-fd64-4324-b164-245926af0f20 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:47.798260 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-1d10d731-fd64-4324-b164-245926af0f20 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:47.805094 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1d10d731-fd64-4324-b164-245926af0f20 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:47.805570 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1d10d731-fd64-4324-b164-245926af0f20 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:47.806330 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1d10d731-fd64-4324-b164-245926af0f20 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:47.806760 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1d10d731-fd64-4324-b164-245926af0f20 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:47.937934 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1d10d731-fd64-4324-b164-245926af0f20 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:47.946827 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1d10d731-fd64-4324-b164-245926af0f20 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:47.948325 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1d10d731-fd64-4324-b164-245926af0f20 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:47.949487 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-1d10d731-fd64-4324-b164-245926af0f20 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.155850 Jul 20 19:34:47.950063 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 566/1133] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:34:47 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:34:48.338705 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-d911f7af-79b3-44be-bde7-4f52881f3d5e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:48.339305 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-d911f7af-79b3-44be-bde7-4f52881f3d5e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:48.346082 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d911f7af-79b3-44be-bde7-4f52881f3d5e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:48.346522 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d911f7af-79b3-44be-bde7-4f52881f3d5e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:48.347285 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d911f7af-79b3-44be-bde7-4f52881f3d5e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:48.347720 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d911f7af-79b3-44be-bde7-4f52881f3d5e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:48.495350 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-d911f7af-79b3-44be-bde7-4f52881f3d5e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:48.503126 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-d911f7af-79b3-44be-bde7-4f52881f3d5e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.168566 Jul 20 19:34:48.503733 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 568/1134] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:48 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:48.645497 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-41f50815-ede4-4f02-9161-e9f6e385d40b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:48.646147 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-41f50815-ede4-4f02-9161-e9f6e385d40b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:48.652212 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-41f50815-ede4-4f02-9161-e9f6e385d40b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:48.652663 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-41f50815-ede4-4f02-9161-e9f6e385d40b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:48.653429 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-41f50815-ede4-4f02-9161-e9f6e385d40b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:48.653898 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-41f50815-ede4-4f02-9161-e9f6e385d40b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:48.718361 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-41f50815-ede4-4f02-9161-e9f6e385d40b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:48.726831 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-41f50815-ede4-4f02-9161-e9f6e385d40b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.085127 Jul 20 19:34:48.727413 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 567/1135] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:48 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:48.968877 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-1b7557b8-869d-4126-b838-8e420c35a48a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:48.969422 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-1b7557b8-869d-4126-b838-8e420c35a48a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:48.976255 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1b7557b8-869d-4126-b838-8e420c35a48a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:48.976702 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1b7557b8-869d-4126-b838-8e420c35a48a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:48.977454 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1b7557b8-869d-4126-b838-8e420c35a48a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:48.977917 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1b7557b8-869d-4126-b838-8e420c35a48a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:49.106357 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-1b7557b8-869d-4126-b838-8e420c35a48a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:49.115298 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-1b7557b8-869d-4126-b838-8e420c35a48a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:49.116872 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-1b7557b8-869d-4126-b838-8e420c35a48a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:49.118045 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-1b7557b8-869d-4126-b838-8e420c35a48a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.153167 Jul 20 19:34:49.118598 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 569/1136] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:34:48 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:34:49.520935 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-8df9e39e-0d7e-4b84-8f1e-016993f6b32a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:49.521608 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-8df9e39e-0d7e-4b84-8f1e-016993f6b32a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:49.528069 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8df9e39e-0d7e-4b84-8f1e-016993f6b32a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:49.528571 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8df9e39e-0d7e-4b84-8f1e-016993f6b32a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:49.529279 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8df9e39e-0d7e-4b84-8f1e-016993f6b32a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:49.529738 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8df9e39e-0d7e-4b84-8f1e-016993f6b32a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:49.664674 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8df9e39e-0d7e-4b84-8f1e-016993f6b32a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:49.672196 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-8df9e39e-0d7e-4b84-8f1e-016993f6b32a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.155868 Jul 20 19:34:49.672788 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 568/1137] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:49 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:49.743618 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-13dc0d28-1baa-4556-874a-8e5533a91cf1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:49.744245 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-13dc0d28-1baa-4556-874a-8e5533a91cf1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:49.751000 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-13dc0d28-1baa-4556-874a-8e5533a91cf1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:49.751449 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-13dc0d28-1baa-4556-874a-8e5533a91cf1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:49.752853 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-13dc0d28-1baa-4556-874a-8e5533a91cf1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:49.753297 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-13dc0d28-1baa-4556-874a-8e5533a91cf1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:49.768338 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_cell1:SELECT=100 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:34:49.817927 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-13dc0d28-1baa-4556-874a-8e5533a91cf1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:49.825489 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-13dc0d28-1baa-4556-874a-8e5533a91cf1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.085753 Jul 20 19:34:49.826087 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 570/1138] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:49 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:50.135905 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-40dffc87-3520-4db9-875b-4dc2d849b5b8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:50.136442 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-40dffc87-3520-4db9-875b-4dc2d849b5b8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:50.142996 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-40dffc87-3520-4db9-875b-4dc2d849b5b8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:50.143701 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-40dffc87-3520-4db9-875b-4dc2d849b5b8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:50.144459 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-40dffc87-3520-4db9-875b-4dc2d849b5b8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:50.144888 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-40dffc87-3520-4db9-875b-4dc2d849b5b8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:50.277823 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-40dffc87-3520-4db9-875b-4dc2d849b5b8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:50.286638 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-40dffc87-3520-4db9-875b-4dc2d849b5b8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:50.288137 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-40dffc87-3520-4db9-875b-4dc2d849b5b8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:50.289295 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-40dffc87-3520-4db9-875b-4dc2d849b5b8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.157408 Jul 20 19:34:50.289881 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 569/1139] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:34:50 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:34:50.690927 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-c8e9d208-d1f4-4051-971c-11a2f00c0e1b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:50.691520 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-c8e9d208-d1f4-4051-971c-11a2f00c0e1b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:50.697576 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c8e9d208-d1f4-4051-971c-11a2f00c0e1b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:50.698027 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c8e9d208-d1f4-4051-971c-11a2f00c0e1b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:50.698784 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c8e9d208-d1f4-4051-971c-11a2f00c0e1b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:50.699216 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c8e9d208-d1f4-4051-971c-11a2f00c0e1b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:50.836237 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-c8e9d208-d1f4-4051-971c-11a2f00c0e1b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:50.842215 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-fd4c2c39-7d01-40b4-94e8-ee111eeda1ca tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:50.842826 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-fd4c2c39-7d01-40b4-94e8-ee111eeda1ca tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:50.844301 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-c8e9d208-d1f4-4051-971c-11a2f00c0e1b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.157994 Jul 20 19:34:50.844872 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 571/1140] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:50 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:50.849689 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fd4c2c39-7d01-40b4-94e8-ee111eeda1ca tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:50.850136 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fd4c2c39-7d01-40b4-94e8-ee111eeda1ca tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:50.850948 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fd4c2c39-7d01-40b4-94e8-ee111eeda1ca tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:50.851369 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fd4c2c39-7d01-40b4-94e8-ee111eeda1ca tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:50.916534 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-fd4c2c39-7d01-40b4-94e8-ee111eeda1ca tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:50.924250 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-fd4c2c39-7d01-40b4-94e8-ee111eeda1ca tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.085841 Jul 20 19:34:50.925027 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 570/1141] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:50 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:34:51.307839 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-a3af2ab2-a3bd-461c-bfb6-2497f16379a6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:51.308474 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-a3af2ab2-a3bd-461c-bfb6-2497f16379a6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:51.314588 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a3af2ab2-a3bd-461c-bfb6-2497f16379a6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:51.315029 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a3af2ab2-a3bd-461c-bfb6-2497f16379a6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:51.315784 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a3af2ab2-a3bd-461c-bfb6-2497f16379a6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:51.316206 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a3af2ab2-a3bd-461c-bfb6-2497f16379a6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:51.447653 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-a3af2ab2-a3bd-461c-bfb6-2497f16379a6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:51.456402 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-a3af2ab2-a3bd-461c-bfb6-2497f16379a6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:51.457952 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-a3af2ab2-a3bd-461c-bfb6-2497f16379a6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:51.459132 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-a3af2ab2-a3bd-461c-bfb6-2497f16379a6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.155225 Jul 20 19:34:51.459691 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 572/1142] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:34:51 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:34:51.861459 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d3b29217-c986-4e66-8858-f074dcf4d4ac tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:51.862079 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d3b29217-c986-4e66-8858-f074dcf4d4ac tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:51.868616 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d3b29217-c986-4e66-8858-f074dcf4d4ac tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:51.869060 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d3b29217-c986-4e66-8858-f074dcf4d4ac tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:51.869847 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d3b29217-c986-4e66-8858-f074dcf4d4ac tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:51.870273 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d3b29217-c986-4e66-8858-f074dcf4d4ac tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:51.940251 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-75559e3f-bad6-4f7e-a614-137aa049a4d3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:51.941036 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-75559e3f-bad6-4f7e-a614-137aa049a4d3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:51.947619 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-75559e3f-bad6-4f7e-a614-137aa049a4d3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:51.948073 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-75559e3f-bad6-4f7e-a614-137aa049a4d3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:51.948846 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-75559e3f-bad6-4f7e-a614-137aa049a4d3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:51.949278 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-75559e3f-bad6-4f7e-a614-137aa049a4d3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:52.007734 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d3b29217-c986-4e66-8858-f074dcf4d4ac tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:52.012514 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-75559e3f-bad6-4f7e-a614-137aa049a4d3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:52.015556 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d3b29217-c986-4e66-8858-f074dcf4d4ac tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.157956 Jul 20 19:34:52.016296 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 571/1143] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:51 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:52.020897 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-75559e3f-bad6-4f7e-a614-137aa049a4d3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.084502 Jul 20 19:34:52.021453 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 573/1144] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:51 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:34:52.477651 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-565fa0ac-8128-4bd6-aa1f-f039b306c4e5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:52.478172 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-565fa0ac-8128-4bd6-aa1f-f039b306c4e5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:52.484648 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-565fa0ac-8128-4bd6-aa1f-f039b306c4e5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:52.485097 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-565fa0ac-8128-4bd6-aa1f-f039b306c4e5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:52.485890 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-565fa0ac-8128-4bd6-aa1f-f039b306c4e5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:52.486323 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-565fa0ac-8128-4bd6-aa1f-f039b306c4e5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:52.629640 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-565fa0ac-8128-4bd6-aa1f-f039b306c4e5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:52.638092 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-565fa0ac-8128-4bd6-aa1f-f039b306c4e5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:52.639583 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-565fa0ac-8128-4bd6-aa1f-f039b306c4e5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:52.640741 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-565fa0ac-8128-4bd6-aa1f-f039b306c4e5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.167126 Jul 20 19:34:52.641339 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 572/1145] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:34:52 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:34:53.034454 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-bb9cf5d4-2929-4f02-845a-f7665be7d1b6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:53.035102 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-bb9cf5d4-2929-4f02-845a-f7665be7d1b6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:53.037769 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-3a759464-ec3b-467e-be10-c4f585345a75 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:53.038390 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-3a759464-ec3b-467e-be10-c4f585345a75 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:53.041815 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-bb9cf5d4-2929-4f02-845a-f7665be7d1b6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:53.042255 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-bb9cf5d4-2929-4f02-845a-f7665be7d1b6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:53.043015 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-bb9cf5d4-2929-4f02-845a-f7665be7d1b6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:53.043444 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-bb9cf5d4-2929-4f02-845a-f7665be7d1b6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:53.044834 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3a759464-ec3b-467e-be10-c4f585345a75 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:53.045301 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3a759464-ec3b-467e-be10-c4f585345a75 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:53.046183 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3a759464-ec3b-467e-be10-c4f585345a75 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:53.046653 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3a759464-ec3b-467e-be10-c4f585345a75 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:53.109484 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3a759464-ec3b-467e-be10-c4f585345a75 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:53.117951 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-3a759464-ec3b-467e-be10-c4f585345a75 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.084610 Jul 20 19:34:53.118559 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 573/1146] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:53 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:34:53.180394 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-bb9cf5d4-2929-4f02-845a-f7665be7d1b6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:53.187885 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-bb9cf5d4-2929-4f02-845a-f7665be7d1b6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.157948 Jul 20 19:34:53.188435 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 574/1147] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:53 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:53.659371 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-bcd614e5-959d-49da-909e-f2dc0da66433 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:53.659987 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-bcd614e5-959d-49da-909e-f2dc0da66433 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:53.666212 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bcd614e5-959d-49da-909e-f2dc0da66433 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:53.666665 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bcd614e5-959d-49da-909e-f2dc0da66433 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:53.667428 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bcd614e5-959d-49da-909e-f2dc0da66433 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:53.667867 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bcd614e5-959d-49da-909e-f2dc0da66433 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:53.804683 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-bcd614e5-959d-49da-909e-f2dc0da66433 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:53.813320 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-bcd614e5-959d-49da-909e-f2dc0da66433 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:53.815417 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-bcd614e5-959d-49da-909e-f2dc0da66433 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:53.816585 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-bcd614e5-959d-49da-909e-f2dc0da66433 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.161897 Jul 20 19:34:53.817149 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 574/1148] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:34:53 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:34:54.134910 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-a5065677-f4ca-426f-a9aa-a18ca3130403 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:54.135440 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-a5065677-f4ca-426f-a9aa-a18ca3130403 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:54.143152 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a5065677-f4ca-426f-a9aa-a18ca3130403 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:54.143800 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a5065677-f4ca-426f-a9aa-a18ca3130403 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:54.144566 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a5065677-f4ca-426f-a9aa-a18ca3130403 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:54.144999 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a5065677-f4ca-426f-a9aa-a18ca3130403 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:54.204858 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-8de8d8a5-aa7f-4ba6-b134-8298913b27ea tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:54.206140 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-8de8d8a5-aa7f-4ba6-b134-8298913b27ea tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:54.210223 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-a5065677-f4ca-426f-a9aa-a18ca3130403 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:54.212874 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8de8d8a5-aa7f-4ba6-b134-8298913b27ea tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:54.213321 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8de8d8a5-aa7f-4ba6-b134-8298913b27ea tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:54.214382 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8de8d8a5-aa7f-4ba6-b134-8298913b27ea tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:54.214814 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8de8d8a5-aa7f-4ba6-b134-8298913b27ea tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:54.217996 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-a5065677-f4ca-426f-a9aa-a18ca3130403 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.087074 Jul 20 19:34:54.218575 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 575/1149] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:54 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:54.352290 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8de8d8a5-aa7f-4ba6-b134-8298913b27ea tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:54.359894 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-8de8d8a5-aa7f-4ba6-b134-8298913b27ea tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.158979 Jul 20 19:34:54.360460 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 575/1150] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:54 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:54.834995 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-341157ee-6d48-4b67-a840-45be8e769e8a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:54.835594 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-341157ee-6d48-4b67-a840-45be8e769e8a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:54.842295 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-341157ee-6d48-4b67-a840-45be8e769e8a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:54.842750 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-341157ee-6d48-4b67-a840-45be8e769e8a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:54.843556 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-341157ee-6d48-4b67-a840-45be8e769e8a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:54.843989 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-341157ee-6d48-4b67-a840-45be8e769e8a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:54.976551 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-341157ee-6d48-4b67-a840-45be8e769e8a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:54.985077 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-341157ee-6d48-4b67-a840-45be8e769e8a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:54.987291 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-341157ee-6d48-4b67-a840-45be8e769e8a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:54.988543 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-341157ee-6d48-4b67-a840-45be8e769e8a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.157586 Jul 20 19:34:54.989109 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 576/1151] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:34:54 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:34:55.235651 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-b86f521c-2e9d-49db-b8c5-1f5bca8b2914 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:55.236261 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-b86f521c-2e9d-49db-b8c5-1f5bca8b2914 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:55.243460 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b86f521c-2e9d-49db-b8c5-1f5bca8b2914 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:55.243913 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b86f521c-2e9d-49db-b8c5-1f5bca8b2914 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:55.244677 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b86f521c-2e9d-49db-b8c5-1f5bca8b2914 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:55.245110 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b86f521c-2e9d-49db-b8c5-1f5bca8b2914 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:55.310464 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-b86f521c-2e9d-49db-b8c5-1f5bca8b2914 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:55.321110 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-b86f521c-2e9d-49db-b8c5-1f5bca8b2914 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.089278 Jul 20 19:34:55.321731 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 576/1152] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:55 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:55.377754 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-a8bc6111-614e-4bad-8689-2b9ff99c4b34 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:55.378367 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-a8bc6111-614e-4bad-8689-2b9ff99c4b34 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:55.385110 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a8bc6111-614e-4bad-8689-2b9ff99c4b34 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:55.385588 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a8bc6111-614e-4bad-8689-2b9ff99c4b34 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:55.386366 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a8bc6111-614e-4bad-8689-2b9ff99c4b34 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:55.386798 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a8bc6111-614e-4bad-8689-2b9ff99c4b34 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:55.762393 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-a8bc6111-614e-4bad-8689-2b9ff99c4b34 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:55.771040 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-a8bc6111-614e-4bad-8689-2b9ff99c4b34 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.397633 Jul 20 19:34:55.771629 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 577/1153] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:55 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:56.007590 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-75bab37a-c720-49f2-9430-1959cfd32c09 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:56.008190 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-75bab37a-c720-49f2-9430-1959cfd32c09 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:56.014271 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-75bab37a-c720-49f2-9430-1959cfd32c09 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:56.014732 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-75bab37a-c720-49f2-9430-1959cfd32c09 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:56.015486 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-75bab37a-c720-49f2-9430-1959cfd32c09 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:56.016111 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-75bab37a-c720-49f2-9430-1959cfd32c09 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:56.157807 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-75bab37a-c720-49f2-9430-1959cfd32c09 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:56.166675 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-75bab37a-c720-49f2-9430-1959cfd32c09 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:56.168004 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-75bab37a-c720-49f2-9430-1959cfd32c09 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:56.169179 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-75bab37a-c720-49f2-9430-1959cfd32c09 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.165587 Jul 20 19:34:56.169764 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 577/1154] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:34:56 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:34:56.348160 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-0e24f42c-db47-49b3-a2cd-c31fecdb120e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:56.349721 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-0e24f42c-db47-49b3-a2cd-c31fecdb120e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:56.351752 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_api:SELECT=78 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:34:56.357155 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-0e24f42c-db47-49b3-a2cd-c31fecdb120e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:56.357618 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-0e24f42c-db47-49b3-a2cd-c31fecdb120e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:56.358383 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-0e24f42c-db47-49b3-a2cd-c31fecdb120e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:56.358810 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-0e24f42c-db47-49b3-a2cd-c31fecdb120e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:56.428403 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-0e24f42c-db47-49b3-a2cd-c31fecdb120e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:56.436296 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-0e24f42c-db47-49b3-a2cd-c31fecdb120e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.102237 Jul 20 19:34:56.436854 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 578/1155] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:56 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:56.788800 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-96d21a2a-0ef9-4913-b5d2-c74c1c4e471b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:56.789407 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-96d21a2a-0ef9-4913-b5d2-c74c1c4e471b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:56.796141 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-96d21a2a-0ef9-4913-b5d2-c74c1c4e471b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:56.796587 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-96d21a2a-0ef9-4913-b5d2-c74c1c4e471b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:56.797353 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-96d21a2a-0ef9-4913-b5d2-c74c1c4e471b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:56.797819 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-96d21a2a-0ef9-4913-b5d2-c74c1c4e471b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:56.933250 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-96d21a2a-0ef9-4913-b5d2-c74c1c4e471b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:56.940726 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-96d21a2a-0ef9-4913-b5d2-c74c1c4e471b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.155915 Jul 20 19:34:56.941288 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 578/1156] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:56 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:57.187637 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-f2294291-f7a3-4fa2-8d97-dfa119d56267 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:57.188245 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-f2294291-f7a3-4fa2-8d97-dfa119d56267 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:57.195257 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f2294291-f7a3-4fa2-8d97-dfa119d56267 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:57.195717 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f2294291-f7a3-4fa2-8d97-dfa119d56267 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:57.196511 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f2294291-f7a3-4fa2-8d97-dfa119d56267 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:57.196948 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f2294291-f7a3-4fa2-8d97-dfa119d56267 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:57.337298 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-f2294291-f7a3-4fa2-8d97-dfa119d56267 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:57.347204 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-f2294291-f7a3-4fa2-8d97-dfa119d56267 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:57.348727 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-f2294291-f7a3-4fa2-8d97-dfa119d56267 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:57.349921 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-f2294291-f7a3-4fa2-8d97-dfa119d56267 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.166235 Jul 20 19:34:57.350480 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 579/1157] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:34:57 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:34:57.454558 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-83ed61da-a6e8-479c-8024-1e18805d80a3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:57.455133 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-83ed61da-a6e8-479c-8024-1e18805d80a3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:57.461672 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-83ed61da-a6e8-479c-8024-1e18805d80a3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:57.462123 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-83ed61da-a6e8-479c-8024-1e18805d80a3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:57.462891 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-83ed61da-a6e8-479c-8024-1e18805d80a3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:57.463328 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-83ed61da-a6e8-479c-8024-1e18805d80a3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:57.478258 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:34:57.527043 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-83ed61da-a6e8-479c-8024-1e18805d80a3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:57.534844 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-83ed61da-a6e8-479c-8024-1e18805d80a3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.084203 Jul 20 19:34:57.535408 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 579/1158] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:57 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:57.957647 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-fa0d0baf-d1e5-4411-9205-1a157e28323c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:57.958252 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-fa0d0baf-d1e5-4411-9205-1a157e28323c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:57.965295 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-fa0d0baf-d1e5-4411-9205-1a157e28323c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:57.965760 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-fa0d0baf-d1e5-4411-9205-1a157e28323c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:57.966509 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-fa0d0baf-d1e5-4411-9205-1a157e28323c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:57.966935 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-fa0d0baf-d1e5-4411-9205-1a157e28323c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:58.108339 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-fa0d0baf-d1e5-4411-9205-1a157e28323c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:58.116311 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-fa0d0baf-d1e5-4411-9205-1a157e28323c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.162497 Jul 20 19:34:58.116877 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 580/1159] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:57 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:58.368211 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ce14af00-73fc-40a1-9145-837f67614c1a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:58.368842 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ce14af00-73fc-40a1-9145-837f67614c1a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:58.375290 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ce14af00-73fc-40a1-9145-837f67614c1a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:58.375730 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ce14af00-73fc-40a1-9145-837f67614c1a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:58.376481 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ce14af00-73fc-40a1-9145-837f67614c1a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:58.377447 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ce14af00-73fc-40a1-9145-837f67614c1a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:58.511504 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ce14af00-73fc-40a1-9145-837f67614c1a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:58.520932 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ce14af00-73fc-40a1-9145-837f67614c1a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:58.522468 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ce14af00-73fc-40a1-9145-837f67614c1a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:58.523640 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ce14af00-73fc-40a1-9145-837f67614c1a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.159340 Jul 20 19:34:58.524197 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 580/1160] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:34:58 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:34:58.552312 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-464ac8bb-7ad9-45e6-884a-c1d46716564b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:58.552916 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-464ac8bb-7ad9-45e6-884a-c1d46716564b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:58.559077 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-464ac8bb-7ad9-45e6-884a-c1d46716564b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:58.559528 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-464ac8bb-7ad9-45e6-884a-c1d46716564b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:58.560296 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-464ac8bb-7ad9-45e6-884a-c1d46716564b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:58.560735 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-464ac8bb-7ad9-45e6-884a-c1d46716564b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:58.622890 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-464ac8bb-7ad9-45e6-884a-c1d46716564b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:58.632823 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-464ac8bb-7ad9-45e6-884a-c1d46716564b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.085061 Jul 20 19:34:58.633404 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 581/1161] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:58 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:59.134072 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-0c37255b-437d-440a-a1c8-f72e8ac73ec1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:59.134688 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-0c37255b-437d-440a-a1c8-f72e8ac73ec1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:59.140757 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0c37255b-437d-440a-a1c8-f72e8ac73ec1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:59.141204 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0c37255b-437d-440a-a1c8-f72e8ac73ec1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:59.142001 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0c37255b-437d-440a-a1c8-f72e8ac73ec1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:59.142441 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0c37255b-437d-440a-a1c8-f72e8ac73ec1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:59.276410 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0c37255b-437d-440a-a1c8-f72e8ac73ec1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:59.284396 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-0c37255b-437d-440a-a1c8-f72e8ac73ec1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.154124 Jul 20 19:34:59.285060 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 581/1162] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:59 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:59.542475 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-c6bf1706-ee2e-4d75-a62a-3a4b3293ddea tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:59.543069 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-c6bf1706-ee2e-4d75-a62a-3a4b3293ddea tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:59.549947 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c6bf1706-ee2e-4d75-a62a-3a4b3293ddea tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:59.550386 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c6bf1706-ee2e-4d75-a62a-3a4b3293ddea tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:59.551166 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c6bf1706-ee2e-4d75-a62a-3a4b3293ddea tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:59.551594 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c6bf1706-ee2e-4d75-a62a-3a4b3293ddea tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:59.650050 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-1942757f-a758-4bef-a048-46552ca2d8f6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:59.650691 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-1942757f-a758-4bef-a048-46552ca2d8f6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:59.657392 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1942757f-a758-4bef-a048-46552ca2d8f6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:59.657882 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1942757f-a758-4bef-a048-46552ca2d8f6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:59.658787 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1942757f-a758-4bef-a048-46552ca2d8f6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:59.659223 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1942757f-a758-4bef-a048-46552ca2d8f6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:59.689248 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-c6bf1706-ee2e-4d75-a62a-3a4b3293ddea tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:59.698647 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-c6bf1706-ee2e-4d75-a62a-3a4b3293ddea tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:59.700197 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-c6bf1706-ee2e-4d75-a62a-3a4b3293ddea tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:59.701363 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-c6bf1706-ee2e-4d75-a62a-3a4b3293ddea tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.162839 Jul 20 19:34:59.701956 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 582/1163] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:34:59 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:34:59.725072 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1942757f-a758-4bef-a048-46552ca2d8f6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:59.732715 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-1942757f-a758-4bef-a048-46552ca2d8f6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.086516 Jul 20 19:34:59.733281 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 582/1164] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:59 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:35:00.301584 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-e83903bf-583b-48e9-af3e-3cdd0ec9ab5f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:00.302193 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-e83903bf-583b-48e9-af3e-3cdd0ec9ab5f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:00.308794 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e83903bf-583b-48e9-af3e-3cdd0ec9ab5f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:00.309268 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e83903bf-583b-48e9-af3e-3cdd0ec9ab5f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:00.310062 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e83903bf-583b-48e9-af3e-3cdd0ec9ab5f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:00.310619 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e83903bf-583b-48e9-af3e-3cdd0ec9ab5f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:00.449751 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-e83903bf-583b-48e9-af3e-3cdd0ec9ab5f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:00.458110 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-e83903bf-583b-48e9-af3e-3cdd0ec9ab5f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.161049 Jul 20 19:35:00.458678 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 583/1165] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:00 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:00.721764 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d9be6b76-7a0e-4f73-8fbc-1afbfb09e922 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:00.722586 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d9be6b76-7a0e-4f73-8fbc-1afbfb09e922 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:00.729068 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d9be6b76-7a0e-4f73-8fbc-1afbfb09e922 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:00.729588 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d9be6b76-7a0e-4f73-8fbc-1afbfb09e922 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:00.730302 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d9be6b76-7a0e-4f73-8fbc-1afbfb09e922 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:00.730728 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d9be6b76-7a0e-4f73-8fbc-1afbfb09e922 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:00.750540 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-e1ecdba0-29f6-4811-bd14-cbf9a1aeac99 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:00.751284 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-e1ecdba0-29f6-4811-bd14-cbf9a1aeac99 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:00.758073 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e1ecdba0-29f6-4811-bd14-cbf9a1aeac99 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:00.758523 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e1ecdba0-29f6-4811-bd14-cbf9a1aeac99 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:00.759295 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e1ecdba0-29f6-4811-bd14-cbf9a1aeac99 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:00.759733 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e1ecdba0-29f6-4811-bd14-cbf9a1aeac99 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:00.822674 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-e1ecdba0-29f6-4811-bd14-cbf9a1aeac99 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:00.831296 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-e1ecdba0-29f6-4811-bd14-cbf9a1aeac99 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.084146 Jul 20 19:35:00.831898 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 584/1166] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:00 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:35:00.866368 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d9be6b76-7a0e-4f73-8fbc-1afbfb09e922 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:00.874573 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d9be6b76-7a0e-4f73-8fbc-1afbfb09e922 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:00.876176 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d9be6b76-7a0e-4f73-8fbc-1afbfb09e922 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:00.877897 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d9be6b76-7a0e-4f73-8fbc-1afbfb09e922 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.161019 Jul 20 19:35:00.878553 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 583/1167] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:00 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:35:01.476274 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-909c6597-650f-46b9-b90d-0b68703a6b66 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:01.476869 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-909c6597-650f-46b9-b90d-0b68703a6b66 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:01.483603 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-909c6597-650f-46b9-b90d-0b68703a6b66 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:01.484037 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-909c6597-650f-46b9-b90d-0b68703a6b66 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:01.484829 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-909c6597-650f-46b9-b90d-0b68703a6b66 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:01.485282 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-909c6597-650f-46b9-b90d-0b68703a6b66 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:01.627281 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-909c6597-650f-46b9-b90d-0b68703a6b66 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:01.635222 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-909c6597-650f-46b9-b90d-0b68703a6b66 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.163029 Jul 20 19:35:01.635802 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 585/1168] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:01 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:35:01.848762 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-193d0f7d-80aa-479e-b1dd-4f3a22ed15bd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:01.849392 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-193d0f7d-80aa-479e-b1dd-4f3a22ed15bd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:01.855951 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-193d0f7d-80aa-479e-b1dd-4f3a22ed15bd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:01.856392 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-193d0f7d-80aa-479e-b1dd-4f3a22ed15bd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:01.857151 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-193d0f7d-80aa-479e-b1dd-4f3a22ed15bd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:01.857607 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-193d0f7d-80aa-479e-b1dd-4f3a22ed15bd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:01.896291 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-2c2b5ede-338f-4c49-95e0-46ac30ff2cbb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:01.896843 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-2c2b5ede-338f-4c49-95e0-46ac30ff2cbb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:01.903392 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2c2b5ede-338f-4c49-95e0-46ac30ff2cbb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:01.903837 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2c2b5ede-338f-4c49-95e0-46ac30ff2cbb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:01.904600 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2c2b5ede-338f-4c49-95e0-46ac30ff2cbb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:01.905038 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2c2b5ede-338f-4c49-95e0-46ac30ff2cbb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:01.920650 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-193d0f7d-80aa-479e-b1dd-4f3a22ed15bd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:01.930048 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-193d0f7d-80aa-479e-b1dd-4f3a22ed15bd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.085666 Jul 20 19:35:01.930622 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 584/1169] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:01 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:02.038953 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-2c2b5ede-338f-4c49-95e0-46ac30ff2cbb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:02.047221 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-2c2b5ede-338f-4c49-95e0-46ac30ff2cbb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:02.048715 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-2c2b5ede-338f-4c49-95e0-46ac30ff2cbb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:02.050212 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-2c2b5ede-338f-4c49-95e0-46ac30ff2cbb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.158175 Jul 20 19:35:02.050763 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 586/1170] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:01 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:35:02.652266 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-7abf35a7-549b-421f-94b3-47b6e75a3a04 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:02.652873 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-7abf35a7-549b-421f-94b3-47b6e75a3a04 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:02.659158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7abf35a7-549b-421f-94b3-47b6e75a3a04 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:02.659609 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7abf35a7-549b-421f-94b3-47b6e75a3a04 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:02.660376 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7abf35a7-549b-421f-94b3-47b6e75a3a04 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:02.660811 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7abf35a7-549b-421f-94b3-47b6e75a3a04 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:02.794496 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-7abf35a7-549b-421f-94b3-47b6e75a3a04 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:02.802476 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-7abf35a7-549b-421f-94b3-47b6e75a3a04 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.154110 Jul 20 19:35:02.803034 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 585/1171] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:02 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:02.947634 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-f8973c42-8668-428e-8334-5de6cc2a4af5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:02.948364 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-f8973c42-8668-428e-8334-5de6cc2a4af5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:02.954960 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f8973c42-8668-428e-8334-5de6cc2a4af5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:02.955405 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f8973c42-8668-428e-8334-5de6cc2a4af5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:02.956166 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f8973c42-8668-428e-8334-5de6cc2a4af5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:02.956595 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-f8973c42-8668-428e-8334-5de6cc2a4af5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:02.960510 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_cell1:SELECT=100 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:35:03.019294 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-f8973c42-8668-428e-8334-5de6cc2a4af5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:03.026904 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-f8973c42-8668-428e-8334-5de6cc2a4af5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.083201 Jul 20 19:35:03.027459 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 587/1172] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:02 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:03.068757 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-dbcbc6ab-f32f-41e5-9127-1e2101244d59 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:03.069344 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-dbcbc6ab-f32f-41e5-9127-1e2101244d59 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:03.077461 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-dbcbc6ab-f32f-41e5-9127-1e2101244d59 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:03.077937 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-dbcbc6ab-f32f-41e5-9127-1e2101244d59 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:03.078708 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-dbcbc6ab-f32f-41e5-9127-1e2101244d59 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:03.079146 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-dbcbc6ab-f32f-41e5-9127-1e2101244d59 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:03.210488 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-dbcbc6ab-f32f-41e5-9127-1e2101244d59 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:03.219178 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-dbcbc6ab-f32f-41e5-9127-1e2101244d59 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:03.221300 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-dbcbc6ab-f32f-41e5-9127-1e2101244d59 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:03.222601 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-dbcbc6ab-f32f-41e5-9127-1e2101244d59 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.158363 Jul 20 19:35:03.223348 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 586/1173] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:03 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:35:03.820403 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-66340fcf-e652-45ef-be4f-bced0939a713 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:03.821008 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-66340fcf-e652-45ef-be4f-bced0939a713 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:03.827281 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-66340fcf-e652-45ef-be4f-bced0939a713 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:03.827720 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-66340fcf-e652-45ef-be4f-bced0939a713 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:03.828480 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-66340fcf-e652-45ef-be4f-bced0939a713 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:03.828908 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-66340fcf-e652-45ef-be4f-bced0939a713 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:03.966400 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-66340fcf-e652-45ef-be4f-bced0939a713 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:03.974329 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-66340fcf-e652-45ef-be4f-bced0939a713 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.157791 Jul 20 19:35:03.974895 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 588/1174] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:03 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:04.043607 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-0f5b2532-5bee-4b4d-9d29-66e43efbc1df tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:04.044208 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-0f5b2532-5bee-4b4d-9d29-66e43efbc1df tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:04.050730 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0f5b2532-5bee-4b4d-9d29-66e43efbc1df tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:04.051183 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0f5b2532-5bee-4b4d-9d29-66e43efbc1df tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:04.051957 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0f5b2532-5bee-4b4d-9d29-66e43efbc1df tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:04.052394 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0f5b2532-5bee-4b4d-9d29-66e43efbc1df tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:04.114571 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0f5b2532-5bee-4b4d-9d29-66e43efbc1df tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:04.122211 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-0f5b2532-5bee-4b4d-9d29-66e43efbc1df tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.082540 Jul 20 19:35:04.122824 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 587/1175] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:04 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:04.241663 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-dbba7c43-01b2-4418-88bd-d1f90526b8ac tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:04.242255 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-dbba7c43-01b2-4418-88bd-d1f90526b8ac tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:04.248275 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-dbba7c43-01b2-4418-88bd-d1f90526b8ac tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:04.248725 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-dbba7c43-01b2-4418-88bd-d1f90526b8ac tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:04.249477 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-dbba7c43-01b2-4418-88bd-d1f90526b8ac tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:04.249939 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-dbba7c43-01b2-4418-88bd-d1f90526b8ac tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:04.382966 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-dbba7c43-01b2-4418-88bd-d1f90526b8ac tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:04.391708 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-dbba7c43-01b2-4418-88bd-d1f90526b8ac tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:04.393275 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-dbba7c43-01b2-4418-88bd-d1f90526b8ac tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:04.394451 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-dbba7c43-01b2-4418-88bd-d1f90526b8ac tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.156996 Jul 20 19:35:04.395005 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 589/1176] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:04 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:35:04.991195 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-0cbfd526-e1d3-44cd-a4f7-6b1d6853a704 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:04.991803 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-0cbfd526-e1d3-44cd-a4f7-6b1d6853a704 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:04.998125 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0cbfd526-e1d3-44cd-a4f7-6b1d6853a704 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:04.998578 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0cbfd526-e1d3-44cd-a4f7-6b1d6853a704 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:04.999342 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0cbfd526-e1d3-44cd-a4f7-6b1d6853a704 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:04.999781 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0cbfd526-e1d3-44cd-a4f7-6b1d6853a704 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:05.138915 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0cbfd526-e1d3-44cd-a4f7-6b1d6853a704 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:05.140127 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-2251c4d4-5edd-4405-a961-142b96da0eea tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:05.140845 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-2251c4d4-5edd-4405-a961-142b96da0eea tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:05.147773 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2251c4d4-5edd-4405-a961-142b96da0eea tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:05.148212 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2251c4d4-5edd-4405-a961-142b96da0eea tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:05.148974 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2251c4d4-5edd-4405-a961-142b96da0eea tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:05.149432 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2251c4d4-5edd-4405-a961-142b96da0eea tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:05.150730 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-0cbfd526-e1d3-44cd-a4f7-6b1d6853a704 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.163048 Jul 20 19:35:05.151642 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 588/1177] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:04 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:05.211791 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-2251c4d4-5edd-4405-a961-142b96da0eea tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:05.219625 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-2251c4d4-5edd-4405-a961-142b96da0eea tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.083584 Jul 20 19:35:05.220180 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 590/1178] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:05 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:35:05.413086 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-fc3a4e1e-ba73-4c6b-bdcf-3cea3479d7a9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:05.413729 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-fc3a4e1e-ba73-4c6b-bdcf-3cea3479d7a9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:05.419780 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fc3a4e1e-ba73-4c6b-bdcf-3cea3479d7a9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:05.420225 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fc3a4e1e-ba73-4c6b-bdcf-3cea3479d7a9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:05.420992 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fc3a4e1e-ba73-4c6b-bdcf-3cea3479d7a9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:05.421425 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fc3a4e1e-ba73-4c6b-bdcf-3cea3479d7a9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:05.556548 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-fc3a4e1e-ba73-4c6b-bdcf-3cea3479d7a9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:05.565747 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-fc3a4e1e-ba73-4c6b-bdcf-3cea3479d7a9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:05.567271 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-fc3a4e1e-ba73-4c6b-bdcf-3cea3479d7a9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:05.568437 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-fc3a4e1e-ba73-4c6b-bdcf-3cea3479d7a9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.159431 Jul 20 19:35:05.569006 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 589/1179] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:05 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:35:06.178328 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-22014fca-b8da-4396-bd87-dbc209401898 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:06.179016 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-22014fca-b8da-4396-bd87-dbc209401898 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:06.185813 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-22014fca-b8da-4396-bd87-dbc209401898 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:06.186260 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-22014fca-b8da-4396-bd87-dbc209401898 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:06.187028 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-22014fca-b8da-4396-bd87-dbc209401898 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:06.187459 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-22014fca-b8da-4396-bd87-dbc209401898 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:06.238266 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-db234151-7a9e-4f71-8f7c-11c0dcd4f363 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:06.239074 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-db234151-7a9e-4f71-8f7c-11c0dcd4f363 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:06.245947 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-db234151-7a9e-4f71-8f7c-11c0dcd4f363 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:06.246481 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-db234151-7a9e-4f71-8f7c-11c0dcd4f363 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:06.247329 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-db234151-7a9e-4f71-8f7c-11c0dcd4f363 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:06.247834 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-db234151-7a9e-4f71-8f7c-11c0dcd4f363 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:06.314399 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-db234151-7a9e-4f71-8f7c-11c0dcd4f363 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:06.325377 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-db234151-7a9e-4f71-8f7c-11c0dcd4f363 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.091914 Jul 20 19:35:06.326176 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 590/1180] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:06 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:35:06.335103 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-22014fca-b8da-4396-bd87-dbc209401898 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:06.342969 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-22014fca-b8da-4396-bd87-dbc209401898 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.172084 Jul 20 19:35:06.343539 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 591/1181] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:06 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:06.587254 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c501a388-33d3-433c-8842-720b0db8fd59 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:06.587759 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c501a388-33d3-433c-8842-720b0db8fd59 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:06.594268 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c501a388-33d3-433c-8842-720b0db8fd59 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:06.594712 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c501a388-33d3-433c-8842-720b0db8fd59 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:06.595462 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c501a388-33d3-433c-8842-720b0db8fd59 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:06.596739 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c501a388-33d3-433c-8842-720b0db8fd59 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:06.750110 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c501a388-33d3-433c-8842-720b0db8fd59 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:06.758949 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c501a388-33d3-433c-8842-720b0db8fd59 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:06.760879 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c501a388-33d3-433c-8842-720b0db8fd59 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:06.762283 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c501a388-33d3-433c-8842-720b0db8fd59 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.179129 Jul 20 19:35:06.762852 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 591/1182] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:06 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:35:07.343360 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-1057e6dc-fa51-4e5b-9735-06a077c3f6dc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:07.344061 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-1057e6dc-fa51-4e5b-9735-06a077c3f6dc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:07.350799 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1057e6dc-fa51-4e5b-9735-06a077c3f6dc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:07.351253 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1057e6dc-fa51-4e5b-9735-06a077c3f6dc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:07.352040 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1057e6dc-fa51-4e5b-9735-06a077c3f6dc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:07.352477 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1057e6dc-fa51-4e5b-9735-06a077c3f6dc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:07.360015 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-8080e57e-296a-470a-a39b-110dbbb8082a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:07.360706 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-8080e57e-296a-470a-a39b-110dbbb8082a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:07.368350 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8080e57e-296a-470a-a39b-110dbbb8082a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:07.368798 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8080e57e-296a-470a-a39b-110dbbb8082a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:07.369598 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8080e57e-296a-470a-a39b-110dbbb8082a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:07.370242 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8080e57e-296a-470a-a39b-110dbbb8082a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:07.416441 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-1057e6dc-fa51-4e5b-9735-06a077c3f6dc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:07.424439 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-1057e6dc-fa51-4e5b-9735-06a077c3f6dc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.084663 Jul 20 19:35:07.425218 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 592/1183] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:07 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:07.501656 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8080e57e-296a-470a-a39b-110dbbb8082a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:07.510082 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-8080e57e-296a-470a-a39b-110dbbb8082a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.153801 Jul 20 19:35:07.511721 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 592/1184] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:07 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:35:07.781198 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-d4611fac-49a8-4af6-92fc-a5c3ecf95975 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:07.781870 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-d4611fac-49a8-4af6-92fc-a5c3ecf95975 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:07.788440 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d4611fac-49a8-4af6-92fc-a5c3ecf95975 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:07.788888 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d4611fac-49a8-4af6-92fc-a5c3ecf95975 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:07.789674 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d4611fac-49a8-4af6-92fc-a5c3ecf95975 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:07.790114 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d4611fac-49a8-4af6-92fc-a5c3ecf95975 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:07.933186 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-d4611fac-49a8-4af6-92fc-a5c3ecf95975 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:07.941807 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-d4611fac-49a8-4af6-92fc-a5c3ecf95975 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:07.943365 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-d4611fac-49a8-4af6-92fc-a5c3ecf95975 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:07.944522 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-d4611fac-49a8-4af6-92fc-a5c3ecf95975 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.167428 Jul 20 19:35:07.945085 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 593/1185] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:07 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:35:08.442390 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e68d7f2f-a1bf-4dd7-b253-eab181b35e55 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:08.442923 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e68d7f2f-a1bf-4dd7-b253-eab181b35e55 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:08.449558 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e68d7f2f-a1bf-4dd7-b253-eab181b35e55 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:08.450007 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e68d7f2f-a1bf-4dd7-b253-eab181b35e55 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:08.450763 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e68d7f2f-a1bf-4dd7-b253-eab181b35e55 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:08.451192 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e68d7f2f-a1bf-4dd7-b253-eab181b35e55 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:08.512466 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e68d7f2f-a1bf-4dd7-b253-eab181b35e55 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:08.520674 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e68d7f2f-a1bf-4dd7-b253-eab181b35e55 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.083011 Jul 20 19:35:08.521229 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 593/1186] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:08 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:08.527033 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-0ab4757b-da53-4d02-b7c7-18c7ac0c649a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:08.527657 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-0ab4757b-da53-4d02-b7c7-18c7ac0c649a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:08.534464 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-0ab4757b-da53-4d02-b7c7-18c7ac0c649a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:08.534913 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-0ab4757b-da53-4d02-b7c7-18c7ac0c649a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:08.535662 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-0ab4757b-da53-4d02-b7c7-18c7ac0c649a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:08.536089 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-0ab4757b-da53-4d02-b7c7-18c7ac0c649a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:08.668757 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-0ab4757b-da53-4d02-b7c7-18c7ac0c649a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:08.676915 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-0ab4757b-da53-4d02-b7c7-18c7ac0c649a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.153624 Jul 20 19:35:08.677485 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 594/1187] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:08 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:08.962767 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-98cc5c68-4233-4a44-8943-2bdead070d32 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:08.963366 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-98cc5c68-4233-4a44-8943-2bdead070d32 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:08.969881 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-98cc5c68-4233-4a44-8943-2bdead070d32 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:08.970337 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-98cc5c68-4233-4a44-8943-2bdead070d32 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:08.971225 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-98cc5c68-4233-4a44-8943-2bdead070d32 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:08.971692 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-98cc5c68-4233-4a44-8943-2bdead070d32 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:09.113252 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-98cc5c68-4233-4a44-8943-2bdead070d32 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:09.121677 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-98cc5c68-4233-4a44-8943-2bdead070d32 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:09.123201 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-98cc5c68-4233-4a44-8943-2bdead070d32 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:09.124368 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-98cc5c68-4233-4a44-8943-2bdead070d32 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.165610 Jul 20 19:35:09.124925 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 594/1188] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:08 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:35:09.537259 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-02334258-3ecc-42d3-a258-8e465ad5d402 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:09.537893 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-02334258-3ecc-42d3-a258-8e465ad5d402 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:09.544444 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-02334258-3ecc-42d3-a258-8e465ad5d402 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:09.544892 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-02334258-3ecc-42d3-a258-8e465ad5d402 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:09.546339 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-02334258-3ecc-42d3-a258-8e465ad5d402 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:09.546789 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-02334258-3ecc-42d3-a258-8e465ad5d402 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:09.610198 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-02334258-3ecc-42d3-a258-8e465ad5d402 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:09.618034 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-02334258-3ecc-42d3-a258-8e465ad5d402 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.085222 Jul 20 19:35:09.618817 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 595/1189] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:09 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:09.694669 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-fcfc776e-497c-4ab0-8020-9f8226ad8cab tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:09.695280 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-fcfc776e-497c-4ab0-8020-9f8226ad8cab tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:09.701723 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fcfc776e-497c-4ab0-8020-9f8226ad8cab tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:09.702169 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fcfc776e-497c-4ab0-8020-9f8226ad8cab tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:09.702925 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fcfc776e-497c-4ab0-8020-9f8226ad8cab tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:09.703357 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fcfc776e-497c-4ab0-8020-9f8226ad8cab tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:09.834035 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-fcfc776e-497c-4ab0-8020-9f8226ad8cab tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:09.842093 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-fcfc776e-497c-4ab0-8020-9f8226ad8cab tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.151209 Jul 20 19:35:09.842783 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 595/1190] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:09 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:10.142478 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-1232a5e5-e324-4644-bd9d-1e0d290e23fe tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:10.143667 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-1232a5e5-e324-4644-bd9d-1e0d290e23fe tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:10.150107 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1232a5e5-e324-4644-bd9d-1e0d290e23fe tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:10.150548 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1232a5e5-e324-4644-bd9d-1e0d290e23fe tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:10.151300 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1232a5e5-e324-4644-bd9d-1e0d290e23fe tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:10.151730 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1232a5e5-e324-4644-bd9d-1e0d290e23fe tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:10.282553 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-1232a5e5-e324-4644-bd9d-1e0d290e23fe tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:10.291416 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-1232a5e5-e324-4644-bd9d-1e0d290e23fe tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:10.292898 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-1232a5e5-e324-4644-bd9d-1e0d290e23fe tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:10.294111 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-1232a5e5-e324-4644-bd9d-1e0d290e23fe tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.155626 Jul 20 19:35:10.294911 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 596/1191] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:10 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:35:10.634948 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-7195175a-d970-4213-afcc-c0694df6ed7e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:10.635604 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-7195175a-d970-4213-afcc-c0694df6ed7e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:10.641649 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7195175a-d970-4213-afcc-c0694df6ed7e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:10.642101 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7195175a-d970-4213-afcc-c0694df6ed7e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:10.642937 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7195175a-d970-4213-afcc-c0694df6ed7e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:10.643374 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7195175a-d970-4213-afcc-c0694df6ed7e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:10.645942 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:35:10.710100 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-7195175a-d970-4213-afcc-c0694df6ed7e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:10.717794 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-7195175a-d970-4213-afcc-c0694df6ed7e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.086904 Jul 20 19:35:10.718359 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 596/1192] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:10 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:10.859994 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-a9742d2e-a029-42e3-b828-865ecdfebfc4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:10.860603 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-a9742d2e-a029-42e3-b828-865ecdfebfc4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:10.867994 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a9742d2e-a029-42e3-b828-865ecdfebfc4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:10.868489 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a9742d2e-a029-42e3-b828-865ecdfebfc4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:10.869464 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a9742d2e-a029-42e3-b828-865ecdfebfc4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:10.869985 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-a9742d2e-a029-42e3-b828-865ecdfebfc4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:10.999670 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-a9742d2e-a029-42e3-b828-865ecdfebfc4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:11.007319 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-a9742d2e-a029-42e3-b828-865ecdfebfc4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.151198 Jul 20 19:35:11.007880 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 597/1193] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:10 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:11.313404 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c0e27853-02c8-45ff-a91c-aa185bb2696a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:11.313952 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c0e27853-02c8-45ff-a91c-aa185bb2696a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:11.321248 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c0e27853-02c8-45ff-a91c-aa185bb2696a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:11.321734 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c0e27853-02c8-45ff-a91c-aa185bb2696a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:11.322507 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c0e27853-02c8-45ff-a91c-aa185bb2696a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:11.322939 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c0e27853-02c8-45ff-a91c-aa185bb2696a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:11.455150 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c0e27853-02c8-45ff-a91c-aa185bb2696a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:11.464542 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c0e27853-02c8-45ff-a91c-aa185bb2696a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:11.466125 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c0e27853-02c8-45ff-a91c-aa185bb2696a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:11.467429 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c0e27853-02c8-45ff-a91c-aa185bb2696a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.158097 Jul 20 19:35:11.467987 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 597/1194] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:11 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:35:11.734004 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-41cf9566-3bbe-4b93-b606-196badc66b67 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:11.734614 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-41cf9566-3bbe-4b93-b606-196badc66b67 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:11.741157 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-41cf9566-3bbe-4b93-b606-196badc66b67 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:11.741636 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-41cf9566-3bbe-4b93-b606-196badc66b67 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:11.742398 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-41cf9566-3bbe-4b93-b606-196badc66b67 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:11.742831 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-41cf9566-3bbe-4b93-b606-196badc66b67 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:11.803646 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-41cf9566-3bbe-4b93-b606-196badc66b67 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:11.811095 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-41cf9566-3bbe-4b93-b606-196badc66b67 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080949 Jul 20 19:35:11.811658 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 598/1195] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:11 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:12.024325 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c2786b31-0d16-4c9c-ba79-cabc02331574 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:12.024845 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c2786b31-0d16-4c9c-ba79-cabc02331574 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:12.031352 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c2786b31-0d16-4c9c-ba79-cabc02331574 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:12.031795 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c2786b31-0d16-4c9c-ba79-cabc02331574 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:12.032549 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c2786b31-0d16-4c9c-ba79-cabc02331574 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:12.032975 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c2786b31-0d16-4c9c-ba79-cabc02331574 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:12.162934 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c2786b31-0d16-4c9c-ba79-cabc02331574 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:12.170337 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c2786b31-0d16-4c9c-ba79-cabc02331574 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.150017 Jul 20 19:35:12.170896 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 598/1196] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:12 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:12.487312 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-1fe33659-f5ec-4691-aed2-23bdfd0c1969 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:12.488019 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-1fe33659-f5ec-4691-aed2-23bdfd0c1969 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:12.494496 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1fe33659-f5ec-4691-aed2-23bdfd0c1969 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:12.494944 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1fe33659-f5ec-4691-aed2-23bdfd0c1969 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:12.495703 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1fe33659-f5ec-4691-aed2-23bdfd0c1969 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:12.496237 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1fe33659-f5ec-4691-aed2-23bdfd0c1969 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:12.627213 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-1fe33659-f5ec-4691-aed2-23bdfd0c1969 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:12.635633 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-1fe33659-f5ec-4691-aed2-23bdfd0c1969 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:12.637155 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-1fe33659-f5ec-4691-aed2-23bdfd0c1969 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:12.638333 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-1fe33659-f5ec-4691-aed2-23bdfd0c1969 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.156317 Jul 20 19:35:12.638899 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 599/1197] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:12 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:35:12.828579 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-6a61e116-314d-4ee3-b85d-97dc9b5f7dfc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:12.829106 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-6a61e116-314d-4ee3-b85d-97dc9b5f7dfc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:12.835832 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6a61e116-314d-4ee3-b85d-97dc9b5f7dfc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:12.836282 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6a61e116-314d-4ee3-b85d-97dc9b5f7dfc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:12.837050 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6a61e116-314d-4ee3-b85d-97dc9b5f7dfc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:12.837490 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6a61e116-314d-4ee3-b85d-97dc9b5f7dfc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:12.901985 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6a61e116-314d-4ee3-b85d-97dc9b5f7dfc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:12.910082 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-6a61e116-314d-4ee3-b85d-97dc9b5f7dfc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.085459 Jul 20 19:35:12.910651 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 599/1198] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:12 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:13.187955 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-df97a1d2-69c1-4733-a15e-ffed84418a0d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:13.188558 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-df97a1d2-69c1-4733-a15e-ffed84418a0d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:13.194833 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-df97a1d2-69c1-4733-a15e-ffed84418a0d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:13.195295 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-df97a1d2-69c1-4733-a15e-ffed84418a0d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:13.196033 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-df97a1d2-69c1-4733-a15e-ffed84418a0d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:13.196465 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-df97a1d2-69c1-4733-a15e-ffed84418a0d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:13.328524 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-df97a1d2-69c1-4733-a15e-ffed84418a0d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:13.336304 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-df97a1d2-69c1-4733-a15e-ffed84418a0d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.152250 Jul 20 19:35:13.336855 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 600/1199] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:13 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:13.656410 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-aeddef76-d2a7-4c63-ae69-98613560891a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:13.657077 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-aeddef76-d2a7-4c63-ae69-98613560891a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:13.664485 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aeddef76-d2a7-4c63-ae69-98613560891a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:13.664928 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aeddef76-d2a7-4c63-ae69-98613560891a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:13.665722 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aeddef76-d2a7-4c63-ae69-98613560891a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:13.666158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aeddef76-d2a7-4c63-ae69-98613560891a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:13.795221 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-aeddef76-d2a7-4c63-ae69-98613560891a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:13.804370 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-aeddef76-d2a7-4c63-ae69-98613560891a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:13.805945 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-aeddef76-d2a7-4c63-ae69-98613560891a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:13.807119 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-aeddef76-d2a7-4c63-ae69-98613560891a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.154642 Jul 20 19:35:13.807679 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 600/1200] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:13 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:35:13.927470 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-35678f10-82a2-44be-9daf-b2130fa80487 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:13.928049 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-35678f10-82a2-44be-9daf-b2130fa80487 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:13.934596 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-35678f10-82a2-44be-9daf-b2130fa80487 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:13.935033 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-35678f10-82a2-44be-9daf-b2130fa80487 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:13.935784 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-35678f10-82a2-44be-9daf-b2130fa80487 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:13.936212 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-35678f10-82a2-44be-9daf-b2130fa80487 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:13.997123 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-35678f10-82a2-44be-9daf-b2130fa80487 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:14.004883 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-35678f10-82a2-44be-9daf-b2130fa80487 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.082118 Jul 20 19:35:14.005436 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 601/1201] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:13 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:14.354192 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c3e9c453-bccf-4cdc-a9ab-8d0b17436476 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:14.354807 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c3e9c453-bccf-4cdc-a9ab-8d0b17436476 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:14.360967 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c3e9c453-bccf-4cdc-a9ab-8d0b17436476 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:14.361627 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c3e9c453-bccf-4cdc-a9ab-8d0b17436476 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:14.362562 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c3e9c453-bccf-4cdc-a9ab-8d0b17436476 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:14.363000 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c3e9c453-bccf-4cdc-a9ab-8d0b17436476 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:14.490179 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c3e9c453-bccf-4cdc-a9ab-8d0b17436476 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:14.497703 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c3e9c453-bccf-4cdc-a9ab-8d0b17436476 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.147916 Jul 20 19:35:14.498262 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 601/1202] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:14 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:14.825771 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-c543e244-0c55-439a-8a64-bb46df84754a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:14.826284 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-c543e244-0c55-439a-8a64-bb46df84754a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:14.832489 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c543e244-0c55-439a-8a64-bb46df84754a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:14.832934 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c543e244-0c55-439a-8a64-bb46df84754a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:14.833721 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c543e244-0c55-439a-8a64-bb46df84754a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:14.834151 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c543e244-0c55-439a-8a64-bb46df84754a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:14.964571 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-c543e244-0c55-439a-8a64-bb46df84754a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:14.973281 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-c543e244-0c55-439a-8a64-bb46df84754a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:14.974848 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-c543e244-0c55-439a-8a64-bb46df84754a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:14.976039 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-c543e244-0c55-439a-8a64-bb46df84754a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.154310 Jul 20 19:35:14.976591 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 602/1203] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:14 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:35:15.021342 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-5350625b-cff0-413e-b96c-22e812755cde tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:15.021980 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-5350625b-cff0-413e-b96c-22e812755cde tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:15.024295 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_api:SELECT=80 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:35:15.029669 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5350625b-cff0-413e-b96c-22e812755cde tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:15.030114 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5350625b-cff0-413e-b96c-22e812755cde tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:15.030875 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5350625b-cff0-413e-b96c-22e812755cde tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:15.031309 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5350625b-cff0-413e-b96c-22e812755cde tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:15.096919 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-5350625b-cff0-413e-b96c-22e812755cde tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:15.104522 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-5350625b-cff0-413e-b96c-22e812755cde tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.087131 Jul 20 19:35:15.105083 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 602/1204] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:15 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:15.515177 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-d5632670-b7ce-4c42-acec-cc603101e833 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:15.515774 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-d5632670-b7ce-4c42-acec-cc603101e833 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:15.522388 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d5632670-b7ce-4c42-acec-cc603101e833 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:15.522828 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d5632670-b7ce-4c42-acec-cc603101e833 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:15.523572 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d5632670-b7ce-4c42-acec-cc603101e833 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:15.524000 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d5632670-b7ce-4c42-acec-cc603101e833 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:15.655077 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-d5632670-b7ce-4c42-acec-cc603101e833 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:15.657257 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_cell1:SELECT=100 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:35:15.664938 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-d5632670-b7ce-4c42-acec-cc603101e833 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.153641 Jul 20 19:35:15.665549 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 603/1205] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:15 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:15.994921 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e12b5f93-820c-4091-9d03-a7e2f6dcd24b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:15.995527 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e12b5f93-820c-4091-9d03-a7e2f6dcd24b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:16.001541 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e12b5f93-820c-4091-9d03-a7e2f6dcd24b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:16.002847 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e12b5f93-820c-4091-9d03-a7e2f6dcd24b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:16.003626 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e12b5f93-820c-4091-9d03-a7e2f6dcd24b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:16.004055 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e12b5f93-820c-4091-9d03-a7e2f6dcd24b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:16.122628 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-8fabc0d6-2f40-44dd-8ce8-0d138cab127c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:16.123217 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-8fabc0d6-2f40-44dd-8ce8-0d138cab127c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:16.130418 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8fabc0d6-2f40-44dd-8ce8-0d138cab127c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:16.130785 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8fabc0d6-2f40-44dd-8ce8-0d138cab127c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:16.131554 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8fabc0d6-2f40-44dd-8ce8-0d138cab127c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:16.131987 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-8fabc0d6-2f40-44dd-8ce8-0d138cab127c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:16.133144 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e12b5f93-820c-4091-9d03-a7e2f6dcd24b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:16.141529 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e12b5f93-820c-4091-9d03-a7e2f6dcd24b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:16.143656 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e12b5f93-820c-4091-9d03-a7e2f6dcd24b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:16.144820 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e12b5f93-820c-4091-9d03-a7e2f6dcd24b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.153937 Jul 20 19:35:16.145370 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 603/1206] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:15 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:35:16.194691 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-8fabc0d6-2f40-44dd-8ce8-0d138cab127c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:16.202163 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-8fabc0d6-2f40-44dd-8ce8-0d138cab127c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.083404 Jul 20 19:35:16.202712 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 604/1207] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:16 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:16.682033 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-938de78f-3acd-4b15-a92c-7f75ee688f05 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:16.682642 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-938de78f-3acd-4b15-a92c-7f75ee688f05 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:16.688712 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-938de78f-3acd-4b15-a92c-7f75ee688f05 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:16.689192 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-938de78f-3acd-4b15-a92c-7f75ee688f05 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:16.690007 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-938de78f-3acd-4b15-a92c-7f75ee688f05 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:16.690445 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-938de78f-3acd-4b15-a92c-7f75ee688f05 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:16.821454 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-938de78f-3acd-4b15-a92c-7f75ee688f05 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:16.829023 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-938de78f-3acd-4b15-a92c-7f75ee688f05 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.150810 Jul 20 19:35:16.829609 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 604/1208] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:16 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:17.163197 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-09cda8cc-68be-46d1-bd87-fe95a2807790 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:17.163806 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-09cda8cc-68be-46d1-bd87-fe95a2807790 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:17.170330 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-09cda8cc-68be-46d1-bd87-fe95a2807790 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:17.170787 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-09cda8cc-68be-46d1-bd87-fe95a2807790 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:17.171545 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-09cda8cc-68be-46d1-bd87-fe95a2807790 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:17.171982 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-09cda8cc-68be-46d1-bd87-fe95a2807790 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:17.219229 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-592a02fd-45a6-4d72-97dc-dcd3d19dea42 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:17.219826 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-592a02fd-45a6-4d72-97dc-dcd3d19dea42 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:17.226377 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-592a02fd-45a6-4d72-97dc-dcd3d19dea42 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:17.226818 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-592a02fd-45a6-4d72-97dc-dcd3d19dea42 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:17.227577 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-592a02fd-45a6-4d72-97dc-dcd3d19dea42 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:17.228003 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-592a02fd-45a6-4d72-97dc-dcd3d19dea42 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:17.293667 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-592a02fd-45a6-4d72-97dc-dcd3d19dea42 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:17.301717 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-592a02fd-45a6-4d72-97dc-dcd3d19dea42 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.086213 Jul 20 19:35:17.302278 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 605/1209] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:17 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:35:17.307681 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-09cda8cc-68be-46d1-bd87-fe95a2807790 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:17.316395 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-09cda8cc-68be-46d1-bd87-fe95a2807790 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:17.317984 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-09cda8cc-68be-46d1-bd87-fe95a2807790 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:17.319154 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-09cda8cc-68be-46d1-bd87-fe95a2807790 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.160070 Jul 20 19:35:17.319705 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 605/1210] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:17 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:35:17.847503 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-295e3e45-191f-407e-962a-39c136b1bf99 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:17.848747 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-295e3e45-191f-407e-962a-39c136b1bf99 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:17.854968 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-295e3e45-191f-407e-962a-39c136b1bf99 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:17.855425 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-295e3e45-191f-407e-962a-39c136b1bf99 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:17.856205 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-295e3e45-191f-407e-962a-39c136b1bf99 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:17.856644 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-295e3e45-191f-407e-962a-39c136b1bf99 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:17.991228 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-295e3e45-191f-407e-962a-39c136b1bf99 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:17.998933 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-295e3e45-191f-407e-962a-39c136b1bf99 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.155499 Jul 20 19:35:17.999506 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 606/1211] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:17 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:18.319634 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-e55f3ca0-17a4-427e-aa20-31f986a56b44 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:18.320358 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-e55f3ca0-17a4-427e-aa20-31f986a56b44 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:18.327091 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e55f3ca0-17a4-427e-aa20-31f986a56b44 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:18.327539 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e55f3ca0-17a4-427e-aa20-31f986a56b44 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:18.328303 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e55f3ca0-17a4-427e-aa20-31f986a56b44 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:18.328741 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-e55f3ca0-17a4-427e-aa20-31f986a56b44 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:18.337568 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ebbfef9a-93fb-4ece-8883-303a129331a8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:18.338288 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ebbfef9a-93fb-4ece-8883-303a129331a8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:18.345079 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ebbfef9a-93fb-4ece-8883-303a129331a8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:18.345977 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ebbfef9a-93fb-4ece-8883-303a129331a8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:18.346527 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ebbfef9a-93fb-4ece-8883-303a129331a8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:18.346968 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ebbfef9a-93fb-4ece-8883-303a129331a8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:18.398107 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-e55f3ca0-17a4-427e-aa20-31f986a56b44 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:18.408607 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-e55f3ca0-17a4-427e-aa20-31f986a56b44 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.092538 Jul 20 19:35:18.409395 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 606/1212] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:18 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:18.499385 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ebbfef9a-93fb-4ece-8883-303a129331a8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:18.509916 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ebbfef9a-93fb-4ece-8883-303a129331a8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:18.511517 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ebbfef9a-93fb-4ece-8883-303a129331a8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:18.513440 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ebbfef9a-93fb-4ece-8883-303a129331a8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.179587 Jul 20 19:35:18.514048 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 607/1213] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:18 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:35:19.016615 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-2df82984-bf9d-4754-9d0f-83684e4d6ae5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:19.017231 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-2df82984-bf9d-4754-9d0f-83684e4d6ae5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:19.026255 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2df82984-bf9d-4754-9d0f-83684e4d6ae5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:19.027015 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2df82984-bf9d-4754-9d0f-83684e4d6ae5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:19.028316 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2df82984-bf9d-4754-9d0f-83684e4d6ae5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:19.029030 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-2df82984-bf9d-4754-9d0f-83684e4d6ae5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:19.192163 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-2df82984-bf9d-4754-9d0f-83684e4d6ae5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:19.200157 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-2df82984-bf9d-4754-9d0f-83684e4d6ae5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.187431 Jul 20 19:35:19.200795 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 607/1214] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:19 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:19.426536 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-f0c2092f-b4fd-4d79-835b-a90ce52fd874 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:19.427151 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-f0c2092f-b4fd-4d79-835b-a90ce52fd874 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:19.433691 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f0c2092f-b4fd-4d79-835b-a90ce52fd874 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:19.434148 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f0c2092f-b4fd-4d79-835b-a90ce52fd874 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:19.434909 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f0c2092f-b4fd-4d79-835b-a90ce52fd874 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:19.435343 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f0c2092f-b4fd-4d79-835b-a90ce52fd874 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:19.501657 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-f0c2092f-b4fd-4d79-835b-a90ce52fd874 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:19.509569 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-f0c2092f-b4fd-4d79-835b-a90ce52fd874 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.086932 Jul 20 19:35:19.510162 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 608/1215] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:19 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:19.535612 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-3f5b8109-62dd-4f14-bd92-2756c1f09e01 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:19.536211 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-3f5b8109-62dd-4f14-bd92-2756c1f09e01 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:19.542607 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3f5b8109-62dd-4f14-bd92-2756c1f09e01 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:19.543055 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3f5b8109-62dd-4f14-bd92-2756c1f09e01 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:19.543820 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3f5b8109-62dd-4f14-bd92-2756c1f09e01 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:19.544249 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-3f5b8109-62dd-4f14-bd92-2756c1f09e01 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:19.677297 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-3f5b8109-62dd-4f14-bd92-2756c1f09e01 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:19.685667 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-3f5b8109-62dd-4f14-bd92-2756c1f09e01 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:19.687212 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-3f5b8109-62dd-4f14-bd92-2756c1f09e01 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:19.688362 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-3f5b8109-62dd-4f14-bd92-2756c1f09e01 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.157616 Jul 20 19:35:19.688915 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 608/1216] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:19 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:35:20.221070 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-abce1ba3-ebdd-4b13-9256-394a3b817616 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:20.221717 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-abce1ba3-ebdd-4b13-9256-394a3b817616 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:20.227829 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-abce1ba3-ebdd-4b13-9256-394a3b817616 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:20.228277 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-abce1ba3-ebdd-4b13-9256-394a3b817616 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:20.229051 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-abce1ba3-ebdd-4b13-9256-394a3b817616 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:20.229476 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-abce1ba3-ebdd-4b13-9256-394a3b817616 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:20.368353 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-abce1ba3-ebdd-4b13-9256-394a3b817616 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:20.376995 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-abce1ba3-ebdd-4b13-9256-394a3b817616 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.159867 Jul 20 19:35:20.377587 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 609/1217] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:20 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:20.527444 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-296569c3-d8b3-40e7-9781-44b3ea148554 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:20.527956 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-296569c3-d8b3-40e7-9781-44b3ea148554 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:20.534926 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-296569c3-d8b3-40e7-9781-44b3ea148554 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:20.535366 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-296569c3-d8b3-40e7-9781-44b3ea148554 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:20.536112 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-296569c3-d8b3-40e7-9781-44b3ea148554 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:20.536654 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-296569c3-d8b3-40e7-9781-44b3ea148554 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:20.598951 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-296569c3-d8b3-40e7-9781-44b3ea148554 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:20.606570 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-296569c3-d8b3-40e7-9781-44b3ea148554 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.083121 Jul 20 19:35:20.607129 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 609/1218] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:20 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:20.707687 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-cf158ee6-5588-41ec-94fb-e83bbe48d7d8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:20.708321 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-cf158ee6-5588-41ec-94fb-e83bbe48d7d8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:20.715026 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cf158ee6-5588-41ec-94fb-e83bbe48d7d8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:20.715486 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cf158ee6-5588-41ec-94fb-e83bbe48d7d8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:20.716236 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cf158ee6-5588-41ec-94fb-e83bbe48d7d8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:20.716669 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cf158ee6-5588-41ec-94fb-e83bbe48d7d8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:20.846739 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-cf158ee6-5588-41ec-94fb-e83bbe48d7d8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:20.855466 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-cf158ee6-5588-41ec-94fb-e83bbe48d7d8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:20.856978 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-cf158ee6-5588-41ec-94fb-e83bbe48d7d8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:20.858205 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-cf158ee6-5588-41ec-94fb-e83bbe48d7d8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.155216 Jul 20 19:35:20.858771 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 610/1219] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:20 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:35:21.394881 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-9ffa1b7f-7ffb-4b4a-9b89-4cb1b868bb33 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:21.395492 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-9ffa1b7f-7ffb-4b4a-9b89-4cb1b868bb33 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:21.401662 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9ffa1b7f-7ffb-4b4a-9b89-4cb1b868bb33 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:21.402111 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9ffa1b7f-7ffb-4b4a-9b89-4cb1b868bb33 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:21.402868 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9ffa1b7f-7ffb-4b4a-9b89-4cb1b868bb33 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:21.403308 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9ffa1b7f-7ffb-4b4a-9b89-4cb1b868bb33 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:21.540317 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-9ffa1b7f-7ffb-4b4a-9b89-4cb1b868bb33 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:21.547889 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-9ffa1b7f-7ffb-4b4a-9b89-4cb1b868bb33 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.157560 Jul 20 19:35:21.548459 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 610/1220] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:21 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:21.624125 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-dfeb0aab-1d8e-4b64-a3d3-2bc6d04da934 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:21.624676 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-dfeb0aab-1d8e-4b64-a3d3-2bc6d04da934 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:21.631425 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-dfeb0aab-1d8e-4b64-a3d3-2bc6d04da934 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:21.631871 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-dfeb0aab-1d8e-4b64-a3d3-2bc6d04da934 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:21.632628 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-dfeb0aab-1d8e-4b64-a3d3-2bc6d04da934 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:21.633075 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-dfeb0aab-1d8e-4b64-a3d3-2bc6d04da934 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:21.697377 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-dfeb0aab-1d8e-4b64-a3d3-2bc6d04da934 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:21.704857 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-dfeb0aab-1d8e-4b64-a3d3-2bc6d04da934 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.084671 Jul 20 19:35:21.705640 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 611/1221] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:21 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:21.876198 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-7a293cc6-034b-493c-b0db-199e88113d7b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:21.876902 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-7a293cc6-034b-493c-b0db-199e88113d7b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:21.882904 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-7a293cc6-034b-493c-b0db-199e88113d7b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:21.883349 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-7a293cc6-034b-493c-b0db-199e88113d7b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:21.884100 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-7a293cc6-034b-493c-b0db-199e88113d7b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:21.884526 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-7a293cc6-034b-493c-b0db-199e88113d7b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:22.013712 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-7a293cc6-034b-493c-b0db-199e88113d7b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:22.022062 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-7a293cc6-034b-493c-b0db-199e88113d7b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:22.023562 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-7a293cc6-034b-493c-b0db-199e88113d7b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:22.024704 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-7a293cc6-034b-493c-b0db-199e88113d7b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.152495 Jul 20 19:35:22.025252 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 611/1222] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:21 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:35:22.565960 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-1d7d21a1-f340-4aa0-83f1-50e26bf544b0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:22.566617 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-1d7d21a1-f340-4aa0-83f1-50e26bf544b0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:22.573034 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1d7d21a1-f340-4aa0-83f1-50e26bf544b0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:22.573525 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1d7d21a1-f340-4aa0-83f1-50e26bf544b0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:22.574295 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1d7d21a1-f340-4aa0-83f1-50e26bf544b0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:22.574726 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1d7d21a1-f340-4aa0-83f1-50e26bf544b0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:22.706800 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1d7d21a1-f340-4aa0-83f1-50e26bf544b0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:22.708981 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:35:22.716054 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-1d7d21a1-f340-4aa0-83f1-50e26bf544b0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.154896 Jul 20 19:35:22.716641 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 612/1223] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:22 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:22.721578 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-02d32096-4548-4c95-adfc-7056541abb6b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:22.722185 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-02d32096-4548-4c95-adfc-7056541abb6b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:22.728826 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-02d32096-4548-4c95-adfc-7056541abb6b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:22.729304 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-02d32096-4548-4c95-adfc-7056541abb6b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:22.730120 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-02d32096-4548-4c95-adfc-7056541abb6b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:22.730587 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-02d32096-4548-4c95-adfc-7056541abb6b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:22.792074 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-02d32096-4548-4c95-adfc-7056541abb6b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:22.800096 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-02d32096-4548-4c95-adfc-7056541abb6b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.082967 Jul 20 19:35:22.800652 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 612/1224] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:22 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:35:23.043305 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-db6628d3-d10c-472a-a704-e45cb5e8f4a8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:23.043936 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-db6628d3-d10c-472a-a704-e45cb5e8f4a8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:23.049935 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-db6628d3-d10c-472a-a704-e45cb5e8f4a8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:23.050374 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-db6628d3-d10c-472a-a704-e45cb5e8f4a8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:23.051125 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-db6628d3-d10c-472a-a704-e45cb5e8f4a8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:23.051585 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-db6628d3-d10c-472a-a704-e45cb5e8f4a8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:23.178789 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-db6628d3-d10c-472a-a704-e45cb5e8f4a8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:23.187505 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-db6628d3-d10c-472a-a704-e45cb5e8f4a8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:23.189054 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-db6628d3-d10c-472a-a704-e45cb5e8f4a8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:23.191029 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-db6628d3-d10c-472a-a704-e45cb5e8f4a8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.151583 Jul 20 19:35:23.191586 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 613/1225] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:23 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:35:23.733474 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-034d1986-8ac0-4d5e-b98f-6e5aab81f23d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:23.734091 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-034d1986-8ac0-4d5e-b98f-6e5aab81f23d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:23.741048 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-034d1986-8ac0-4d5e-b98f-6e5aab81f23d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:23.741492 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-034d1986-8ac0-4d5e-b98f-6e5aab81f23d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:23.742292 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-034d1986-8ac0-4d5e-b98f-6e5aab81f23d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:23.742724 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-034d1986-8ac0-4d5e-b98f-6e5aab81f23d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:23.816412 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-9446f411-020f-4f42-bc22-81d23c02d264 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:23.817048 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-9446f411-020f-4f42-bc22-81d23c02d264 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:23.823590 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9446f411-020f-4f42-bc22-81d23c02d264 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:23.823987 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9446f411-020f-4f42-bc22-81d23c02d264 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:23.824786 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9446f411-020f-4f42-bc22-81d23c02d264 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:23.825227 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9446f411-020f-4f42-bc22-81d23c02d264 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:23.878976 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-034d1986-8ac0-4d5e-b98f-6e5aab81f23d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:23.886920 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-034d1986-8ac0-4d5e-b98f-6e5aab81f23d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.157264 Jul 20 19:35:23.887705 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 613/1226] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:23 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:23.890306 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-9446f411-020f-4f42-bc22-81d23c02d264 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:23.898556 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-9446f411-020f-4f42-bc22-81d23c02d264 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.086195 Jul 20 19:35:23.899120 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 614/1227] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:23 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:35:24.209232 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-301ac467-aef8-475b-ba19-7b24319d8097 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:24.209856 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-301ac467-aef8-475b-ba19-7b24319d8097 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:24.216253 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-301ac467-aef8-475b-ba19-7b24319d8097 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:24.216696 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-301ac467-aef8-475b-ba19-7b24319d8097 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:24.217451 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-301ac467-aef8-475b-ba19-7b24319d8097 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:24.217905 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-301ac467-aef8-475b-ba19-7b24319d8097 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:24.347279 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-301ac467-aef8-475b-ba19-7b24319d8097 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:24.358237 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-301ac467-aef8-475b-ba19-7b24319d8097 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:24.359961 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-301ac467-aef8-475b-ba19-7b24319d8097 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:24.361739 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-301ac467-aef8-475b-ba19-7b24319d8097 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.156991 Jul 20 19:35:24.362296 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 614/1228] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:24 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:35:24.904696 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-10043d2f-76c3-4c7a-993b-d843b6af48ff tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:24.905347 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-10043d2f-76c3-4c7a-993b-d843b6af48ff tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:24.912552 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-10043d2f-76c3-4c7a-993b-d843b6af48ff tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:24.912987 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-10043d2f-76c3-4c7a-993b-d843b6af48ff tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:24.913801 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-10043d2f-76c3-4c7a-993b-d843b6af48ff tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:24.914233 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-10043d2f-76c3-4c7a-993b-d843b6af48ff tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:24.916297 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-c2f857db-f978-4467-b9aa-71906c07e2a8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:24.916910 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-c2f857db-f978-4467-b9aa-71906c07e2a8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:24.923435 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c2f857db-f978-4467-b9aa-71906c07e2a8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:24.923905 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c2f857db-f978-4467-b9aa-71906c07e2a8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:24.924680 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c2f857db-f978-4467-b9aa-71906c07e2a8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:24.925118 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c2f857db-f978-4467-b9aa-71906c07e2a8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:24.986585 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-c2f857db-f978-4467-b9aa-71906c07e2a8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:24.994396 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-c2f857db-f978-4467-b9aa-71906c07e2a8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.082465 Jul 20 19:35:24.994969 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 615/1229] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:24 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:25.046023 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-10043d2f-76c3-4c7a-993b-d843b6af48ff tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:25.052057 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 19:35:25.052408 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Wed Jul 20 19:35:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 (ip 10.222.0.69) !!! Jul 20 19:35:25.054783 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-10043d2f-76c3-4c7a-993b-d843b6af48ff tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.154001 Jul 20 19:35:25.062073 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 615/1230] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:24 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:25.379993 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-decd8cd4-64e7-45db-8aad-055a14995982 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:25.380622 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-decd8cd4-64e7-45db-8aad-055a14995982 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:25.386622 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-decd8cd4-64e7-45db-8aad-055a14995982 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:25.387065 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-decd8cd4-64e7-45db-8aad-055a14995982 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:25.387812 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-decd8cd4-64e7-45db-8aad-055a14995982 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:25.388238 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-decd8cd4-64e7-45db-8aad-055a14995982 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:25.520172 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-decd8cd4-64e7-45db-8aad-055a14995982 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:25.529450 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-decd8cd4-64e7-45db-8aad-055a14995982 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:25.531143 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-decd8cd4-64e7-45db-8aad-055a14995982 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:25.532308 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-decd8cd4-64e7-45db-8aad-055a14995982 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.156877 Jul 20 19:35:25.532867 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 616/1231] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:25 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:35:26.011681 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-61594f13-1092-4f86-9ad6-6cbc06b5be97 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:26.012273 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-61594f13-1092-4f86-9ad6-6cbc06b5be97 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:26.018813 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-61594f13-1092-4f86-9ad6-6cbc06b5be97 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:26.019257 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-61594f13-1092-4f86-9ad6-6cbc06b5be97 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:26.020002 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-61594f13-1092-4f86-9ad6-6cbc06b5be97 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:26.020427 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-61594f13-1092-4f86-9ad6-6cbc06b5be97 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:26.073120 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-08584209-e0b2-4435-82fa-e26d38f04bd0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:26.073776 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-08584209-e0b2-4435-82fa-e26d38f04bd0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:26.080962 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-08584209-e0b2-4435-82fa-e26d38f04bd0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:26.081413 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-08584209-e0b2-4435-82fa-e26d38f04bd0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:26.082206 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-08584209-e0b2-4435-82fa-e26d38f04bd0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:26.082589 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-61594f13-1092-4f86-9ad6-6cbc06b5be97 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:26.082717 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-08584209-e0b2-4435-82fa-e26d38f04bd0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:26.090438 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-61594f13-1092-4f86-9ad6-6cbc06b5be97 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.082615 Jul 20 19:35:26.091095 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 616/1232] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:26 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:26.212203 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-08584209-e0b2-4435-82fa-e26d38f04bd0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:26.219929 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-08584209-e0b2-4435-82fa-e26d38f04bd0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.150653 Jul 20 19:35:26.221152 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 617/1233] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:26 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:35:26.550975 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-9844ce96-9900-4085-94b9-865c7b213d06 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:26.551583 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-9844ce96-9900-4085-94b9-865c7b213d06 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:26.557628 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9844ce96-9900-4085-94b9-865c7b213d06 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:26.558079 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9844ce96-9900-4085-94b9-865c7b213d06 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:26.558846 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9844ce96-9900-4085-94b9-865c7b213d06 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:26.559278 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9844ce96-9900-4085-94b9-865c7b213d06 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:26.688549 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-9844ce96-9900-4085-94b9-865c7b213d06 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:26.696994 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-9844ce96-9900-4085-94b9-865c7b213d06 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:26.698860 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-9844ce96-9900-4085-94b9-865c7b213d06 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:26.699797 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-9844ce96-9900-4085-94b9-865c7b213d06 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.153380 Jul 20 19:35:26.700535 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 617/1234] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:26 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:35:27.107992 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-4fbf9eb0-509d-4428-a7fb-2ad1bbd36a0b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:27.108587 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-4fbf9eb0-509d-4428-a7fb-2ad1bbd36a0b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:27.110930 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_api:SELECT=80 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:35:27.116624 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4fbf9eb0-509d-4428-a7fb-2ad1bbd36a0b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:27.117077 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4fbf9eb0-509d-4428-a7fb-2ad1bbd36a0b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:27.117876 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4fbf9eb0-509d-4428-a7fb-2ad1bbd36a0b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:27.118312 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-4fbf9eb0-509d-4428-a7fb-2ad1bbd36a0b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:27.152986 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 19:35:27.153558 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Wed Jul 20 19:35:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 19:35:27.180893 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-4fbf9eb0-509d-4428-a7fb-2ad1bbd36a0b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:27.188407 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-4fbf9eb0-509d-4428-a7fb-2ad1bbd36a0b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.084294 Jul 20 19:35:27.188961 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 618/1235] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:27 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:27.237079 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4ba91ee6-7874-4b9b-83aa-6618f5e58d9a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:27.237727 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-4ba91ee6-7874-4b9b-83aa-6618f5e58d9a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:27.244105 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4ba91ee6-7874-4b9b-83aa-6618f5e58d9a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:27.244595 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4ba91ee6-7874-4b9b-83aa-6618f5e58d9a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:27.245296 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4ba91ee6-7874-4b9b-83aa-6618f5e58d9a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:27.245745 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4ba91ee6-7874-4b9b-83aa-6618f5e58d9a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:27.380049 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-4ba91ee6-7874-4b9b-83aa-6618f5e58d9a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:27.387503 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-4ba91ee6-7874-4b9b-83aa-6618f5e58d9a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.154197 Jul 20 19:35:27.388085 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 618/1236] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:27 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:27.719095 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-d4c23c71-8ce6-432f-ac5d-f7dc62288010 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:27.719697 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-d4c23c71-8ce6-432f-ac5d-f7dc62288010 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:27.725813 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d4c23c71-8ce6-432f-ac5d-f7dc62288010 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:27.726271 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d4c23c71-8ce6-432f-ac5d-f7dc62288010 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:27.727029 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d4c23c71-8ce6-432f-ac5d-f7dc62288010 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:27.727466 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-d4c23c71-8ce6-432f-ac5d-f7dc62288010 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:27.859188 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-d4c23c71-8ce6-432f-ac5d-f7dc62288010 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:27.868175 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-d4c23c71-8ce6-432f-ac5d-f7dc62288010 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:27.869727 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-d4c23c71-8ce6-432f-ac5d-f7dc62288010 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:27.870882 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-d4c23c71-8ce6-432f-ac5d-f7dc62288010 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.156047 Jul 20 19:35:27.871443 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 619/1237] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:27 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:35:28.206248 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-9ceb942c-8720-4f70-8862-deaf00d6f6c0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:28.206924 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-9ceb942c-8720-4f70-8862-deaf00d6f6c0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:28.212902 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9ceb942c-8720-4f70-8862-deaf00d6f6c0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:28.213351 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9ceb942c-8720-4f70-8862-deaf00d6f6c0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:28.214208 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9ceb942c-8720-4f70-8862-deaf00d6f6c0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:28.214911 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9ceb942c-8720-4f70-8862-deaf00d6f6c0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:28.275114 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-9ceb942c-8720-4f70-8862-deaf00d6f6c0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:28.282670 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-9ceb942c-8720-4f70-8862-deaf00d6f6c0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080894 Jul 20 19:35:28.283951 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 619/1238] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:28 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:28.404698 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-cf52638a-f40c-4062-9484-63c3eeee81c3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:28.405325 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-cf52638a-f40c-4062-9484-63c3eeee81c3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:28.415534 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-cf52638a-f40c-4062-9484-63c3eeee81c3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:28.415977 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-cf52638a-f40c-4062-9484-63c3eeee81c3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:28.416728 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-cf52638a-f40c-4062-9484-63c3eeee81c3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:28.417155 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-cf52638a-f40c-4062-9484-63c3eeee81c3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:28.431765 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG dbcounter [-] [117762] Writing DB stats nova_cell1:SELECT=100 {{(pid=117762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:35:28.547095 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-cf52638a-f40c-4062-9484-63c3eeee81c3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:28.554840 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-cf52638a-f40c-4062-9484-63c3eeee81c3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.153978 Jul 20 19:35:28.555398 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 620/1239] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:28 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:28.888292 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-737805b2-e0bd-4871-9c39-9692f3443227 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:28.888817 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-737805b2-e0bd-4871-9c39-9692f3443227 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:28.895690 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-737805b2-e0bd-4871-9c39-9692f3443227 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:28.896140 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-737805b2-e0bd-4871-9c39-9692f3443227 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:28.896934 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-737805b2-e0bd-4871-9c39-9692f3443227 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:28.897369 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-737805b2-e0bd-4871-9c39-9692f3443227 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:29.027496 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-737805b2-e0bd-4871-9c39-9692f3443227 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:29.035976 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-737805b2-e0bd-4871-9c39-9692f3443227 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:29.037462 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-737805b2-e0bd-4871-9c39-9692f3443227 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:29.038638 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-737805b2-e0bd-4871-9c39-9692f3443227 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.154369 Jul 20 19:35:29.039190 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 620/1240] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:28 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:35:29.300596 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-c97214a8-64b5-4ca8-ae80-0e91b09e1563 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:29.301202 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-c97214a8-64b5-4ca8-ae80-0e91b09e1563 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:29.307311 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c97214a8-64b5-4ca8-ae80-0e91b09e1563 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:29.307760 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c97214a8-64b5-4ca8-ae80-0e91b09e1563 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:29.308531 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c97214a8-64b5-4ca8-ae80-0e91b09e1563 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:29.308966 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c97214a8-64b5-4ca8-ae80-0e91b09e1563 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:29.375137 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-c97214a8-64b5-4ca8-ae80-0e91b09e1563 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:29.382904 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-c97214a8-64b5-4ca8-ae80-0e91b09e1563 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.087293 Jul 20 19:35:29.383465 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 621/1241] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:29 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:29.571781 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d54d62a7-f23e-4b5f-9b4a-8124239ebadd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:29.572314 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d54d62a7-f23e-4b5f-9b4a-8124239ebadd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:29.578878 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d54d62a7-f23e-4b5f-9b4a-8124239ebadd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:29.579321 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d54d62a7-f23e-4b5f-9b4a-8124239ebadd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:29.580209 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d54d62a7-f23e-4b5f-9b4a-8124239ebadd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:29.580811 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d54d62a7-f23e-4b5f-9b4a-8124239ebadd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:29.712429 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d54d62a7-f23e-4b5f-9b4a-8124239ebadd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:29.720153 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d54d62a7-f23e-4b5f-9b4a-8124239ebadd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.152383 Jul 20 19:35:29.721422 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 621/1242] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:29 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:30.057540 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-75a2fca0-e588-4535-a142-8d8389962d6e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:30.057540 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-75a2fca0-e588-4535-a142-8d8389962d6e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:30.064003 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-75a2fca0-e588-4535-a142-8d8389962d6e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:30.064993 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-75a2fca0-e588-4535-a142-8d8389962d6e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:30.065850 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-75a2fca0-e588-4535-a142-8d8389962d6e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:30.066282 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-75a2fca0-e588-4535-a142-8d8389962d6e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:30.194033 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-75a2fca0-e588-4535-a142-8d8389962d6e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:30.202584 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-75a2fca0-e588-4535-a142-8d8389962d6e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:30.204104 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-75a2fca0-e588-4535-a142-8d8389962d6e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:30.205976 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-75a2fca0-e588-4535-a142-8d8389962d6e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.152885 Jul 20 19:35:30.206560 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 622/1243] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:30 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:35:30.399691 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-726f8edf-25ef-4256-947e-69acc900b7aa tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:30.400300 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-726f8edf-25ef-4256-947e-69acc900b7aa tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:30.406318 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-726f8edf-25ef-4256-947e-69acc900b7aa tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:30.406765 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-726f8edf-25ef-4256-947e-69acc900b7aa tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:30.407541 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-726f8edf-25ef-4256-947e-69acc900b7aa tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:30.408524 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-726f8edf-25ef-4256-947e-69acc900b7aa tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:30.469975 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-726f8edf-25ef-4256-947e-69acc900b7aa tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:30.478293 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-726f8edf-25ef-4256-947e-69acc900b7aa tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.082405 Jul 20 19:35:30.478869 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 622/1244] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:30 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:30.738089 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-0c9b6016-3adc-4010-88ab-b3db071a59e6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:30.738527 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-0c9b6016-3adc-4010-88ab-b3db071a59e6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:30.744745 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-0c9b6016-3adc-4010-88ab-b3db071a59e6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:30.745194 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-0c9b6016-3adc-4010-88ab-b3db071a59e6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:30.745992 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-0c9b6016-3adc-4010-88ab-b3db071a59e6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:30.746429 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-0c9b6016-3adc-4010-88ab-b3db071a59e6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:30.880527 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-0c9b6016-3adc-4010-88ab-b3db071a59e6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:30.888060 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-0c9b6016-3adc-4010-88ab-b3db071a59e6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.154150 Jul 20 19:35:30.888619 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 623/1245] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:30 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:31.224984 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-487ad865-9d67-4b2f-b4bc-28b2c8187623 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:31.225586 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-487ad865-9d67-4b2f-b4bc-28b2c8187623 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:31.232197 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-487ad865-9d67-4b2f-b4bc-28b2c8187623 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:31.232642 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-487ad865-9d67-4b2f-b4bc-28b2c8187623 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:31.233400 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-487ad865-9d67-4b2f-b4bc-28b2c8187623 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:31.233862 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-487ad865-9d67-4b2f-b4bc-28b2c8187623 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:31.364696 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-487ad865-9d67-4b2f-b4bc-28b2c8187623 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:31.372942 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-487ad865-9d67-4b2f-b4bc-28b2c8187623 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:31.374449 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-487ad865-9d67-4b2f-b4bc-28b2c8187623 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:31.375594 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-487ad865-9d67-4b2f-b4bc-28b2c8187623 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.155262 Jul 20 19:35:31.376143 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 623/1246] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:31 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:35:31.494158 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-622452c8-2b89-4e49-8e14-6993e2b4af2a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:31.494681 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-622452c8-2b89-4e49-8e14-6993e2b4af2a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:31.501382 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-622452c8-2b89-4e49-8e14-6993e2b4af2a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:31.502516 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-622452c8-2b89-4e49-8e14-6993e2b4af2a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:31.503282 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-622452c8-2b89-4e49-8e14-6993e2b4af2a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:31.503725 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-622452c8-2b89-4e49-8e14-6993e2b4af2a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:31.567963 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-622452c8-2b89-4e49-8e14-6993e2b4af2a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:31.575537 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-622452c8-2b89-4e49-8e14-6993e2b4af2a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.085259 Jul 20 19:35:31.576097 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 624/1247] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:31 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:31.906292 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ef3904dd-7fdf-4063-918b-0e81bc769289 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:31.906935 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ef3904dd-7fdf-4063-918b-0e81bc769289 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:31.913204 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ef3904dd-7fdf-4063-918b-0e81bc769289 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:31.913696 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ef3904dd-7fdf-4063-918b-0e81bc769289 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:31.914461 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ef3904dd-7fdf-4063-918b-0e81bc769289 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:31.914899 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ef3904dd-7fdf-4063-918b-0e81bc769289 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:32.043315 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ef3904dd-7fdf-4063-918b-0e81bc769289 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:32.051561 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ef3904dd-7fdf-4063-918b-0e81bc769289 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.149218 Jul 20 19:35:32.052129 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 624/1248] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:31 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:32.394904 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-54f59bdf-53a6-40d4-a0c0-9dbec0161a62 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:32.395494 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-54f59bdf-53a6-40d4-a0c0-9dbec0161a62 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:32.401534 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-54f59bdf-53a6-40d4-a0c0-9dbec0161a62 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:32.401979 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-54f59bdf-53a6-40d4-a0c0-9dbec0161a62 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:32.402724 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-54f59bdf-53a6-40d4-a0c0-9dbec0161a62 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:32.403148 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-54f59bdf-53a6-40d4-a0c0-9dbec0161a62 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:32.532822 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-54f59bdf-53a6-40d4-a0c0-9dbec0161a62 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:32.543021 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-54f59bdf-53a6-40d4-a0c0-9dbec0161a62 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:32.544521 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-54f59bdf-53a6-40d4-a0c0-9dbec0161a62 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:32.545690 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-54f59bdf-53a6-40d4-a0c0-9dbec0161a62 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.155667 Jul 20 19:35:32.546236 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 625/1249] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:32 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:35:32.592533 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-937ed487-e5cc-4051-bf7c-3e155ec47bd5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:32.593143 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-937ed487-e5cc-4051-bf7c-3e155ec47bd5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:32.599818 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-937ed487-e5cc-4051-bf7c-3e155ec47bd5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:32.600263 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-937ed487-e5cc-4051-bf7c-3e155ec47bd5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:32.601025 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-937ed487-e5cc-4051-bf7c-3e155ec47bd5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:32.601456 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-937ed487-e5cc-4051-bf7c-3e155ec47bd5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:32.663345 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-937ed487-e5cc-4051-bf7c-3e155ec47bd5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:32.670906 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-937ed487-e5cc-4051-bf7c-3e155ec47bd5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.082688 Jul 20 19:35:32.671472 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 625/1250] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:32 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:33.068255 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-ccc77965-175a-4b9a-aabe-a4bf55165c01 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:33.068851 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-ccc77965-175a-4b9a-aabe-a4bf55165c01 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:33.075179 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-ccc77965-175a-4b9a-aabe-a4bf55165c01 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:33.075616 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-ccc77965-175a-4b9a-aabe-a4bf55165c01 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:33.076391 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-ccc77965-175a-4b9a-aabe-a4bf55165c01 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:33.076820 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-ccc77965-175a-4b9a-aabe-a4bf55165c01 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:33.206306 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-ccc77965-175a-4b9a-aabe-a4bf55165c01 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:33.213781 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-ccc77965-175a-4b9a-aabe-a4bf55165c01 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.149959 Jul 20 19:35:33.214367 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 626/1251] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:33 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:33.563828 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-9624792c-943f-443e-9b29-1073f67fcb11 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:33.565079 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-9624792c-943f-443e-9b29-1073f67fcb11 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:33.571377 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9624792c-943f-443e-9b29-1073f67fcb11 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:33.571828 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9624792c-943f-443e-9b29-1073f67fcb11 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:33.572590 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9624792c-943f-443e-9b29-1073f67fcb11 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:33.573025 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9624792c-943f-443e-9b29-1073f67fcb11 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:33.687772 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-9c7ac4ca-58d4-475e-b5c9-59da63553a8a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:33.688464 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-9c7ac4ca-58d4-475e-b5c9-59da63553a8a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:33.695586 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9c7ac4ca-58d4-475e-b5c9-59da63553a8a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:33.696028 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9c7ac4ca-58d4-475e-b5c9-59da63553a8a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:33.696790 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9c7ac4ca-58d4-475e-b5c9-59da63553a8a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:33.697218 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-9c7ac4ca-58d4-475e-b5c9-59da63553a8a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:33.707867 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-9624792c-943f-443e-9b29-1073f67fcb11 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:33.716503 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-9624792c-943f-443e-9b29-1073f67fcb11 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:33.718117 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-9624792c-943f-443e-9b29-1073f67fcb11 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:33.719185 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-9624792c-943f-443e-9b29-1073f67fcb11 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.159288 Jul 20 19:35:33.719744 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 626/1252] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:33 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:35:33.764613 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-9c7ac4ca-58d4-475e-b5c9-59da63553a8a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:33.772466 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-9c7ac4ca-58d4-475e-b5c9-59da63553a8a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.088527 Jul 20 19:35:33.773027 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 627/1253] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:33 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:35:34.230178 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-2919e6b1-e30c-4ca2-b4ca-16328d96650b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:34.230868 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-2919e6b1-e30c-4ca2-b4ca-16328d96650b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:34.236871 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2919e6b1-e30c-4ca2-b4ca-16328d96650b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:34.237315 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2919e6b1-e30c-4ca2-b4ca-16328d96650b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:34.238107 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2919e6b1-e30c-4ca2-b4ca-16328d96650b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:34.238546 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2919e6b1-e30c-4ca2-b4ca-16328d96650b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:34.372008 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-2919e6b1-e30c-4ca2-b4ca-16328d96650b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:34.379720 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-2919e6b1-e30c-4ca2-b4ca-16328d96650b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.153355 Jul 20 19:35:34.380273 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 627/1254] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:34 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:34.737691 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-62319f94-21b3-40e8-868e-c93480bba851 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:34.738290 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-62319f94-21b3-40e8-868e-c93480bba851 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:34.745395 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-62319f94-21b3-40e8-868e-c93480bba851 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:34.745872 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-62319f94-21b3-40e8-868e-c93480bba851 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:34.746626 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-62319f94-21b3-40e8-868e-c93480bba851 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:34.747056 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-62319f94-21b3-40e8-868e-c93480bba851 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:34.789111 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-cfa179e7-62fd-4459-afaa-1a20aa65a4d7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:34.789749 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-cfa179e7-62fd-4459-afaa-1a20aa65a4d7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:34.796160 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cfa179e7-62fd-4459-afaa-1a20aa65a4d7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:34.796607 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cfa179e7-62fd-4459-afaa-1a20aa65a4d7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:34.797370 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cfa179e7-62fd-4459-afaa-1a20aa65a4d7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:34.797823 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cfa179e7-62fd-4459-afaa-1a20aa65a4d7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:34.862456 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-cfa179e7-62fd-4459-afaa-1a20aa65a4d7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:34.869771 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-cfa179e7-62fd-4459-afaa-1a20aa65a4d7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.084379 Jul 20 19:35:34.870341 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 628/1255] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:34 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:35:34.879085 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-62319f94-21b3-40e8-868e-c93480bba851 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:34.887779 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-62319f94-21b3-40e8-868e-c93480bba851 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:34.889283 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-62319f94-21b3-40e8-868e-c93480bba851 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:34.890441 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-62319f94-21b3-40e8-868e-c93480bba851 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.156931 Jul 20 19:35:34.890992 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 628/1256] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:34 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:35:35.396155 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-b9dab141-53c0-4f1b-902c-536b6959088a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:35.396764 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-b9dab141-53c0-4f1b-902c-536b6959088a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:35.402798 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b9dab141-53c0-4f1b-902c-536b6959088a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:35.403248 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b9dab141-53c0-4f1b-902c-536b6959088a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:35.404014 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b9dab141-53c0-4f1b-902c-536b6959088a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:35.404451 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b9dab141-53c0-4f1b-902c-536b6959088a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:35.419520 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:35:35.535323 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-b9dab141-53c0-4f1b-902c-536b6959088a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:35.542842 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-b9dab141-53c0-4f1b-902c-536b6959088a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.150621 Jul 20 19:35:35.543413 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 629/1257] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:35 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:35.887777 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-577aa441-e583-48ce-be82-550db3fa3fef tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:35.888546 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-577aa441-e583-48ce-be82-550db3fa3fef tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:35.895481 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-577aa441-e583-48ce-be82-550db3fa3fef tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:35.895928 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-577aa441-e583-48ce-be82-550db3fa3fef tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:35.896692 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-577aa441-e583-48ce-be82-550db3fa3fef tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:35.897126 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-577aa441-e583-48ce-be82-550db3fa3fef tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:35.909930 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-6e478ca2-db07-4704-be84-a2a9e666db9d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:35.910532 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-6e478ca2-db07-4704-be84-a2a9e666db9d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:35.916928 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6e478ca2-db07-4704-be84-a2a9e666db9d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:35.917370 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6e478ca2-db07-4704-be84-a2a9e666db9d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:35.918164 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6e478ca2-db07-4704-be84-a2a9e666db9d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:35.918589 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6e478ca2-db07-4704-be84-a2a9e666db9d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:35.959192 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-577aa441-e583-48ce-be82-550db3fa3fef tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:35.967084 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-577aa441-e583-48ce-be82-550db3fa3fef tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.083874 Jul 20 19:35:35.967659 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 629/1258] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:35 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:36.047884 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6e478ca2-db07-4704-be84-a2a9e666db9d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:36.057064 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6e478ca2-db07-4704-be84-a2a9e666db9d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:36.058606 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6e478ca2-db07-4704-be84-a2a9e666db9d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:36.059772 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-6e478ca2-db07-4704-be84-a2a9e666db9d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.153859 Jul 20 19:35:36.060323 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 630/1259] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:35 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:35:36.560445 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-c6d48eda-a86e-4bdd-94ea-e2ebbadf1230 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:36.560972 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-c6d48eda-a86e-4bdd-94ea-e2ebbadf1230 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:36.567208 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c6d48eda-a86e-4bdd-94ea-e2ebbadf1230 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:36.567658 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c6d48eda-a86e-4bdd-94ea-e2ebbadf1230 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:36.568418 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c6d48eda-a86e-4bdd-94ea-e2ebbadf1230 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:36.568854 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-c6d48eda-a86e-4bdd-94ea-e2ebbadf1230 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:36.700255 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-c6d48eda-a86e-4bdd-94ea-e2ebbadf1230 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:36.708493 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-c6d48eda-a86e-4bdd-94ea-e2ebbadf1230 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.152196 Jul 20 19:35:36.709055 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 630/1260] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:36 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:36.983523 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-becb6593-7bdf-4b24-8b39-1fa006adda5b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:36.984164 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-becb6593-7bdf-4b24-8b39-1fa006adda5b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:36.990945 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-becb6593-7bdf-4b24-8b39-1fa006adda5b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:36.991390 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-becb6593-7bdf-4b24-8b39-1fa006adda5b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:36.992147 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-becb6593-7bdf-4b24-8b39-1fa006adda5b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:36.992573 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-becb6593-7bdf-4b24-8b39-1fa006adda5b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:37.057382 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-becb6593-7bdf-4b24-8b39-1fa006adda5b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:37.065590 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-becb6593-7bdf-4b24-8b39-1fa006adda5b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.085792 Jul 20 19:35:37.066154 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 631/1261] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:36 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:37.078335 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-1f642e05-158d-4f19-8317-34f525469213 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:37.078934 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.compute.api [None req-1f642e05-158d-4f19-8317-34f525469213 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117762) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:37.086449 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1f642e05-158d-4f19-8317-34f525469213 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:37.086893 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1f642e05-158d-4f19-8317-34f525469213 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:37.087642 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1f642e05-158d-4f19-8317-34f525469213 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:37.088074 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG oslo_concurrency.lockutils [None req-1f642e05-158d-4f19-8317-34f525469213 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:37.219116 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-1f642e05-158d-4f19-8317-34f525469213 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:37.227643 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-1f642e05-158d-4f19-8317-34f525469213 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:37.229156 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.policy [None req-1f642e05-158d-4f19-8317-34f525469213 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117762) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:37.230342 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: INFO nova.api.openstack.requestlog [None req-1f642e05-158d-4f19-8317-34f525469213 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.155937 Jul 20 19:35:37.230903 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: [pid: 117762|app: 0|req: 631/1262] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:37 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:35:37.726364 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-58690c25-9a36-4f4c-9961-e4aa07912ed1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:37.726975 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-58690c25-9a36-4f4c-9961-e4aa07912ed1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:37.732950 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-58690c25-9a36-4f4c-9961-e4aa07912ed1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:37.733403 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-58690c25-9a36-4f4c-9961-e4aa07912ed1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:37.734197 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-58690c25-9a36-4f4c-9961-e4aa07912ed1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:37.734638 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-58690c25-9a36-4f4c-9961-e4aa07912ed1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:37.864565 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-58690c25-9a36-4f4c-9961-e4aa07912ed1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:37.871974 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-58690c25-9a36-4f4c-9961-e4aa07912ed1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.149521 Jul 20 19:35:37.872554 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 632/1263] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:37 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:38.083167 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: DEBUG nova.api.openstack.wsgi [None req-c04a5776-ab8c-4537-b199-8a55570008c2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:38.094174 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: Traceback (most recent call last): Jul 20 19:35:38.094311 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Jul 20 19:35:38.094311 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: timer() Jul 20 19:35:38.094311 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Jul 20 19:35:38.094311 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: cb(*args, **kw) Jul 20 19:35:38.094311 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: File "/usr/local/lib/python3.8/dist-packages/eventlet/semaphore.py", line 147, in _do_acquire Jul 20 19:35:38.094311 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: waiter.switch() Jul 20 19:35:38.094311 dv-cinder-835384-16-iscsi devstack@n-api.service[117762]: greenlet.error: cannot switch to a different thread Jul 20 19:35:38.248770 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-b4dfa5fb-6708-4fb0-961c-11ce9cce0ef8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:38.249370 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-b4dfa5fb-6708-4fb0-961c-11ce9cce0ef8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:38.255958 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b4dfa5fb-6708-4fb0-961c-11ce9cce0ef8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:38.256403 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b4dfa5fb-6708-4fb0-961c-11ce9cce0ef8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:38.257149 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b4dfa5fb-6708-4fb0-961c-11ce9cce0ef8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:38.257600 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b4dfa5fb-6708-4fb0-961c-11ce9cce0ef8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:38.386360 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-b4dfa5fb-6708-4fb0-961c-11ce9cce0ef8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:38.395288 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-b4dfa5fb-6708-4fb0-961c-11ce9cce0ef8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:38.396778 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-b4dfa5fb-6708-4fb0-961c-11ce9cce0ef8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:38.397963 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-b4dfa5fb-6708-4fb0-961c-11ce9cce0ef8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.153071 Jul 20 19:35:38.398515 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 633/1264] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:38 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:35:38.889192 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-96babe7a-2792-4c42-92e8-2c82c2e2148e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:38.889830 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-96babe7a-2792-4c42-92e8-2c82c2e2148e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:38.896147 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-96babe7a-2792-4c42-92e8-2c82c2e2148e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:38.896548 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-96babe7a-2792-4c42-92e8-2c82c2e2148e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:38.897309 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-96babe7a-2792-4c42-92e8-2c82c2e2148e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:38.897765 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-96babe7a-2792-4c42-92e8-2c82c2e2148e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:39.030916 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-96babe7a-2792-4c42-92e8-2c82c2e2148e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:39.038492 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-96babe7a-2792-4c42-92e8-2c82c2e2148e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.153181 Jul 20 19:35:39.039053 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 634/1265] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:38 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:35:39.416272 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-eca845be-2f7f-4c0e-b7de-58b40d921936 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:39.416899 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-eca845be-2f7f-4c0e-b7de-58b40d921936 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:39.423231 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-eca845be-2f7f-4c0e-b7de-58b40d921936 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:39.424599 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-eca845be-2f7f-4c0e-b7de-58b40d921936 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:39.425354 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-eca845be-2f7f-4c0e-b7de-58b40d921936 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:39.425803 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-eca845be-2f7f-4c0e-b7de-58b40d921936 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:39.552535 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-eca845be-2f7f-4c0e-b7de-58b40d921936 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:39.560949 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-eca845be-2f7f-4c0e-b7de-58b40d921936 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:39.562492 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-eca845be-2f7f-4c0e-b7de-58b40d921936 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:39.563649 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-eca845be-2f7f-4c0e-b7de-58b40d921936 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.151313 Jul 20 19:35:39.564296 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 635/1266] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:39 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:35:40.055597 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d4368f5b-fdd0-476a-9daa-86e8c4d0f274 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:40.056205 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d4368f5b-fdd0-476a-9daa-86e8c4d0f274 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:40.062315 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d4368f5b-fdd0-476a-9daa-86e8c4d0f274 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:40.062765 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d4368f5b-fdd0-476a-9daa-86e8c4d0f274 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:40.063529 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d4368f5b-fdd0-476a-9daa-86e8c4d0f274 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:40.063991 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d4368f5b-fdd0-476a-9daa-86e8c4d0f274 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:40.197344 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d4368f5b-fdd0-476a-9daa-86e8c4d0f274 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:40.205387 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d4368f5b-fdd0-476a-9daa-86e8c4d0f274 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.153124 Jul 20 19:35:40.205990 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 636/1267] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:40 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:35:40.582051 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-81aa80e8-51a3-4b75-a44e-694efc55bece tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:40.582723 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-81aa80e8-51a3-4b75-a44e-694efc55bece tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:40.589083 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-81aa80e8-51a3-4b75-a44e-694efc55bece tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:40.589554 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-81aa80e8-51a3-4b75-a44e-694efc55bece tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:40.590576 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-81aa80e8-51a3-4b75-a44e-694efc55bece tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:40.591006 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-81aa80e8-51a3-4b75-a44e-694efc55bece tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:40.717923 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-81aa80e8-51a3-4b75-a44e-694efc55bece tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:40.727444 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-81aa80e8-51a3-4b75-a44e-694efc55bece tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:40.728942 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-81aa80e8-51a3-4b75-a44e-694efc55bece tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:40.730302 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-81aa80e8-51a3-4b75-a44e-694efc55bece tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.152462 Jul 20 19:35:40.730865 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 637/1268] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:40 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:35:41.223350 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-32e597a0-e71a-48b8-980d-1e4fd79b7af9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:41.223954 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-32e597a0-e71a-48b8-980d-1e4fd79b7af9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:41.229955 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-32e597a0-e71a-48b8-980d-1e4fd79b7af9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:41.230403 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-32e597a0-e71a-48b8-980d-1e4fd79b7af9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:41.231164 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-32e597a0-e71a-48b8-980d-1e4fd79b7af9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:41.231594 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-32e597a0-e71a-48b8-980d-1e4fd79b7af9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:41.362658 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-32e597a0-e71a-48b8-980d-1e4fd79b7af9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:41.370102 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-32e597a0-e71a-48b8-980d-1e4fd79b7af9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.151635 Jul 20 19:35:41.370679 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 638/1269] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:41 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:35:41.749100 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e2d4d96e-be6a-4552-a5ac-bcf2353255e8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:41.749844 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e2d4d96e-be6a-4552-a5ac-bcf2353255e8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:41.756980 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e2d4d96e-be6a-4552-a5ac-bcf2353255e8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:41.757429 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e2d4d96e-be6a-4552-a5ac-bcf2353255e8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:41.758224 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e2d4d96e-be6a-4552-a5ac-bcf2353255e8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:41.758657 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e2d4d96e-be6a-4552-a5ac-bcf2353255e8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:41.889105 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e2d4d96e-be6a-4552-a5ac-bcf2353255e8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:41.897463 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e2d4d96e-be6a-4552-a5ac-bcf2353255e8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:41.899055 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e2d4d96e-be6a-4552-a5ac-bcf2353255e8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:41.900217 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e2d4d96e-be6a-4552-a5ac-bcf2353255e8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.155057 Jul 20 19:35:41.900784 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 639/1270] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:41 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:35:42.387994 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-6e0062a5-eaac-41c8-8911-7368cc507118 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:42.388605 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-6e0062a5-eaac-41c8-8911-7368cc507118 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:42.394864 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6e0062a5-eaac-41c8-8911-7368cc507118 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:42.395312 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6e0062a5-eaac-41c8-8911-7368cc507118 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:42.396072 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6e0062a5-eaac-41c8-8911-7368cc507118 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:42.396505 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6e0062a5-eaac-41c8-8911-7368cc507118 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:42.529552 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6e0062a5-eaac-41c8-8911-7368cc507118 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:42.537853 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-6e0062a5-eaac-41c8-8911-7368cc507118 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.153825 Jul 20 19:35:42.538427 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 640/1271] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:42 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:35:42.919603 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a3e762bf-30c0-4fbd-a80f-649faea06e8e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:42.920458 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a3e762bf-30c0-4fbd-a80f-649faea06e8e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:42.926749 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a3e762bf-30c0-4fbd-a80f-649faea06e8e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:42.927201 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a3e762bf-30c0-4fbd-a80f-649faea06e8e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:42.927976 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a3e762bf-30c0-4fbd-a80f-649faea06e8e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:42.928406 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a3e762bf-30c0-4fbd-a80f-649faea06e8e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:43.064790 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a3e762bf-30c0-4fbd-a80f-649faea06e8e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:43.073176 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a3e762bf-30c0-4fbd-a80f-649faea06e8e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:43.074697 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a3e762bf-30c0-4fbd-a80f-649faea06e8e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:43.075882 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a3e762bf-30c0-4fbd-a80f-649faea06e8e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.161261 Jul 20 19:35:43.076438 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 641/1272] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:42 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:35:43.555335 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-8214bb56-3c67-47d4-b7bd-44362a6c83f7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:43.555939 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-8214bb56-3c67-47d4-b7bd-44362a6c83f7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:43.561900 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8214bb56-3c67-47d4-b7bd-44362a6c83f7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:43.562344 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8214bb56-3c67-47d4-b7bd-44362a6c83f7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:43.563100 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8214bb56-3c67-47d4-b7bd-44362a6c83f7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:43.563531 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8214bb56-3c67-47d4-b7bd-44362a6c83f7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:43.692090 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8214bb56-3c67-47d4-b7bd-44362a6c83f7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:43.699772 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-8214bb56-3c67-47d4-b7bd-44362a6c83f7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.148224 Jul 20 19:35:43.700366 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 642/1273] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:43 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:35:44.095948 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-b7addb52-7d6a-4af6-831a-1dfe0e626e33 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:44.096781 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-b7addb52-7d6a-4af6-831a-1dfe0e626e33 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:44.103065 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b7addb52-7d6a-4af6-831a-1dfe0e626e33 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:44.103515 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b7addb52-7d6a-4af6-831a-1dfe0e626e33 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:44.104284 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b7addb52-7d6a-4af6-831a-1dfe0e626e33 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:44.104722 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b7addb52-7d6a-4af6-831a-1dfe0e626e33 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:44.242859 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-b7addb52-7d6a-4af6-831a-1dfe0e626e33 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:44.251087 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-b7addb52-7d6a-4af6-831a-1dfe0e626e33 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:44.252881 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-b7addb52-7d6a-4af6-831a-1dfe0e626e33 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:44.254056 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-b7addb52-7d6a-4af6-831a-1dfe0e626e33 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.162805 Jul 20 19:35:44.254613 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 643/1274] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:44 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:35:44.716822 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-73e010be-0d18-4d4d-91d5-b7c367d3fcbc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:44.717464 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-73e010be-0d18-4d4d-91d5-b7c367d3fcbc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:44.724183 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-73e010be-0d18-4d4d-91d5-b7c367d3fcbc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:44.724631 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-73e010be-0d18-4d4d-91d5-b7c367d3fcbc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:44.725395 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-73e010be-0d18-4d4d-91d5-b7c367d3fcbc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:44.725853 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-73e010be-0d18-4d4d-91d5-b7c367d3fcbc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:44.855406 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-73e010be-0d18-4d4d-91d5-b7c367d3fcbc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:44.862947 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-73e010be-0d18-4d4d-91d5-b7c367d3fcbc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.150371 Jul 20 19:35:44.863505 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 644/1275] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:44 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:35:45.272114 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c9561a38-80cc-4933-9bb9-ef4b202b61b4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:45.272759 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c9561a38-80cc-4933-9bb9-ef4b202b61b4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:45.275040 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_api:SELECT=86 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:35:45.280261 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c9561a38-80cc-4933-9bb9-ef4b202b61b4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:45.280701 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c9561a38-80cc-4933-9bb9-ef4b202b61b4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:45.281455 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c9561a38-80cc-4933-9bb9-ef4b202b61b4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:45.281903 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c9561a38-80cc-4933-9bb9-ef4b202b61b4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:45.738108 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c9561a38-80cc-4933-9bb9-ef4b202b61b4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:45.746861 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c9561a38-80cc-4933-9bb9-ef4b202b61b4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:45.748342 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c9561a38-80cc-4933-9bb9-ef4b202b61b4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:45.749547 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c9561a38-80cc-4933-9bb9-ef4b202b61b4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.481366 Jul 20 19:35:45.750101 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 645/1276] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:45 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:35:45.880725 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-aef48764-7de3-40a9-9fbe-0c3dc47e65e5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:45.881252 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-aef48764-7de3-40a9-9fbe-0c3dc47e65e5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:45.887403 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aef48764-7de3-40a9-9fbe-0c3dc47e65e5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:45.887855 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aef48764-7de3-40a9-9fbe-0c3dc47e65e5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:45.888661 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aef48764-7de3-40a9-9fbe-0c3dc47e65e5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:45.889101 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aef48764-7de3-40a9-9fbe-0c3dc47e65e5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:45.891851 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:35:46.047792 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-aef48764-7de3-40a9-9fbe-0c3dc47e65e5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:46.056161 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-aef48764-7de3-40a9-9fbe-0c3dc47e65e5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.179937 Jul 20 19:35:46.057014 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 646/1277] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:45 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:35:46.772505 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-fb51e3e8-0afb-4237-a9b5-c83a02014174 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:46.773177 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-fb51e3e8-0afb-4237-a9b5-c83a02014174 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:46.779609 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fb51e3e8-0afb-4237-a9b5-c83a02014174 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:46.780055 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fb51e3e8-0afb-4237-a9b5-c83a02014174 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:46.780818 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fb51e3e8-0afb-4237-a9b5-c83a02014174 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:46.781255 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fb51e3e8-0afb-4237-a9b5-c83a02014174 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:46.909176 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-fb51e3e8-0afb-4237-a9b5-c83a02014174 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:46.917529 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-fb51e3e8-0afb-4237-a9b5-c83a02014174 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:46.919022 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-fb51e3e8-0afb-4237-a9b5-c83a02014174 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:46.920172 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-fb51e3e8-0afb-4237-a9b5-c83a02014174 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.151637 Jul 20 19:35:46.920732 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 647/1278] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:46 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:35:47.074162 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-37882c49-27b8-4157-a24e-f72f108ee604 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:47.074680 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-37882c49-27b8-4157-a24e-f72f108ee604 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:47.081056 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-37882c49-27b8-4157-a24e-f72f108ee604 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:47.081499 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-37882c49-27b8-4157-a24e-f72f108ee604 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:47.082296 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-37882c49-27b8-4157-a24e-f72f108ee604 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:47.082755 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-37882c49-27b8-4157-a24e-f72f108ee604 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:47.219604 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-37882c49-27b8-4157-a24e-f72f108ee604 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:47.227790 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-37882c49-27b8-4157-a24e-f72f108ee604 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.157579 Jul 20 19:35:47.228349 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 648/1279] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:47 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:35:47.939620 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-83438d63-b9d3-48c4-8815-3db94ad59997 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:47.940353 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-83438d63-b9d3-48c4-8815-3db94ad59997 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:47.946978 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-83438d63-b9d3-48c4-8815-3db94ad59997 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:47.947533 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-83438d63-b9d3-48c4-8815-3db94ad59997 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:47.948309 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-83438d63-b9d3-48c4-8815-3db94ad59997 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:47.948742 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-83438d63-b9d3-48c4-8815-3db94ad59997 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:48.075802 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-83438d63-b9d3-48c4-8815-3db94ad59997 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:48.084826 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-83438d63-b9d3-48c4-8815-3db94ad59997 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:48.086409 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-83438d63-b9d3-48c4-8815-3db94ad59997 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:48.087561 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-83438d63-b9d3-48c4-8815-3db94ad59997 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.152381 Jul 20 19:35:48.088117 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 649/1280] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:47 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:35:48.245247 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-6255a060-eaaa-48be-a08b-bdc7e9ef0cdd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:48.245887 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-6255a060-eaaa-48be-a08b-bdc7e9ef0cdd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:48.252632 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6255a060-eaaa-48be-a08b-bdc7e9ef0cdd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:48.253080 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6255a060-eaaa-48be-a08b-bdc7e9ef0cdd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:48.253877 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6255a060-eaaa-48be-a08b-bdc7e9ef0cdd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:48.254312 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6255a060-eaaa-48be-a08b-bdc7e9ef0cdd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:48.386000 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6255a060-eaaa-48be-a08b-bdc7e9ef0cdd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:48.394139 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-6255a060-eaaa-48be-a08b-bdc7e9ef0cdd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.152751 Jul 20 19:35:48.394706 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 650/1281] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:48 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:35:49.105917 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c412af2b-a4f4-4251-bd8c-0a7344b28560 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:49.106613 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c412af2b-a4f4-4251-bd8c-0a7344b28560 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:49.113301 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c412af2b-a4f4-4251-bd8c-0a7344b28560 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:49.113785 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c412af2b-a4f4-4251-bd8c-0a7344b28560 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:49.114559 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c412af2b-a4f4-4251-bd8c-0a7344b28560 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:49.115034 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c412af2b-a4f4-4251-bd8c-0a7344b28560 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:49.243110 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c412af2b-a4f4-4251-bd8c-0a7344b28560 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:49.252001 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c412af2b-a4f4-4251-bd8c-0a7344b28560 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:49.254303 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c412af2b-a4f4-4251-bd8c-0a7344b28560 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:49.255458 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c412af2b-a4f4-4251-bd8c-0a7344b28560 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.153421 Jul 20 19:35:49.256017 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 651/1282] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:49 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:35:49.411206 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-102b8704-6fec-490d-b12d-b86123bd0c81 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:49.411812 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-102b8704-6fec-490d-b12d-b86123bd0c81 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:49.418803 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-102b8704-6fec-490d-b12d-b86123bd0c81 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:49.419259 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-102b8704-6fec-490d-b12d-b86123bd0c81 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:49.420240 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-102b8704-6fec-490d-b12d-b86123bd0c81 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:49.421305 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-102b8704-6fec-490d-b12d-b86123bd0c81 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:49.557032 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-102b8704-6fec-490d-b12d-b86123bd0c81 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:49.564409 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-102b8704-6fec-490d-b12d-b86123bd0c81 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.157488 Jul 20 19:35:49.564984 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 652/1283] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:49 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:35:50.274289 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c2857755-24c8-4ba4-b3f5-5d62b64c7ca1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:50.275076 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c2857755-24c8-4ba4-b3f5-5d62b64c7ca1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:50.281359 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c2857755-24c8-4ba4-b3f5-5d62b64c7ca1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:50.282187 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c2857755-24c8-4ba4-b3f5-5d62b64c7ca1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:50.282817 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c2857755-24c8-4ba4-b3f5-5d62b64c7ca1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:50.283051 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c2857755-24c8-4ba4-b3f5-5d62b64c7ca1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:50.413745 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c2857755-24c8-4ba4-b3f5-5d62b64c7ca1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:50.422042 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c2857755-24c8-4ba4-b3f5-5d62b64c7ca1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:50.423563 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c2857755-24c8-4ba4-b3f5-5d62b64c7ca1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:50.424726 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c2857755-24c8-4ba4-b3f5-5d62b64c7ca1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.154369 Jul 20 19:35:50.425435 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 653/1284] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:50 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:35:50.582272 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-2c69dbef-cd92-4769-b1ae-07afffb04913 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:50.582801 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-2c69dbef-cd92-4769-b1ae-07afffb04913 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:50.588909 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2c69dbef-cd92-4769-b1ae-07afffb04913 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:50.589356 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2c69dbef-cd92-4769-b1ae-07afffb04913 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:50.590409 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2c69dbef-cd92-4769-b1ae-07afffb04913 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:50.590847 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2c69dbef-cd92-4769-b1ae-07afffb04913 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:50.718653 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-2c69dbef-cd92-4769-b1ae-07afffb04913 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:50.726732 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-2c69dbef-cd92-4769-b1ae-07afffb04913 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.148601 Jul 20 19:35:50.727295 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 654/1285] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:50 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:35:51.443479 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-9dd0be28-403b-4c66-b751-b400dbee5bec tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:51.444756 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-9dd0be28-403b-4c66-b751-b400dbee5bec tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:51.451452 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9dd0be28-403b-4c66-b751-b400dbee5bec tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:51.451906 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9dd0be28-403b-4c66-b751-b400dbee5bec tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:51.452672 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9dd0be28-403b-4c66-b751-b400dbee5bec tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:51.453107 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9dd0be28-403b-4c66-b751-b400dbee5bec tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:51.583956 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-9dd0be28-403b-4c66-b751-b400dbee5bec tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:51.592467 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-9dd0be28-403b-4c66-b751-b400dbee5bec tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:51.593975 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-9dd0be28-403b-4c66-b751-b400dbee5bec tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:51.595116 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-9dd0be28-403b-4c66-b751-b400dbee5bec tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.155584 Jul 20 19:35:51.595672 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 655/1286] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:51 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:35:51.743924 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ce92711b-eeec-4085-ae32-1d9712e1a061 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:51.744521 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ce92711b-eeec-4085-ae32-1d9712e1a061 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:51.750457 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ce92711b-eeec-4085-ae32-1d9712e1a061 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:51.750900 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ce92711b-eeec-4085-ae32-1d9712e1a061 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:51.751653 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ce92711b-eeec-4085-ae32-1d9712e1a061 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:51.752080 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ce92711b-eeec-4085-ae32-1d9712e1a061 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:51.886068 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ce92711b-eeec-4085-ae32-1d9712e1a061 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:51.893442 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ce92711b-eeec-4085-ae32-1d9712e1a061 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.153294 Jul 20 19:35:51.894272 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 656/1287] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:51 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:35:52.613929 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-882d6bcc-6547-41d9-baf7-e318aa51b4bd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:52.614573 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-882d6bcc-6547-41d9-baf7-e318aa51b4bd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:52.620925 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-882d6bcc-6547-41d9-baf7-e318aa51b4bd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:52.621370 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-882d6bcc-6547-41d9-baf7-e318aa51b4bd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:52.622195 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-882d6bcc-6547-41d9-baf7-e318aa51b4bd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:52.622619 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-882d6bcc-6547-41d9-baf7-e318aa51b4bd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:52.755492 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-882d6bcc-6547-41d9-baf7-e318aa51b4bd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:52.763947 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-882d6bcc-6547-41d9-baf7-e318aa51b4bd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:52.765465 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-882d6bcc-6547-41d9-baf7-e318aa51b4bd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:52.766677 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-882d6bcc-6547-41d9-baf7-e318aa51b4bd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.157371 Jul 20 19:35:52.767238 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 657/1288] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:52 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:35:52.910816 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-5dc49c1c-32f7-460f-b4de-aeb1dba51fe8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:52.911437 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-5dc49c1c-32f7-460f-b4de-aeb1dba51fe8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:52.917528 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5dc49c1c-32f7-460f-b4de-aeb1dba51fe8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:52.917988 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5dc49c1c-32f7-460f-b4de-aeb1dba51fe8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:52.918771 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5dc49c1c-32f7-460f-b4de-aeb1dba51fe8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:52.919213 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5dc49c1c-32f7-460f-b4de-aeb1dba51fe8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:53.051798 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-5dc49c1c-32f7-460f-b4de-aeb1dba51fe8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:53.059302 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-5dc49c1c-32f7-460f-b4de-aeb1dba51fe8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.152592 Jul 20 19:35:53.059869 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 658/1289] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:52 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:35:53.786502 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-92f123f0-1a31-4d68-b543-1f1c7d1786fd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:53.787195 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-92f123f0-1a31-4d68-b543-1f1c7d1786fd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:53.793586 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-92f123f0-1a31-4d68-b543-1f1c7d1786fd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:53.794036 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-92f123f0-1a31-4d68-b543-1f1c7d1786fd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:53.794792 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-92f123f0-1a31-4d68-b543-1f1c7d1786fd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:53.795224 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-92f123f0-1a31-4d68-b543-1f1c7d1786fd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:53.923212 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-92f123f0-1a31-4d68-b543-1f1c7d1786fd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:53.932384 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-92f123f0-1a31-4d68-b543-1f1c7d1786fd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:53.933933 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-92f123f0-1a31-4d68-b543-1f1c7d1786fd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:53.935102 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-92f123f0-1a31-4d68-b543-1f1c7d1786fd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.153280 Jul 20 19:35:53.935657 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 659/1290] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:53 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:35:54.076698 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-789c388b-a478-4c52-b489-0ccd5165af0b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:54.077219 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-789c388b-a478-4c52-b489-0ccd5165af0b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:54.083467 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-789c388b-a478-4c52-b489-0ccd5165af0b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:54.083904 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-789c388b-a478-4c52-b489-0ccd5165af0b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:54.084653 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-789c388b-a478-4c52-b489-0ccd5165af0b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:54.085079 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-789c388b-a478-4c52-b489-0ccd5165af0b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:54.219230 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-789c388b-a478-4c52-b489-0ccd5165af0b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:54.226761 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-789c388b-a478-4c52-b489-0ccd5165af0b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.153967 Jul 20 19:35:54.227347 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 660/1291] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:54 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:35:54.952932 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-369400fa-e0e3-4c29-96cd-9102a81fba46 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:54.953655 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-369400fa-e0e3-4c29-96cd-9102a81fba46 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:54.960546 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-369400fa-e0e3-4c29-96cd-9102a81fba46 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:54.961002 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-369400fa-e0e3-4c29-96cd-9102a81fba46 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:54.961795 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-369400fa-e0e3-4c29-96cd-9102a81fba46 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:54.962232 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-369400fa-e0e3-4c29-96cd-9102a81fba46 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:55.090837 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-369400fa-e0e3-4c29-96cd-9102a81fba46 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:55.099837 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-369400fa-e0e3-4c29-96cd-9102a81fba46 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:55.101326 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-369400fa-e0e3-4c29-96cd-9102a81fba46 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:55.102507 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-369400fa-e0e3-4c29-96cd-9102a81fba46 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.153511 Jul 20 19:35:55.103065 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 661/1292] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:54 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:35:55.243742 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-0974b143-5910-4fbc-96f8-ecb0ce295cac tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:55.244531 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-0974b143-5910-4fbc-96f8-ecb0ce295cac tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:55.250475 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0974b143-5910-4fbc-96f8-ecb0ce295cac tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:55.250921 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0974b143-5910-4fbc-96f8-ecb0ce295cac tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:55.251663 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0974b143-5910-4fbc-96f8-ecb0ce295cac tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:55.252087 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0974b143-5910-4fbc-96f8-ecb0ce295cac tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:55.386756 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0974b143-5910-4fbc-96f8-ecb0ce295cac tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:55.388917 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:35:55.395368 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-0974b143-5910-4fbc-96f8-ecb0ce295cac tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.155442 Jul 20 19:35:55.395934 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 662/1293] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:55 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:35:56.120720 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e43a61f6-eff6-47ad-8f1a-0bb5d7586ece tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:56.121366 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e43a61f6-eff6-47ad-8f1a-0bb5d7586ece tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:56.128446 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e43a61f6-eff6-47ad-8f1a-0bb5d7586ece tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:56.128898 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e43a61f6-eff6-47ad-8f1a-0bb5d7586ece tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:56.129799 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e43a61f6-eff6-47ad-8f1a-0bb5d7586ece tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:56.130241 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e43a61f6-eff6-47ad-8f1a-0bb5d7586ece tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:56.258343 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e43a61f6-eff6-47ad-8f1a-0bb5d7586ece tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:56.266611 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e43a61f6-eff6-47ad-8f1a-0bb5d7586ece tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:56.268106 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e43a61f6-eff6-47ad-8f1a-0bb5d7586ece tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:56.269952 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e43a61f6-eff6-47ad-8f1a-0bb5d7586ece tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.153202 Jul 20 19:35:56.270532 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 663/1294] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:56 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:35:56.412953 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a470ac66-6f4b-4481-9c7a-3fde27477dc5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:56.413589 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a470ac66-6f4b-4481-9c7a-3fde27477dc5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:56.419628 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a470ac66-6f4b-4481-9c7a-3fde27477dc5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:56.420070 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a470ac66-6f4b-4481-9c7a-3fde27477dc5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:56.420824 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a470ac66-6f4b-4481-9c7a-3fde27477dc5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:56.421253 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a470ac66-6f4b-4481-9c7a-3fde27477dc5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:56.557185 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a470ac66-6f4b-4481-9c7a-3fde27477dc5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:56.564619 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a470ac66-6f4b-4481-9c7a-3fde27477dc5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.156284 Jul 20 19:35:56.565180 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 664/1295] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:56 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:35:57.287948 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-456046a4-bce0-4e48-b70f-95ddae90ed1b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:57.288624 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-456046a4-bce0-4e48-b70f-95ddae90ed1b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:57.295102 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-456046a4-bce0-4e48-b70f-95ddae90ed1b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:57.295556 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-456046a4-bce0-4e48-b70f-95ddae90ed1b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:57.296319 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-456046a4-bce0-4e48-b70f-95ddae90ed1b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:57.296756 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-456046a4-bce0-4e48-b70f-95ddae90ed1b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:57.428658 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-456046a4-bce0-4e48-b70f-95ddae90ed1b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:57.436910 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-456046a4-bce0-4e48-b70f-95ddae90ed1b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:57.438427 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-456046a4-bce0-4e48-b70f-95ddae90ed1b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:57.439574 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-456046a4-bce0-4e48-b70f-95ddae90ed1b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.155951 Jul 20 19:35:57.440122 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 665/1296] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:57 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:35:57.581911 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-29ea23c0-712d-4987-9119-c91069c44a5d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:57.582451 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-29ea23c0-712d-4987-9119-c91069c44a5d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:57.588405 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-29ea23c0-712d-4987-9119-c91069c44a5d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:57.588855 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-29ea23c0-712d-4987-9119-c91069c44a5d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:57.589725 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-29ea23c0-712d-4987-9119-c91069c44a5d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:57.590164 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-29ea23c0-712d-4987-9119-c91069c44a5d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:57.718524 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-29ea23c0-712d-4987-9119-c91069c44a5d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:57.726399 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-29ea23c0-712d-4987-9119-c91069c44a5d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.148613 Jul 20 19:35:57.726955 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 666/1297] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:57 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:35:58.459067 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-30c25eef-97f7-4109-8da0-334b9714e9a0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:58.459672 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-30c25eef-97f7-4109-8da0-334b9714e9a0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:58.466411 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-30c25eef-97f7-4109-8da0-334b9714e9a0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:58.466862 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-30c25eef-97f7-4109-8da0-334b9714e9a0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:58.467629 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-30c25eef-97f7-4109-8da0-334b9714e9a0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:58.468062 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-30c25eef-97f7-4109-8da0-334b9714e9a0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:58.599208 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-30c25eef-97f7-4109-8da0-334b9714e9a0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:58.607551 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-30c25eef-97f7-4109-8da0-334b9714e9a0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:58.609081 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-30c25eef-97f7-4109-8da0-334b9714e9a0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:58.610258 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-30c25eef-97f7-4109-8da0-334b9714e9a0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.155898 Jul 20 19:35:58.610816 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 667/1298] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:58 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:35:58.744041 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-718f455f-8f47-4e36-b9e2-11ab31eb5636 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:58.744597 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-718f455f-8f47-4e36-b9e2-11ab31eb5636 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:58.750561 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-718f455f-8f47-4e36-b9e2-11ab31eb5636 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:58.751004 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-718f455f-8f47-4e36-b9e2-11ab31eb5636 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:58.751752 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-718f455f-8f47-4e36-b9e2-11ab31eb5636 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:58.752180 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-718f455f-8f47-4e36-b9e2-11ab31eb5636 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:58.881152 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-718f455f-8f47-4e36-b9e2-11ab31eb5636 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:58.888696 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-718f455f-8f47-4e36-b9e2-11ab31eb5636 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.148662 Jul 20 19:35:58.889255 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 668/1299] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:58 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:35:59.628772 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-3f867a9c-018f-4e80-8d3b-ef5272ce3abb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:59.629397 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-3f867a9c-018f-4e80-8d3b-ef5272ce3abb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:59.635865 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3f867a9c-018f-4e80-8d3b-ef5272ce3abb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:59.636323 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3f867a9c-018f-4e80-8d3b-ef5272ce3abb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:59.637091 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3f867a9c-018f-4e80-8d3b-ef5272ce3abb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:59.637541 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3f867a9c-018f-4e80-8d3b-ef5272ce3abb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:59.771210 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3f867a9c-018f-4e80-8d3b-ef5272ce3abb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:59.779562 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3f867a9c-018f-4e80-8d3b-ef5272ce3abb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:59.781108 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3f867a9c-018f-4e80-8d3b-ef5272ce3abb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:59.782299 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-3f867a9c-018f-4e80-8d3b-ef5272ce3abb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.157541 Jul 20 19:35:59.782874 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 669/1300] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:59 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:35:59.905889 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-b75749f6-87bf-479e-a4d7-a846b4a60e51 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:59.906501 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-b75749f6-87bf-479e-a4d7-a846b4a60e51 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:59.913209 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b75749f6-87bf-479e-a4d7-a846b4a60e51 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:59.913687 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b75749f6-87bf-479e-a4d7-a846b4a60e51 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:59.914456 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b75749f6-87bf-479e-a4d7-a846b4a60e51 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:59.914895 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b75749f6-87bf-479e-a4d7-a846b4a60e51 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:00.045196 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-b75749f6-87bf-479e-a4d7-a846b4a60e51 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:00.053284 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-b75749f6-87bf-479e-a4d7-a846b4a60e51 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.151237 Jul 20 19:36:00.053877 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 670/1301] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:59 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:36:00.801010 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-cd9e2464-c573-4ba7-a304-57e958c5dab4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:00.801649 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-cd9e2464-c573-4ba7-a304-57e958c5dab4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:00.808171 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cd9e2464-c573-4ba7-a304-57e958c5dab4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:00.808622 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cd9e2464-c573-4ba7-a304-57e958c5dab4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:00.809384 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cd9e2464-c573-4ba7-a304-57e958c5dab4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:00.809847 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cd9e2464-c573-4ba7-a304-57e958c5dab4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:00.939055 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-cd9e2464-c573-4ba7-a304-57e958c5dab4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:00.948008 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-cd9e2464-c573-4ba7-a304-57e958c5dab4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:00.949536 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-cd9e2464-c573-4ba7-a304-57e958c5dab4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:00.950733 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-cd9e2464-c573-4ba7-a304-57e958c5dab4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 200 len: 1745 microversion: 2.20 time: 0.154330 Jul 20 19:36:00.951297 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 671/1302] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 19:36:00 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:36:01.072230 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-794a3c29-170a-4a95-9380-0b3685e44ba9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:01.072835 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-794a3c29-170a-4a95-9380-0b3685e44ba9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:01.078872 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-794a3c29-170a-4a95-9380-0b3685e44ba9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:01.079318 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-794a3c29-170a-4a95-9380-0b3685e44ba9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:01.080075 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-794a3c29-170a-4a95-9380-0b3685e44ba9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:01.080505 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-794a3c29-170a-4a95-9380-0b3685e44ba9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:01.217238 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-794a3c29-170a-4a95-9380-0b3685e44ba9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:01.225118 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-794a3c29-170a-4a95-9380-0b3685e44ba9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.157735 Jul 20 19:36:01.226801 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 672/1303] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:01 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:36:02.243226 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-9c204fdb-dbcc-4ffa-bd71-58eb08ad18c1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:02.243865 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-9c204fdb-dbcc-4ffa-bd71-58eb08ad18c1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:02.250351 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9c204fdb-dbcc-4ffa-bd71-58eb08ad18c1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:02.250796 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9c204fdb-dbcc-4ffa-bd71-58eb08ad18c1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:02.251554 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9c204fdb-dbcc-4ffa-bd71-58eb08ad18c1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:02.251976 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9c204fdb-dbcc-4ffa-bd71-58eb08ad18c1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:02.383135 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-9c204fdb-dbcc-4ffa-bd71-58eb08ad18c1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:02.390680 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-9c204fdb-dbcc-4ffa-bd71-58eb08ad18c1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.151366 Jul 20 19:36:02.391250 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 673/1304] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:02 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:36:03.407695 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-224afbc8-f9db-4c51-80f5-8fe28170f302 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:03.408325 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-224afbc8-f9db-4c51-80f5-8fe28170f302 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:03.415362 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-224afbc8-f9db-4c51-80f5-8fe28170f302 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:03.415800 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-224afbc8-f9db-4c51-80f5-8fe28170f302 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:03.416546 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-224afbc8-f9db-4c51-80f5-8fe28170f302 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:03.416972 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-224afbc8-f9db-4c51-80f5-8fe28170f302 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:03.549640 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-224afbc8-f9db-4c51-80f5-8fe28170f302 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:03.557108 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-224afbc8-f9db-4c51-80f5-8fe28170f302 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.153258 Jul 20 19:36:03.557685 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 674/1305] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:03 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:36:04.574895 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-84ea408b-1b0c-4c1e-bfcd-e9418ce02c85 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:04.575560 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-84ea408b-1b0c-4c1e-bfcd-e9418ce02c85 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:04.581991 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-84ea408b-1b0c-4c1e-bfcd-e9418ce02c85 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:04.582445 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-84ea408b-1b0c-4c1e-bfcd-e9418ce02c85 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:04.583222 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-84ea408b-1b0c-4c1e-bfcd-e9418ce02c85 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:04.583660 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-84ea408b-1b0c-4c1e-bfcd-e9418ce02c85 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:04.713256 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-84ea408b-1b0c-4c1e-bfcd-e9418ce02c85 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:04.720970 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-84ea408b-1b0c-4c1e-bfcd-e9418ce02c85 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.150068 Jul 20 19:36:04.721739 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 675/1306] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:04 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:36:05.738738 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-809dbbc0-9f27-4471-95cc-c8b6ad4b3ffc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:05.739407 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-809dbbc0-9f27-4471-95cc-c8b6ad4b3ffc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:05.745827 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-809dbbc0-9f27-4471-95cc-c8b6ad4b3ffc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:05.746274 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-809dbbc0-9f27-4471-95cc-c8b6ad4b3ffc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:05.747039 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-809dbbc0-9f27-4471-95cc-c8b6ad4b3ffc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:05.747469 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-809dbbc0-9f27-4471-95cc-c8b6ad4b3ffc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:05.876683 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-809dbbc0-9f27-4471-95cc-c8b6ad4b3ffc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:05.884083 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-809dbbc0-9f27-4471-95cc-c8b6ad4b3ffc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.149882 Jul 20 19:36:05.884669 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 676/1307] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:05 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:36:06.900557 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-623127a1-4956-4c7f-881a-4fd63fe899cc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:06.901283 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-623127a1-4956-4c7f-881a-4fd63fe899cc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:06.907571 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-623127a1-4956-4c7f-881a-4fd63fe899cc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:06.908012 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-623127a1-4956-4c7f-881a-4fd63fe899cc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:06.908757 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-623127a1-4956-4c7f-881a-4fd63fe899cc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:06.909872 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-623127a1-4956-4c7f-881a-4fd63fe899cc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:07.042952 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-623127a1-4956-4c7f-881a-4fd63fe899cc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:07.050558 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-623127a1-4956-4c7f-881a-4fd63fe899cc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.153762 Jul 20 19:36:07.051128 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 677/1308] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:06 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:36:08.067547 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-9dd49217-228b-428b-b6e1-a8e43c2bc2e2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:08.068184 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-9dd49217-228b-428b-b6e1-a8e43c2bc2e2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:08.074443 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9dd49217-228b-428b-b6e1-a8e43c2bc2e2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:08.074879 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9dd49217-228b-428b-b6e1-a8e43c2bc2e2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:08.075627 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9dd49217-228b-428b-b6e1-a8e43c2bc2e2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:08.076047 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9dd49217-228b-428b-b6e1-a8e43c2bc2e2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:08.204811 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-9dd49217-228b-428b-b6e1-a8e43c2bc2e2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:08.212426 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-9dd49217-228b-428b-b6e1-a8e43c2bc2e2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.148808 Jul 20 19:36:08.213001 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 678/1309] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:08 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:36:09.230406 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-dac2a71d-5d12-4492-8ae2-5efb2b8cf2c3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:09.231089 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-dac2a71d-5d12-4492-8ae2-5efb2b8cf2c3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:09.237959 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-dac2a71d-5d12-4492-8ae2-5efb2b8cf2c3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:09.238400 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-dac2a71d-5d12-4492-8ae2-5efb2b8cf2c3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:09.239151 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-dac2a71d-5d12-4492-8ae2-5efb2b8cf2c3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:09.239570 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-dac2a71d-5d12-4492-8ae2-5efb2b8cf2c3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:09.256806 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:09.377541 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-dac2a71d-5d12-4492-8ae2-5efb2b8cf2c3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:09.385667 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-dac2a71d-5d12-4492-8ae2-5efb2b8cf2c3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.159169 Jul 20 19:36:09.386234 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 679/1310] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:09 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:36:10.403173 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-83009cc3-90eb-49f5-ae91-edcb3065081b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:10.403823 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-83009cc3-90eb-49f5-ae91-edcb3065081b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:10.410505 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-83009cc3-90eb-49f5-ae91-edcb3065081b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:10.410952 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-83009cc3-90eb-49f5-ae91-edcb3065081b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:10.411704 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-83009cc3-90eb-49f5-ae91-edcb3065081b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:10.412136 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-83009cc3-90eb-49f5-ae91-edcb3065081b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:10.539900 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-83009cc3-90eb-49f5-ae91-edcb3065081b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:10.547352 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-83009cc3-90eb-49f5-ae91-edcb3065081b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.147998 Jul 20 19:36:10.547948 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 680/1311] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:10 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:36:11.564380 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ab3d2e84-badf-4853-ba2a-a0f8e54db23e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:11.565072 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ab3d2e84-badf-4853-ba2a-a0f8e54db23e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:11.571608 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ab3d2e84-badf-4853-ba2a-a0f8e54db23e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:11.572056 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ab3d2e84-badf-4853-ba2a-a0f8e54db23e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:11.572821 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ab3d2e84-badf-4853-ba2a-a0f8e54db23e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:11.573322 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ab3d2e84-badf-4853-ba2a-a0f8e54db23e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:11.708656 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ab3d2e84-badf-4853-ba2a-a0f8e54db23e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:11.716336 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ab3d2e84-badf-4853-ba2a-a0f8e54db23e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.155541 Jul 20 19:36:11.716937 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 681/1312] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:11 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:36:12.733939 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-5f9e45ca-6343-4e1c-87c3-3184b7f82110 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:12.734626 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-5f9e45ca-6343-4e1c-87c3-3184b7f82110 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:12.741766 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5f9e45ca-6343-4e1c-87c3-3184b7f82110 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:12.742217 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5f9e45ca-6343-4e1c-87c3-3184b7f82110 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:12.742982 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5f9e45ca-6343-4e1c-87c3-3184b7f82110 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:12.743414 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5f9e45ca-6343-4e1c-87c3-3184b7f82110 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:12.874952 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-5f9e45ca-6343-4e1c-87c3-3184b7f82110 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:12.883422 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-5f9e45ca-6343-4e1c-87c3-3184b7f82110 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.153364 Jul 20 19:36:12.883986 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 682/1313] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:12 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:36:13.900584 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-546f2560-f192-411b-bb4e-614b11520341 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:13.901263 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-546f2560-f192-411b-bb4e-614b11520341 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:13.907666 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-546f2560-f192-411b-bb4e-614b11520341 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:13.908112 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-546f2560-f192-411b-bb4e-614b11520341 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:13.908862 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-546f2560-f192-411b-bb4e-614b11520341 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:13.909342 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-546f2560-f192-411b-bb4e-614b11520341 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:14.040188 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-546f2560-f192-411b-bb4e-614b11520341 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:14.047586 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-546f2560-f192-411b-bb4e-614b11520341 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.150923 Jul 20 19:36:14.048152 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 683/1314] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:13 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:36:15.066403 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-0beb1381-4eda-411c-8c21-df3fc8c6de2c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:15.067172 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-0beb1381-4eda-411c-8c21-df3fc8c6de2c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:15.073915 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0beb1381-4eda-411c-8c21-df3fc8c6de2c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:15.074358 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0beb1381-4eda-411c-8c21-df3fc8c6de2c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:15.075109 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0beb1381-4eda-411c-8c21-df3fc8c6de2c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:15.075535 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0beb1381-4eda-411c-8c21-df3fc8c6de2c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:15.209015 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0beb1381-4eda-411c-8c21-df3fc8c6de2c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:15.216747 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-0beb1381-4eda-411c-8c21-df3fc8c6de2c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.155089 Jul 20 19:36:15.217308 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 684/1315] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:15 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:36:16.234312 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-7964b46e-4564-4746-97d8-096adceb58b1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:16.234919 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-7964b46e-4564-4746-97d8-096adceb58b1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:16.237495 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_api:SELECT=80 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:16.243061 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7964b46e-4564-4746-97d8-096adceb58b1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:16.243502 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7964b46e-4564-4746-97d8-096adceb58b1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:16.244268 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7964b46e-4564-4746-97d8-096adceb58b1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:16.244696 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7964b46e-4564-4746-97d8-096adceb58b1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:16.379523 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-7964b46e-4564-4746-97d8-096adceb58b1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:16.386925 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-7964b46e-4564-4746-97d8-096adceb58b1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.156479 Jul 20 19:36:16.387502 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 685/1316] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:16 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:36:17.404124 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-aa69946b-4cc0-4529-83a0-2906afcdca60 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:17.404771 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-aa69946b-4cc0-4529-83a0-2906afcdca60 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:17.411436 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aa69946b-4cc0-4529-83a0-2906afcdca60 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:17.411885 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aa69946b-4cc0-4529-83a0-2906afcdca60 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:17.412650 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aa69946b-4cc0-4529-83a0-2906afcdca60 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:17.413084 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aa69946b-4cc0-4529-83a0-2906afcdca60 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:17.547199 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-aa69946b-4cc0-4529-83a0-2906afcdca60 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:17.555493 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-aa69946b-4cc0-4529-83a0-2906afcdca60 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.155382 Jul 20 19:36:17.556061 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 686/1317] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:17 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:36:18.573666 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-cdfbe10a-20e0-4c8d-b5a4-ea9ba0c049ce tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:18.574295 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-cdfbe10a-20e0-4c8d-b5a4-ea9ba0c049ce tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:18.580671 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cdfbe10a-20e0-4c8d-b5a4-ea9ba0c049ce tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:18.581222 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cdfbe10a-20e0-4c8d-b5a4-ea9ba0c049ce tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:18.582017 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cdfbe10a-20e0-4c8d-b5a4-ea9ba0c049ce tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:18.582454 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cdfbe10a-20e0-4c8d-b5a4-ea9ba0c049ce tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:18.713903 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-cdfbe10a-20e0-4c8d-b5a4-ea9ba0c049ce tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:18.722620 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-cdfbe10a-20e0-4c8d-b5a4-ea9ba0c049ce tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.151920 Jul 20 19:36:18.723593 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 687/1318] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:18 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:36:19.740370 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-585ace08-74ad-4e51-ad32-3ba658186b47 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:19.741041 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-585ace08-74ad-4e51-ad32-3ba658186b47 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:19.747688 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-585ace08-74ad-4e51-ad32-3ba658186b47 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:19.748144 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-585ace08-74ad-4e51-ad32-3ba658186b47 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:19.748905 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-585ace08-74ad-4e51-ad32-3ba658186b47 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:19.749342 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-585ace08-74ad-4e51-ad32-3ba658186b47 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:19.878848 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-585ace08-74ad-4e51-ad32-3ba658186b47 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:19.886339 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-585ace08-74ad-4e51-ad32-3ba658186b47 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.149942 Jul 20 19:36:19.886909 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 688/1319] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:19 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:36:20.903748 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-bea1fc47-56f7-4d06-b7d5-6036b34bd570 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:20.904448 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-bea1fc47-56f7-4d06-b7d5-6036b34bd570 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:20.911955 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bea1fc47-56f7-4d06-b7d5-6036b34bd570 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:20.912741 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bea1fc47-56f7-4d06-b7d5-6036b34bd570 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:20.914146 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bea1fc47-56f7-4d06-b7d5-6036b34bd570 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:20.914933 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bea1fc47-56f7-4d06-b7d5-6036b34bd570 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:21.056204 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-bea1fc47-56f7-4d06-b7d5-6036b34bd570 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:21.063768 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-bea1fc47-56f7-4d06-b7d5-6036b34bd570 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.163973 Jul 20 19:36:21.064331 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 689/1320] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:20 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:36:22.082341 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-6136a0b2-23fc-4703-bf76-7c7bd4d39525 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:22.083028 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-6136a0b2-23fc-4703-bf76-7c7bd4d39525 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:22.089432 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6136a0b2-23fc-4703-bf76-7c7bd4d39525 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:22.089915 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6136a0b2-23fc-4703-bf76-7c7bd4d39525 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:22.090683 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6136a0b2-23fc-4703-bf76-7c7bd4d39525 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:22.091377 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6136a0b2-23fc-4703-bf76-7c7bd4d39525 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:22.222230 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6136a0b2-23fc-4703-bf76-7c7bd4d39525 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:22.229764 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-6136a0b2-23fc-4703-bf76-7c7bd4d39525 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.152201 Jul 20 19:36:22.230338 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 690/1321] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:22 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:36:23.246926 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e38ad52a-d76e-459f-9f06-5ae602aadef1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:23.247573 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e38ad52a-d76e-459f-9f06-5ae602aadef1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:23.254599 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e38ad52a-d76e-459f-9f06-5ae602aadef1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:23.255039 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e38ad52a-d76e-459f-9f06-5ae602aadef1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:23.255826 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e38ad52a-d76e-459f-9f06-5ae602aadef1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:23.256242 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e38ad52a-d76e-459f-9f06-5ae602aadef1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:23.393120 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e38ad52a-d76e-459f-9f06-5ae602aadef1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:23.400708 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e38ad52a-d76e-459f-9f06-5ae602aadef1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.157768 Jul 20 19:36:23.401267 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 691/1322] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:23 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:36:24.418674 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-8b33afc3-aa1e-4221-9ede-d2e38bc3b04b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:24.419373 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-8b33afc3-aa1e-4221-9ede-d2e38bc3b04b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:24.426400 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8b33afc3-aa1e-4221-9ede-d2e38bc3b04b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:24.426849 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8b33afc3-aa1e-4221-9ede-d2e38bc3b04b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:24.427620 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8b33afc3-aa1e-4221-9ede-d2e38bc3b04b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:24.428081 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8b33afc3-aa1e-4221-9ede-d2e38bc3b04b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:24.558743 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8b33afc3-aa1e-4221-9ede-d2e38bc3b04b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:24.566928 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-8b33afc3-aa1e-4221-9ede-d2e38bc3b04b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.152354 Jul 20 19:36:24.567493 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 692/1323] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:24 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:36:25.584623 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-6e7f9e49-a558-43c5-986d-16dbb1ef624d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:25.585259 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-6e7f9e49-a558-43c5-986d-16dbb1ef624d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:25.592084 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6e7f9e49-a558-43c5-986d-16dbb1ef624d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:25.592565 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6e7f9e49-a558-43c5-986d-16dbb1ef624d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:25.593337 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6e7f9e49-a558-43c5-986d-16dbb1ef624d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:25.593806 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6e7f9e49-a558-43c5-986d-16dbb1ef624d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:25.727809 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6e7f9e49-a558-43c5-986d-16dbb1ef624d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:25.735328 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-6e7f9e49-a558-43c5-986d-16dbb1ef624d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.155367 Jul 20 19:36:25.735894 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 693/1324] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:25 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:36:26.752154 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-0eb67ea1-ce3c-4ed2-a6ec-f95a09c7b25d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:26.753420 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-0eb67ea1-ce3c-4ed2-a6ec-f95a09c7b25d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:26.759723 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0eb67ea1-ce3c-4ed2-a6ec-f95a09c7b25d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:26.760163 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0eb67ea1-ce3c-4ed2-a6ec-f95a09c7b25d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:26.760916 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0eb67ea1-ce3c-4ed2-a6ec-f95a09c7b25d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:26.761342 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0eb67ea1-ce3c-4ed2-a6ec-f95a09c7b25d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:26.894249 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0eb67ea1-ce3c-4ed2-a6ec-f95a09c7b25d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:26.901674 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-0eb67ea1-ce3c-4ed2-a6ec-f95a09c7b25d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.153400 Jul 20 19:36:26.902229 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 694/1325] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:26 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:36:27.918810 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-8dbdb251-acac-45b6-9f59-fc7f64af657d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:27.919491 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-8dbdb251-acac-45b6-9f59-fc7f64af657d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:27.925962 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8dbdb251-acac-45b6-9f59-fc7f64af657d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:27.926409 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8dbdb251-acac-45b6-9f59-fc7f64af657d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:27.927165 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8dbdb251-acac-45b6-9f59-fc7f64af657d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:27.927593 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8dbdb251-acac-45b6-9f59-fc7f64af657d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:28.056176 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8dbdb251-acac-45b6-9f59-fc7f64af657d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:28.063812 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-8dbdb251-acac-45b6-9f59-fc7f64af657d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.148887 Jul 20 19:36:28.064370 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 695/1326] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:27 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:36:29.080586 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e592ff53-d148-4f55-83b0-7d6c4cd5dd91 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:29.081801 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e592ff53-d148-4f55-83b0-7d6c4cd5dd91 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:29.088189 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e592ff53-d148-4f55-83b0-7d6c4cd5dd91 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:29.088638 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e592ff53-d148-4f55-83b0-7d6c4cd5dd91 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:29.089423 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e592ff53-d148-4f55-83b0-7d6c4cd5dd91 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:29.089875 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e592ff53-d148-4f55-83b0-7d6c4cd5dd91 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:29.094049 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:29.240050 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e592ff53-d148-4f55-83b0-7d6c4cd5dd91 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:29.247661 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e592ff53-d148-4f55-83b0-7d6c4cd5dd91 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.171134 Jul 20 19:36:29.248224 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 696/1327] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:29 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:36:30.264793 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-668c7112-c2ff-48ec-b727-35895ad0b92d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:30.265400 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-668c7112-c2ff-48ec-b727-35895ad0b92d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:30.272368 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-668c7112-c2ff-48ec-b727-35895ad0b92d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:30.272808 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-668c7112-c2ff-48ec-b727-35895ad0b92d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:30.273577 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-668c7112-c2ff-48ec-b727-35895ad0b92d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:30.274005 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-668c7112-c2ff-48ec-b727-35895ad0b92d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:30.404797 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-668c7112-c2ff-48ec-b727-35895ad0b92d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:30.412256 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-668c7112-c2ff-48ec-b727-35895ad0b92d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.151348 Jul 20 19:36:30.412823 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 697/1328] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:30 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:36:31.429239 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-34863a53-5da4-47b5-95a2-31ede93c0f93 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:31.429932 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-34863a53-5da4-47b5-95a2-31ede93c0f93 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:31.436229 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-34863a53-5da4-47b5-95a2-31ede93c0f93 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:31.436671 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-34863a53-5da4-47b5-95a2-31ede93c0f93 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:31.437421 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-34863a53-5da4-47b5-95a2-31ede93c0f93 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:31.437881 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-34863a53-5da4-47b5-95a2-31ede93c0f93 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:31.573175 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-34863a53-5da4-47b5-95a2-31ede93c0f93 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:31.581613 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-34863a53-5da4-47b5-95a2-31ede93c0f93 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.155388 Jul 20 19:36:31.582349 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 698/1329] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:31 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:36:32.599558 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-73efb1ee-66a7-4963-84b8-46d93b1477d9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:32.600179 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-73efb1ee-66a7-4963-84b8-46d93b1477d9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:32.606744 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-73efb1ee-66a7-4963-84b8-46d93b1477d9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:32.607194 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-73efb1ee-66a7-4963-84b8-46d93b1477d9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:32.608046 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-73efb1ee-66a7-4963-84b8-46d93b1477d9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:32.608497 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-73efb1ee-66a7-4963-84b8-46d93b1477d9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:32.738457 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-73efb1ee-66a7-4963-84b8-46d93b1477d9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:32.746019 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-73efb1ee-66a7-4963-84b8-46d93b1477d9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.150999 Jul 20 19:36:32.746508 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 699/1330] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:32 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:36:33.763828 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d062256b-ca1c-44a2-8d65-4b44cd04b54e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:33.764516 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d062256b-ca1c-44a2-8d65-4b44cd04b54e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:33.770454 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d062256b-ca1c-44a2-8d65-4b44cd04b54e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:33.770895 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d062256b-ca1c-44a2-8d65-4b44cd04b54e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:33.771641 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d062256b-ca1c-44a2-8d65-4b44cd04b54e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:33.772069 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d062256b-ca1c-44a2-8d65-4b44cd04b54e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:33.901593 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d062256b-ca1c-44a2-8d65-4b44cd04b54e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:33.909938 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d062256b-ca1c-44a2-8d65-4b44cd04b54e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.149942 Jul 20 19:36:33.910511 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 700/1331] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:33 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:36:34.927169 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-b431ebf0-9338-467b-bdbc-3049efb65e1d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:34.927842 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-b431ebf0-9338-467b-bdbc-3049efb65e1d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:34.935095 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b431ebf0-9338-467b-bdbc-3049efb65e1d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:34.935546 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b431ebf0-9338-467b-bdbc-3049efb65e1d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:34.936318 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b431ebf0-9338-467b-bdbc-3049efb65e1d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:34.936753 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b431ebf0-9338-467b-bdbc-3049efb65e1d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:35.069350 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-b431ebf0-9338-467b-bdbc-3049efb65e1d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:35.077401 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-b431ebf0-9338-467b-bdbc-3049efb65e1d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.154083 Jul 20 19:36:35.078456 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 701/1332] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:34 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:36:36.100990 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ebd176e7-c93f-4bee-9f4c-cd9f423851fd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:36.101696 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ebd176e7-c93f-4bee-9f4c-cd9f423851fd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:36.108110 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ebd176e7-c93f-4bee-9f4c-cd9f423851fd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:36.108581 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ebd176e7-c93f-4bee-9f4c-cd9f423851fd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:36.109326 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ebd176e7-c93f-4bee-9f4c-cd9f423851fd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:36.109788 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ebd176e7-c93f-4bee-9f4c-cd9f423851fd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:36.238875 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ebd176e7-c93f-4bee-9f4c-cd9f423851fd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:36.246388 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ebd176e7-c93f-4bee-9f4c-cd9f423851fd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.149540 Jul 20 19:36:36.246963 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 702/1333] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:36 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:36:37.263565 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c02deed0-3881-4c4b-98db-cc119c94328b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:37.264236 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c02deed0-3881-4c4b-98db-cc119c94328b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:37.271268 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c02deed0-3881-4c4b-98db-cc119c94328b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:37.271715 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c02deed0-3881-4c4b-98db-cc119c94328b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:37.272487 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c02deed0-3881-4c4b-98db-cc119c94328b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:37.272918 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c02deed0-3881-4c4b-98db-cc119c94328b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:37.405023 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c02deed0-3881-4c4b-98db-cc119c94328b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:37.413069 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c02deed0-3881-4c4b-98db-cc119c94328b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.153334 Jul 20 19:36:37.413658 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 703/1334] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:37 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:36:38.143932 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-399d1dcf-278d-4e40-bba0-184a33e9cd02 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:38.144541 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-399d1dcf-278d-4e40-bba0-184a33e9cd02 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:38.150596 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-399d1dcf-278d-4e40-bba0-184a33e9cd02 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:38.151073 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-399d1dcf-278d-4e40-bba0-184a33e9cd02 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:38.151837 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-399d1dcf-278d-4e40-bba0-184a33e9cd02 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:38.152273 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-399d1dcf-278d-4e40-bba0-184a33e9cd02 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:38.212317 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-399d1dcf-278d-4e40-bba0-184a33e9cd02 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:38.220044 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-399d1dcf-278d-4e40-bba0-184a33e9cd02 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080201 Jul 20 19:36:38.220606 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 704/1335] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:38 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:36:38.430469 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-0cc81fe0-4457-464e-9e19-6804c10f56a7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:38.431112 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-0cc81fe0-4457-464e-9e19-6804c10f56a7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:38.437481 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0cc81fe0-4457-464e-9e19-6804c10f56a7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:38.437965 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0cc81fe0-4457-464e-9e19-6804c10f56a7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:38.438728 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0cc81fe0-4457-464e-9e19-6804c10f56a7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:38.439162 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0cc81fe0-4457-464e-9e19-6804c10f56a7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:38.569895 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0cc81fe0-4457-464e-9e19-6804c10f56a7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:38.577406 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-0cc81fe0-4457-464e-9e19-6804c10f56a7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.150798 Jul 20 19:36:38.578000 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 705/1336] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:38 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:36:39.238325 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e490f446-fd92-48c0-9952-15cbf5bb264d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:39.238936 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e490f446-fd92-48c0-9952-15cbf5bb264d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:39.244896 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e490f446-fd92-48c0-9952-15cbf5bb264d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:39.245336 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e490f446-fd92-48c0-9952-15cbf5bb264d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:39.246165 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e490f446-fd92-48c0-9952-15cbf5bb264d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:39.246593 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e490f446-fd92-48c0-9952-15cbf5bb264d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:39.313221 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e490f446-fd92-48c0-9952-15cbf5bb264d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:39.321622 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e490f446-fd92-48c0-9952-15cbf5bb264d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.088165 Jul 20 19:36:39.322206 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 706/1337] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:39 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:36:39.595488 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-37b3537e-96a4-485a-a24d-f4a3bf219846 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:39.596612 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-37b3537e-96a4-485a-a24d-f4a3bf219846 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:39.603251 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-37b3537e-96a4-485a-a24d-f4a3bf219846 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:39.603699 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-37b3537e-96a4-485a-a24d-f4a3bf219846 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:39.604463 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-37b3537e-96a4-485a-a24d-f4a3bf219846 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:39.604896 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-37b3537e-96a4-485a-a24d-f4a3bf219846 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:39.738865 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-37b3537e-96a4-485a-a24d-f4a3bf219846 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:39.746457 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-37b3537e-96a4-485a-a24d-f4a3bf219846 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.155202 Jul 20 19:36:39.747022 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 707/1338] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:39 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:36:40.338694 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ba93ddb1-eb6e-467b-aad1-da6661c00ee6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:40.339293 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ba93ddb1-eb6e-467b-aad1-da6661c00ee6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:40.345536 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ba93ddb1-eb6e-467b-aad1-da6661c00ee6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:40.346518 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ba93ddb1-eb6e-467b-aad1-da6661c00ee6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:40.347359 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ba93ddb1-eb6e-467b-aad1-da6661c00ee6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:40.347776 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ba93ddb1-eb6e-467b-aad1-da6661c00ee6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:40.408928 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ba93ddb1-eb6e-467b-aad1-da6661c00ee6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:40.416656 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ba93ddb1-eb6e-467b-aad1-da6661c00ee6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.081846 Jul 20 19:36:40.417215 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 708/1339] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:40 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:36:40.764071 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-956ee805-8ae9-41ab-9cee-5b12f088ef2f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:40.764735 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-956ee805-8ae9-41ab-9cee-5b12f088ef2f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:40.771707 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-956ee805-8ae9-41ab-9cee-5b12f088ef2f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:40.772158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-956ee805-8ae9-41ab-9cee-5b12f088ef2f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:40.772916 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-956ee805-8ae9-41ab-9cee-5b12f088ef2f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:40.773347 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-956ee805-8ae9-41ab-9cee-5b12f088ef2f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:40.905496 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-956ee805-8ae9-41ab-9cee-5b12f088ef2f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:40.913702 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-956ee805-8ae9-41ab-9cee-5b12f088ef2f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.153453 Jul 20 19:36:40.914298 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 709/1340] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:40 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:36:41.434263 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4d098151-60c6-4c24-893c-88e1fd252d61 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:41.434865 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-4d098151-60c6-4c24-893c-88e1fd252d61 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:41.441451 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4d098151-60c6-4c24-893c-88e1fd252d61 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:41.441918 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4d098151-60c6-4c24-893c-88e1fd252d61 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:41.442666 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4d098151-60c6-4c24-893c-88e1fd252d61 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:41.443091 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4d098151-60c6-4c24-893c-88e1fd252d61 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:41.504386 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-4d098151-60c6-4c24-893c-88e1fd252d61 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:41.511858 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-4d098151-60c6-4c24-893c-88e1fd252d61 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.081440 Jul 20 19:36:41.512420 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 710/1341] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:41 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:36:41.930765 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a47c7581-29bd-4366-b84e-8ba0aa21861c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:41.931443 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a47c7581-29bd-4366-b84e-8ba0aa21861c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:41.938081 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a47c7581-29bd-4366-b84e-8ba0aa21861c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:41.938532 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a47c7581-29bd-4366-b84e-8ba0aa21861c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:41.939296 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a47c7581-29bd-4366-b84e-8ba0aa21861c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:41.940258 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a47c7581-29bd-4366-b84e-8ba0aa21861c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:42.071121 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a47c7581-29bd-4366-b84e-8ba0aa21861c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:42.078844 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a47c7581-29bd-4366-b84e-8ba0aa21861c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.152014 Jul 20 19:36:42.079406 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 711/1342] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:41 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:36:42.528962 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-410b4449-622f-43af-9488-0aee6c72bbd2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:42.529475 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-410b4449-622f-43af-9488-0aee6c72bbd2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:42.536397 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-410b4449-622f-43af-9488-0aee6c72bbd2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:42.536846 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-410b4449-622f-43af-9488-0aee6c72bbd2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:42.537667 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-410b4449-622f-43af-9488-0aee6c72bbd2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:42.538099 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-410b4449-622f-43af-9488-0aee6c72bbd2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:42.608220 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-410b4449-622f-43af-9488-0aee6c72bbd2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:42.610564 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:42.618474 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-410b4449-622f-43af-9488-0aee6c72bbd2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.093442 Jul 20 19:36:42.619253 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 712/1343] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:42 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:36:43.097119 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-516ef647-41eb-4f0a-a533-1837e46d8ce6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:43.098208 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-516ef647-41eb-4f0a-a533-1837e46d8ce6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:43.104764 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-516ef647-41eb-4f0a-a533-1837e46d8ce6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:43.105218 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-516ef647-41eb-4f0a-a533-1837e46d8ce6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:43.106016 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-516ef647-41eb-4f0a-a533-1837e46d8ce6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:43.106453 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-516ef647-41eb-4f0a-a533-1837e46d8ce6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:43.235306 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-516ef647-41eb-4f0a-a533-1837e46d8ce6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:43.243045 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-516ef647-41eb-4f0a-a533-1837e46d8ce6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.150523 Jul 20 19:36:43.243597 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 713/1344] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:43 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:36:43.635710 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-99a2c84d-c296-4915-b20e-ed8187afc6cb tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:43.636231 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-99a2c84d-c296-4915-b20e-ed8187afc6cb tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:43.642295 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-99a2c84d-c296-4915-b20e-ed8187afc6cb tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:43.642742 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-99a2c84d-c296-4915-b20e-ed8187afc6cb tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:43.643648 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-99a2c84d-c296-4915-b20e-ed8187afc6cb tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:43.644069 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-99a2c84d-c296-4915-b20e-ed8187afc6cb tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:43.708401 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-99a2c84d-c296-4915-b20e-ed8187afc6cb tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:43.716018 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-99a2c84d-c296-4915-b20e-ed8187afc6cb tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.084212 Jul 20 19:36:43.716843 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 714/1345] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:43 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:36:44.260560 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-df7d2cb2-bdd4-49c5-8fd7-e67d11a2ddf4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:44.261169 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-df7d2cb2-bdd4-49c5-8fd7-e67d11a2ddf4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:44.267837 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-df7d2cb2-bdd4-49c5-8fd7-e67d11a2ddf4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:44.268957 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-df7d2cb2-bdd4-49c5-8fd7-e67d11a2ddf4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:44.269754 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-df7d2cb2-bdd4-49c5-8fd7-e67d11a2ddf4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:44.270186 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-df7d2cb2-bdd4-49c5-8fd7-e67d11a2ddf4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:44.404856 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-df7d2cb2-bdd4-49c5-8fd7-e67d11a2ddf4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:44.412777 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-df7d2cb2-bdd4-49c5-8fd7-e67d11a2ddf4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.156209 Jul 20 19:36:44.413344 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 715/1346] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:44 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:36:44.733867 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-8c78ac71-3926-40f6-8623-6d748d78a784 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:44.734515 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-8c78ac71-3926-40f6-8623-6d748d78a784 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:44.741486 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8c78ac71-3926-40f6-8623-6d748d78a784 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:44.741948 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8c78ac71-3926-40f6-8623-6d748d78a784 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:44.742728 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8c78ac71-3926-40f6-8623-6d748d78a784 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:44.743151 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8c78ac71-3926-40f6-8623-6d748d78a784 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:44.803974 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8c78ac71-3926-40f6-8623-6d748d78a784 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:44.811669 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-8c78ac71-3926-40f6-8623-6d748d78a784 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.081645 Jul 20 19:36:44.812234 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 716/1347] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:44 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:36:45.430197 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-23aebf27-55be-4e12-a431-80bc6ba1e97c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:45.430912 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-23aebf27-55be-4e12-a431-80bc6ba1e97c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:45.437209 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-23aebf27-55be-4e12-a431-80bc6ba1e97c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:45.437737 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-23aebf27-55be-4e12-a431-80bc6ba1e97c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:45.438451 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-23aebf27-55be-4e12-a431-80bc6ba1e97c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:45.438880 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-23aebf27-55be-4e12-a431-80bc6ba1e97c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:45.683795 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-23aebf27-55be-4e12-a431-80bc6ba1e97c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:45.691879 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-23aebf27-55be-4e12-a431-80bc6ba1e97c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.265711 Jul 20 19:36:45.692474 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 717/1348] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:45 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:36:45.828249 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-675dbe65-7fba-4e34-a0d4-a65bc381dad7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:45.829003 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-675dbe65-7fba-4e34-a0d4-a65bc381dad7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:45.835903 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-675dbe65-7fba-4e34-a0d4-a65bc381dad7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:45.836348 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-675dbe65-7fba-4e34-a0d4-a65bc381dad7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:45.837103 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-675dbe65-7fba-4e34-a0d4-a65bc381dad7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:45.837561 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-675dbe65-7fba-4e34-a0d4-a65bc381dad7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:45.899064 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-675dbe65-7fba-4e34-a0d4-a65bc381dad7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:45.906614 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-675dbe65-7fba-4e34-a0d4-a65bc381dad7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.082274 Jul 20 19:36:45.907185 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 718/1349] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:45 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:36:46.708878 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-8812c0a7-82d0-49ba-9bde-7a18cd6bd336 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:46.709583 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-8812c0a7-82d0-49ba-9bde-7a18cd6bd336 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:46.711806 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_api:SELECT=68 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:46.717359 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8812c0a7-82d0-49ba-9bde-7a18cd6bd336 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:46.717842 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8812c0a7-82d0-49ba-9bde-7a18cd6bd336 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:46.718610 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8812c0a7-82d0-49ba-9bde-7a18cd6bd336 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:46.719043 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8812c0a7-82d0-49ba-9bde-7a18cd6bd336 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:46.848510 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8812c0a7-82d0-49ba-9bde-7a18cd6bd336 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:46.856035 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-8812c0a7-82d0-49ba-9bde-7a18cd6bd336 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.151098 Jul 20 19:36:46.856597 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 719/1350] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:46 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:36:46.923719 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d37806b3-318e-4938-b127-c0d737a9f295 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:46.924940 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d37806b3-318e-4938-b127-c0d737a9f295 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:46.930882 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d37806b3-318e-4938-b127-c0d737a9f295 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:46.931482 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d37806b3-318e-4938-b127-c0d737a9f295 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:46.932255 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d37806b3-318e-4938-b127-c0d737a9f295 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:46.932682 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d37806b3-318e-4938-b127-c0d737a9f295 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:46.993952 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d37806b3-318e-4938-b127-c0d737a9f295 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:47.001331 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d37806b3-318e-4938-b127-c0d737a9f295 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.081367 Jul 20 19:36:47.001946 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 720/1351] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:46 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:36:47.874113 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-db594fff-0ba7-4cac-8b2b-2be13cc56242 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:47.874800 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-db594fff-0ba7-4cac-8b2b-2be13cc56242 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:47.882330 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-db594fff-0ba7-4cac-8b2b-2be13cc56242 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:47.882776 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-db594fff-0ba7-4cac-8b2b-2be13cc56242 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:47.883562 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-db594fff-0ba7-4cac-8b2b-2be13cc56242 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:47.883996 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-db594fff-0ba7-4cac-8b2b-2be13cc56242 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:48.023251 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-db594fff-0ba7-4cac-8b2b-2be13cc56242 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:48.030857 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-db594fff-0ba7-4cac-8b2b-2be13cc56242 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.160614 Jul 20 19:36:48.031435 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 721/1352] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:47 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:36:48.036768 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-5637e63c-39b4-4e50-96b7-1f732cc98584 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:48.037368 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-5637e63c-39b4-4e50-96b7-1f732cc98584 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:48.043475 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5637e63c-39b4-4e50-96b7-1f732cc98584 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:48.043928 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5637e63c-39b4-4e50-96b7-1f732cc98584 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:48.044702 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5637e63c-39b4-4e50-96b7-1f732cc98584 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:48.045142 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5637e63c-39b4-4e50-96b7-1f732cc98584 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:48.114267 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-5637e63c-39b4-4e50-96b7-1f732cc98584 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:48.121971 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-5637e63c-39b4-4e50-96b7-1f732cc98584 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.089427 Jul 20 19:36:48.122561 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 722/1353] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:48 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:36:49.048270 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-b1bedeae-2ce6-440b-8b7b-ee8162edf2f0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:49.048913 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-b1bedeae-2ce6-440b-8b7b-ee8162edf2f0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:49.056030 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b1bedeae-2ce6-440b-8b7b-ee8162edf2f0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:49.056470 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b1bedeae-2ce6-440b-8b7b-ee8162edf2f0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:49.057226 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b1bedeae-2ce6-440b-8b7b-ee8162edf2f0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:49.057693 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b1bedeae-2ce6-440b-8b7b-ee8162edf2f0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:49.192068 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-b1bedeae-2ce6-440b-8b7b-ee8162edf2f0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:49.199575 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-b1bedeae-2ce6-440b-8b7b-ee8162edf2f0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.155307 Jul 20 19:36:49.200141 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 723/1354] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:49 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:36:49.204576 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e5c721bc-6f18-4f45-a109-0ad1ca8c74cf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:49.205168 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e5c721bc-6f18-4f45-a109-0ad1ca8c74cf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:49.211060 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e5c721bc-6f18-4f45-a109-0ad1ca8c74cf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:49.211503 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e5c721bc-6f18-4f45-a109-0ad1ca8c74cf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:49.212297 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e5c721bc-6f18-4f45-a109-0ad1ca8c74cf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:49.212707 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e5c721bc-6f18-4f45-a109-0ad1ca8c74cf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:49.273783 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e5c721bc-6f18-4f45-a109-0ad1ca8c74cf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:49.281129 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e5c721bc-6f18-4f45-a109-0ad1ca8c74cf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080069 Jul 20 19:36:49.281721 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 724/1355] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:49 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:36:50.216282 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-140e0036-fe61-4320-b20f-fdcb31e37746 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:50.217237 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-140e0036-fe61-4320-b20f-fdcb31e37746 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:50.223924 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-140e0036-fe61-4320-b20f-fdcb31e37746 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:50.224373 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-140e0036-fe61-4320-b20f-fdcb31e37746 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:50.225142 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-140e0036-fe61-4320-b20f-fdcb31e37746 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:50.225604 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-140e0036-fe61-4320-b20f-fdcb31e37746 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:50.360722 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-140e0036-fe61-4320-b20f-fdcb31e37746 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:50.368881 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-140e0036-fe61-4320-b20f-fdcb31e37746 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.156419 Jul 20 19:36:50.369464 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 725/1356] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:50 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:36:50.373950 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-aa073e39-0df5-45a2-961a-103565d0b723 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:50.374548 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-aa073e39-0df5-45a2-961a-103565d0b723 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:50.381305 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aa073e39-0df5-45a2-961a-103565d0b723 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:50.381775 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aa073e39-0df5-45a2-961a-103565d0b723 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:50.382547 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aa073e39-0df5-45a2-961a-103565d0b723 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:50.382979 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aa073e39-0df5-45a2-961a-103565d0b723 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:50.445645 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-aa073e39-0df5-45a2-961a-103565d0b723 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:50.453302 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-aa073e39-0df5-45a2-961a-103565d0b723 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.082816 Jul 20 19:36:50.453911 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 726/1357] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:50 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:36:51.386816 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d0c8968e-e741-44b1-bdc8-1c7c84dfa50f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:51.387453 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d0c8968e-e741-44b1-bdc8-1c7c84dfa50f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:51.393900 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d0c8968e-e741-44b1-bdc8-1c7c84dfa50f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:51.394343 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d0c8968e-e741-44b1-bdc8-1c7c84dfa50f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:51.395094 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d0c8968e-e741-44b1-bdc8-1c7c84dfa50f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:51.395524 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d0c8968e-e741-44b1-bdc8-1c7c84dfa50f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:51.527894 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d0c8968e-e741-44b1-bdc8-1c7c84dfa50f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:51.535958 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d0c8968e-e741-44b1-bdc8-1c7c84dfa50f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.152994 Jul 20 19:36:51.536527 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 727/1358] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:51 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:36:51.540850 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a0579646-2e8b-4dd2-9d03-09f9a341e8f7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:51.541455 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a0579646-2e8b-4dd2-9d03-09f9a341e8f7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:51.547071 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a0579646-2e8b-4dd2-9d03-09f9a341e8f7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:51.547566 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a0579646-2e8b-4dd2-9d03-09f9a341e8f7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:51.548307 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a0579646-2e8b-4dd2-9d03-09f9a341e8f7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:51.548740 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a0579646-2e8b-4dd2-9d03-09f9a341e8f7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:51.609440 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a0579646-2e8b-4dd2-9d03-09f9a341e8f7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:51.617699 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a0579646-2e8b-4dd2-9d03-09f9a341e8f7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080194 Jul 20 19:36:51.618267 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 728/1359] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:51 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:36:52.552920 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-31beb02f-51fb-4430-b5c4-ab234c2d0f19 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:52.553610 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-31beb02f-51fb-4430-b5c4-ab234c2d0f19 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:52.560399 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-31beb02f-51fb-4430-b5c4-ab234c2d0f19 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:52.560850 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-31beb02f-51fb-4430-b5c4-ab234c2d0f19 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:52.561826 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-31beb02f-51fb-4430-b5c4-ab234c2d0f19 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:52.562268 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-31beb02f-51fb-4430-b5c4-ab234c2d0f19 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:52.577726 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:52.706292 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-31beb02f-51fb-4430-b5c4-ab234c2d0f19 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:52.713901 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-31beb02f-51fb-4430-b5c4-ab234c2d0f19 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.165587 Jul 20 19:36:52.714472 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 729/1360] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:52 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:36:52.719099 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4cbdade8-3e4b-47fa-9169-e2e283b70196 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:52.719702 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-4cbdade8-3e4b-47fa-9169-e2e283b70196 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:52.725644 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4cbdade8-3e4b-47fa-9169-e2e283b70196 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:52.726095 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4cbdade8-3e4b-47fa-9169-e2e283b70196 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:52.726861 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4cbdade8-3e4b-47fa-9169-e2e283b70196 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:52.727297 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4cbdade8-3e4b-47fa-9169-e2e283b70196 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:52.791152 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-4cbdade8-3e4b-47fa-9169-e2e283b70196 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:52.798717 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-4cbdade8-3e4b-47fa-9169-e2e283b70196 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.083300 Jul 20 19:36:52.799870 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 730/1361] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:52 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:36:53.732729 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e36cd413-2be0-4301-ac11-875d44b57e46 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:53.733401 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e36cd413-2be0-4301-ac11-875d44b57e46 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:53.740126 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e36cd413-2be0-4301-ac11-875d44b57e46 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:53.740574 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e36cd413-2be0-4301-ac11-875d44b57e46 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:53.741342 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e36cd413-2be0-4301-ac11-875d44b57e46 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:53.741809 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e36cd413-2be0-4301-ac11-875d44b57e46 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:53.874298 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e36cd413-2be0-4301-ac11-875d44b57e46 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:53.881798 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e36cd413-2be0-4301-ac11-875d44b57e46 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.153006 Jul 20 19:36:53.882372 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 731/1362] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:53 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:36:53.886703 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-555ff7f1-a300-4c1b-ba48-7872653c9fd4 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:53.887300 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-555ff7f1-a300-4c1b-ba48-7872653c9fd4 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:53.892898 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-555ff7f1-a300-4c1b-ba48-7872653c9fd4 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:53.893349 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-555ff7f1-a300-4c1b-ba48-7872653c9fd4 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:53.894143 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-555ff7f1-a300-4c1b-ba48-7872653c9fd4 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:53.894583 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-555ff7f1-a300-4c1b-ba48-7872653c9fd4 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:53.955151 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-555ff7f1-a300-4c1b-ba48-7872653c9fd4 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:53.962636 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-555ff7f1-a300-4c1b-ba48-7872653c9fd4 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.079329 Jul 20 19:36:53.963198 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 732/1363] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:53 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:36:54.899064 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-aad7fdd2-325a-45c5-9d20-95cd8f409087 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:54.899780 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-aad7fdd2-325a-45c5-9d20-95cd8f409087 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:54.906308 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aad7fdd2-325a-45c5-9d20-95cd8f409087 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:54.906759 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aad7fdd2-325a-45c5-9d20-95cd8f409087 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:54.907528 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aad7fdd2-325a-45c5-9d20-95cd8f409087 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:54.907966 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aad7fdd2-325a-45c5-9d20-95cd8f409087 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:55.040002 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-aad7fdd2-325a-45c5-9d20-95cd8f409087 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:55.047390 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-aad7fdd2-325a-45c5-9d20-95cd8f409087 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.152263 Jul 20 19:36:55.047946 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 733/1364] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:54 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:36:55.052807 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-1c32d56a-7aae-4dfc-83cf-43795117dce6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:55.053398 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-1c32d56a-7aae-4dfc-83cf-43795117dce6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:55.058871 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1c32d56a-7aae-4dfc-83cf-43795117dce6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:55.059306 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1c32d56a-7aae-4dfc-83cf-43795117dce6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:55.060054 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1c32d56a-7aae-4dfc-83cf-43795117dce6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:55.060481 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1c32d56a-7aae-4dfc-83cf-43795117dce6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:55.121415 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1c32d56a-7aae-4dfc-83cf-43795117dce6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:55.129499 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-1c32d56a-7aae-4dfc-83cf-43795117dce6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080598 Jul 20 19:36:55.130094 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 734/1365] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:55 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:36:56.065893 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-08102f01-237a-49fd-8dec-9a4a5998bc09 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:56.066564 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-08102f01-237a-49fd-8dec-9a4a5998bc09 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:56.073036 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-08102f01-237a-49fd-8dec-9a4a5998bc09 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:56.073470 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-08102f01-237a-49fd-8dec-9a4a5998bc09 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:56.074250 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-08102f01-237a-49fd-8dec-9a4a5998bc09 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:56.074674 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-08102f01-237a-49fd-8dec-9a4a5998bc09 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:56.210516 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-08102f01-237a-49fd-8dec-9a4a5998bc09 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:56.218229 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-08102f01-237a-49fd-8dec-9a4a5998bc09 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.157019 Jul 20 19:36:56.218809 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 735/1366] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:56 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:36:56.224009 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ac620ef2-80e4-4aa0-997c-b3692fc49ebb tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:56.224009 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ac620ef2-80e4-4aa0-997c-b3692fc49ebb tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:56.229900 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ac620ef2-80e4-4aa0-997c-b3692fc49ebb tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:56.230349 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ac620ef2-80e4-4aa0-997c-b3692fc49ebb tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:56.231150 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ac620ef2-80e4-4aa0-997c-b3692fc49ebb tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:56.231586 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ac620ef2-80e4-4aa0-997c-b3692fc49ebb tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:56.292971 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ac620ef2-80e4-4aa0-997c-b3692fc49ebb tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:56.301021 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ac620ef2-80e4-4aa0-997c-b3692fc49ebb tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.081241 Jul 20 19:36:56.301609 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 736/1367] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:56 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:36:57.238037 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c5a40b50-a9f5-403b-9f03-ed96a7813ae5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:57.238713 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c5a40b50-a9f5-403b-9f03-ed96a7813ae5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:57.245310 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c5a40b50-a9f5-403b-9f03-ed96a7813ae5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:57.245788 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c5a40b50-a9f5-403b-9f03-ed96a7813ae5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:57.246558 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c5a40b50-a9f5-403b-9f03-ed96a7813ae5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:57.246990 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c5a40b50-a9f5-403b-9f03-ed96a7813ae5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:57.376404 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c5a40b50-a9f5-403b-9f03-ed96a7813ae5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:57.384615 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c5a40b50-a9f5-403b-9f03-ed96a7813ae5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.150954 Jul 20 19:36:57.385170 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 737/1368] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:57 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:36:57.389770 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-43e0763f-f721-4f5a-b10a-872e50816798 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:57.390375 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-43e0763f-f721-4f5a-b10a-872e50816798 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:57.395891 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-43e0763f-f721-4f5a-b10a-872e50816798 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:57.396331 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-43e0763f-f721-4f5a-b10a-872e50816798 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:57.397087 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-43e0763f-f721-4f5a-b10a-872e50816798 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:57.397533 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-43e0763f-f721-4f5a-b10a-872e50816798 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:57.459778 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-43e0763f-f721-4f5a-b10a-872e50816798 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:57.467372 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-43e0763f-f721-4f5a-b10a-872e50816798 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080866 Jul 20 19:36:57.467931 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 738/1369] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:57 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:36:58.401948 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-8d7a4aee-5985-4ca2-9aaf-0a82f203eacd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:58.402683 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-8d7a4aee-5985-4ca2-9aaf-0a82f203eacd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:58.409285 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8d7a4aee-5985-4ca2-9aaf-0a82f203eacd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:58.409759 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8d7a4aee-5985-4ca2-9aaf-0a82f203eacd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:58.410518 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8d7a4aee-5985-4ca2-9aaf-0a82f203eacd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:58.410945 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8d7a4aee-5985-4ca2-9aaf-0a82f203eacd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:58.544152 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8d7a4aee-5985-4ca2-9aaf-0a82f203eacd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:58.552122 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-8d7a4aee-5985-4ca2-9aaf-0a82f203eacd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.154196 Jul 20 19:36:58.552686 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 739/1370] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:58 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:36:58.557415 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-642b2da0-6440-430d-96ce-f7d5c19389a2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:58.558059 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-642b2da0-6440-430d-96ce-f7d5c19389a2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:58.563906 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-642b2da0-6440-430d-96ce-f7d5c19389a2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:58.564356 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-642b2da0-6440-430d-96ce-f7d5c19389a2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:58.565927 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-642b2da0-6440-430d-96ce-f7d5c19389a2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:58.566365 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-642b2da0-6440-430d-96ce-f7d5c19389a2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:58.626331 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-642b2da0-6440-430d-96ce-f7d5c19389a2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:58.634605 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-642b2da0-6440-430d-96ce-f7d5c19389a2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080992 Jul 20 19:36:58.635168 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 740/1371] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:58 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:36:59.569891 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ead2afc3-bb97-463c-bdd6-0598d7eabcf2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:59.570583 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ead2afc3-bb97-463c-bdd6-0598d7eabcf2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:59.576985 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ead2afc3-bb97-463c-bdd6-0598d7eabcf2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:59.577367 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ead2afc3-bb97-463c-bdd6-0598d7eabcf2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:59.578153 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ead2afc3-bb97-463c-bdd6-0598d7eabcf2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:59.578582 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ead2afc3-bb97-463c-bdd6-0598d7eabcf2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:59.713729 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ead2afc3-bb97-463c-bdd6-0598d7eabcf2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:59.722442 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ead2afc3-bb97-463c-bdd6-0598d7eabcf2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.156307 Jul 20 19:36:59.723001 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 741/1372] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:59 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:36:59.727532 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-b2fb59b4-0a0f-4512-b8ef-d0443601f3ee tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:59.728137 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-b2fb59b4-0a0f-4512-b8ef-d0443601f3ee tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:59.733902 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b2fb59b4-0a0f-4512-b8ef-d0443601f3ee tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:59.734351 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b2fb59b4-0a0f-4512-b8ef-d0443601f3ee tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:59.735115 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b2fb59b4-0a0f-4512-b8ef-d0443601f3ee tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:59.735551 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b2fb59b4-0a0f-4512-b8ef-d0443601f3ee tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:59.796625 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-b2fb59b4-0a0f-4512-b8ef-d0443601f3ee tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:59.804812 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-b2fb59b4-0a0f-4512-b8ef-d0443601f3ee tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080880 Jul 20 19:36:59.805365 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 742/1373] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:59 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:00.741384 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c5562bae-66f2-4b11-93cd-9f2a88cd2c0d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:00.742100 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c5562bae-66f2-4b11-93cd-9f2a88cd2c0d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:00.748464 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c5562bae-66f2-4b11-93cd-9f2a88cd2c0d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:00.748915 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c5562bae-66f2-4b11-93cd-9f2a88cd2c0d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:00.749728 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c5562bae-66f2-4b11-93cd-9f2a88cd2c0d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:00.750155 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c5562bae-66f2-4b11-93cd-9f2a88cd2c0d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:00.883261 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c5562bae-66f2-4b11-93cd-9f2a88cd2c0d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:00.890925 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c5562bae-66f2-4b11-93cd-9f2a88cd2c0d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.154012 Jul 20 19:37:00.891491 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 743/1374] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:00 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:00.895823 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d9c31542-19fc-440f-b164-004dc596e58b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:00.896418 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d9c31542-19fc-440f-b164-004dc596e58b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:00.901975 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d9c31542-19fc-440f-b164-004dc596e58b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:00.902419 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d9c31542-19fc-440f-b164-004dc596e58b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:00.903180 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d9c31542-19fc-440f-b164-004dc596e58b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:00.903613 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d9c31542-19fc-440f-b164-004dc596e58b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:00.963913 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d9c31542-19fc-440f-b164-004dc596e58b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:00.972001 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d9c31542-19fc-440f-b164-004dc596e58b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.079564 Jul 20 19:37:00.972580 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 744/1375] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:00 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:01.908029 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-db4436e4-16a4-4f1e-9332-b9f9eb1d4a3b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:01.908910 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-db4436e4-16a4-4f1e-9332-b9f9eb1d4a3b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:01.916103 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-db4436e4-16a4-4f1e-9332-b9f9eb1d4a3b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:01.916549 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-db4436e4-16a4-4f1e-9332-b9f9eb1d4a3b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:01.917345 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-db4436e4-16a4-4f1e-9332-b9f9eb1d4a3b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:01.917816 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-db4436e4-16a4-4f1e-9332-b9f9eb1d4a3b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:02.056115 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-db4436e4-16a4-4f1e-9332-b9f9eb1d4a3b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:02.063869 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-db4436e4-16a4-4f1e-9332-b9f9eb1d4a3b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.159670 Jul 20 19:37:02.064479 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 745/1376] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:01 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:37:02.069315 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-bde180db-aebb-48ae-8fef-ffbd10f1b065 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:02.069951 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-bde180db-aebb-48ae-8fef-ffbd10f1b065 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:02.075744 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bde180db-aebb-48ae-8fef-ffbd10f1b065 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:02.076197 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bde180db-aebb-48ae-8fef-ffbd10f1b065 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:02.076961 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bde180db-aebb-48ae-8fef-ffbd10f1b065 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:02.077397 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bde180db-aebb-48ae-8fef-ffbd10f1b065 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:02.081675 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:02.142085 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-bde180db-aebb-48ae-8fef-ffbd10f1b065 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:02.152423 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-bde180db-aebb-48ae-8fef-ffbd10f1b065 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.086965 Jul 20 19:37:02.153229 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 746/1377] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:02 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:03.081331 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-55f6c448-a63d-445c-aa7e-b403ded5f910 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:03.082115 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-55f6c448-a63d-445c-aa7e-b403ded5f910 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:03.088583 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-55f6c448-a63d-445c-aa7e-b403ded5f910 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:03.089032 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-55f6c448-a63d-445c-aa7e-b403ded5f910 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:03.089820 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-55f6c448-a63d-445c-aa7e-b403ded5f910 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:03.090251 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-55f6c448-a63d-445c-aa7e-b403ded5f910 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:03.226080 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-55f6c448-a63d-445c-aa7e-b403ded5f910 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:03.233441 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-55f6c448-a63d-445c-aa7e-b403ded5f910 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.156333 Jul 20 19:37:03.234025 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 747/1378] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:03 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:37:03.239361 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d8b05205-7253-45e5-960b-c8c422a17dd6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:03.239946 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d8b05205-7253-45e5-960b-c8c422a17dd6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:03.245707 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d8b05205-7253-45e5-960b-c8c422a17dd6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:03.246147 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d8b05205-7253-45e5-960b-c8c422a17dd6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:03.246899 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d8b05205-7253-45e5-960b-c8c422a17dd6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:03.247328 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d8b05205-7253-45e5-960b-c8c422a17dd6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:03.309910 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d8b05205-7253-45e5-960b-c8c422a17dd6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:03.317944 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d8b05205-7253-45e5-960b-c8c422a17dd6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.082912 Jul 20 19:37:03.318738 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 748/1379] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:03 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:04.251247 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-18cea5c2-da75-4152-b009-30c1ee8252a6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:04.252372 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-18cea5c2-da75-4152-b009-30c1ee8252a6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:04.258833 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-18cea5c2-da75-4152-b009-30c1ee8252a6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:04.259280 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-18cea5c2-da75-4152-b009-30c1ee8252a6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:04.260050 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-18cea5c2-da75-4152-b009-30c1ee8252a6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:04.260484 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-18cea5c2-da75-4152-b009-30c1ee8252a6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:04.395260 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-18cea5c2-da75-4152-b009-30c1ee8252a6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:04.402932 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-18cea5c2-da75-4152-b009-30c1ee8252a6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.155630 Jul 20 19:37:04.403502 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 749/1380] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:04 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:04.407970 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-b0b9c3fd-8683-4dae-b90c-417c510ef731 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:04.408649 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-b0b9c3fd-8683-4dae-b90c-417c510ef731 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:04.414467 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b0b9c3fd-8683-4dae-b90c-417c510ef731 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:04.414912 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b0b9c3fd-8683-4dae-b90c-417c510ef731 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:04.415679 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b0b9c3fd-8683-4dae-b90c-417c510ef731 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:04.416107 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b0b9c3fd-8683-4dae-b90c-417c510ef731 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:04.488496 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-b0b9c3fd-8683-4dae-b90c-417c510ef731 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:04.496215 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-b0b9c3fd-8683-4dae-b90c-417c510ef731 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.091762 Jul 20 19:37:04.496775 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 750/1381] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:04 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:05.419818 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-51738969-5e75-4948-b6b7-add12452bfb0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:05.420412 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-51738969-5e75-4948-b6b7-add12452bfb0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:05.438083 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-51738969-5e75-4948-b6b7-add12452bfb0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:05.438524 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-51738969-5e75-4948-b6b7-add12452bfb0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:05.439287 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-51738969-5e75-4948-b6b7-add12452bfb0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:05.439824 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-51738969-5e75-4948-b6b7-add12452bfb0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:05.572047 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-51738969-5e75-4948-b6b7-add12452bfb0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:05.579455 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-51738969-5e75-4948-b6b7-add12452bfb0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.163415 Jul 20 19:37:05.580460 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 751/1382] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:05 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:37:05.587603 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4f3ad99c-c1d8-4ebc-a53b-c09692ff5351 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:05.588646 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-4f3ad99c-c1d8-4ebc-a53b-c09692ff5351 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:05.595433 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4f3ad99c-c1d8-4ebc-a53b-c09692ff5351 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:05.596951 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4f3ad99c-c1d8-4ebc-a53b-c09692ff5351 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:05.597591 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4f3ad99c-c1d8-4ebc-a53b-c09692ff5351 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:05.598031 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4f3ad99c-c1d8-4ebc-a53b-c09692ff5351 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:05.660255 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-4f3ad99c-c1d8-4ebc-a53b-c09692ff5351 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:05.668037 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-4f3ad99c-c1d8-4ebc-a53b-c09692ff5351 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.086227 Jul 20 19:37:05.668634 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 752/1383] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:05 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:06.597967 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-86839ab3-4677-4472-84f2-ade0d82bfdc4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:06.598604 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-86839ab3-4677-4472-84f2-ade0d82bfdc4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:06.605469 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-86839ab3-4677-4472-84f2-ade0d82bfdc4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:06.605936 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-86839ab3-4677-4472-84f2-ade0d82bfdc4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:06.606700 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-86839ab3-4677-4472-84f2-ade0d82bfdc4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:06.607132 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-86839ab3-4677-4472-84f2-ade0d82bfdc4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:06.750532 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-86839ab3-4677-4472-84f2-ade0d82bfdc4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:06.759301 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-86839ab3-4677-4472-84f2-ade0d82bfdc4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.165723 Jul 20 19:37:06.759894 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 753/1384] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:06 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:37:06.764880 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-94c7c818-9028-4c62-b639-5b40f4e3dbe2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:06.765497 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-94c7c818-9028-4c62-b639-5b40f4e3dbe2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:06.772676 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-94c7c818-9028-4c62-b639-5b40f4e3dbe2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:06.773280 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-94c7c818-9028-4c62-b639-5b40f4e3dbe2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:06.774066 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-94c7c818-9028-4c62-b639-5b40f4e3dbe2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:06.774513 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-94c7c818-9028-4c62-b639-5b40f4e3dbe2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:06.841023 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-94c7c818-9028-4c62-b639-5b40f4e3dbe2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:06.848959 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-94c7c818-9028-4c62-b639-5b40f4e3dbe2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.088086 Jul 20 19:37:06.849541 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 754/1385] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:06 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:07.777922 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-9e3a90ed-bb5f-4b99-8714-dd8bae7cc088 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:07.778615 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-9e3a90ed-bb5f-4b99-8714-dd8bae7cc088 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:07.785826 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9e3a90ed-bb5f-4b99-8714-dd8bae7cc088 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:07.786275 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9e3a90ed-bb5f-4b99-8714-dd8bae7cc088 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:07.787099 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9e3a90ed-bb5f-4b99-8714-dd8bae7cc088 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:07.787532 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9e3a90ed-bb5f-4b99-8714-dd8bae7cc088 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:07.921939 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-9e3a90ed-bb5f-4b99-8714-dd8bae7cc088 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:07.929656 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-9e3a90ed-bb5f-4b99-8714-dd8bae7cc088 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.155613 Jul 20 19:37:07.930237 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 755/1386] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:07 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:37:07.934850 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-b53c72e8-e5a2-4647-bc42-5c5b5d675132 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:07.935449 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-b53c72e8-e5a2-4647-bc42-5c5b5d675132 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:07.941995 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b53c72e8-e5a2-4647-bc42-5c5b5d675132 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:07.942443 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b53c72e8-e5a2-4647-bc42-5c5b5d675132 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:07.943237 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b53c72e8-e5a2-4647-bc42-5c5b5d675132 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:07.943670 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b53c72e8-e5a2-4647-bc42-5c5b5d675132 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:08.159171 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-b53c72e8-e5a2-4647-bc42-5c5b5d675132 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:08.166640 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-b53c72e8-e5a2-4647-bc42-5c5b5d675132 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.235449 Jul 20 19:37:08.167411 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 756/1387] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:07 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:08.946729 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a95cbb48-e038-4eda-ae1b-44b4a21fe3e4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:08.947388 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a95cbb48-e038-4eda-ae1b-44b4a21fe3e4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:08.953757 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a95cbb48-e038-4eda-ae1b-44b4a21fe3e4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:08.954199 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a95cbb48-e038-4eda-ae1b-44b4a21fe3e4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:08.954954 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a95cbb48-e038-4eda-ae1b-44b4a21fe3e4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:08.955381 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a95cbb48-e038-4eda-ae1b-44b4a21fe3e4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:09.089019 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a95cbb48-e038-4eda-ae1b-44b4a21fe3e4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:09.097487 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a95cbb48-e038-4eda-ae1b-44b4a21fe3e4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.154593 Jul 20 19:37:09.098062 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 757/1388] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:08 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:37:09.184517 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-262d1914-aa8a-4591-a746-a5395e401c14 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:09.185120 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-262d1914-aa8a-4591-a746-a5395e401c14 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:09.191217 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-262d1914-aa8a-4591-a746-a5395e401c14 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:09.191661 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-262d1914-aa8a-4591-a746-a5395e401c14 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:09.192428 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-262d1914-aa8a-4591-a746-a5395e401c14 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:09.192863 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-262d1914-aa8a-4591-a746-a5395e401c14 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:09.255270 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-262d1914-aa8a-4591-a746-a5395e401c14 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:09.268446 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-262d1914-aa8a-4591-a746-a5395e401c14 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.087029 Jul 20 19:37:09.269346 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 758/1389] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:09 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:37:10.115470 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ab1ff12b-e7a7-4f3c-86b9-069b5dd329f2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:10.116244 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ab1ff12b-e7a7-4f3c-86b9-069b5dd329f2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:10.122597 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ab1ff12b-e7a7-4f3c-86b9-069b5dd329f2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:10.123052 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ab1ff12b-e7a7-4f3c-86b9-069b5dd329f2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:10.123819 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ab1ff12b-e7a7-4f3c-86b9-069b5dd329f2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:10.124255 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ab1ff12b-e7a7-4f3c-86b9-069b5dd329f2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:10.257872 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ab1ff12b-e7a7-4f3c-86b9-069b5dd329f2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:10.265811 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ab1ff12b-e7a7-4f3c-86b9-069b5dd329f2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.154990 Jul 20 19:37:10.266384 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 759/1390] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:10 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:37:10.287633 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-57e023e6-c695-4530-b2fc-dde2eb39c6cf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:10.288297 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-57e023e6-c695-4530-b2fc-dde2eb39c6cf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:10.294550 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-57e023e6-c695-4530-b2fc-dde2eb39c6cf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:10.295030 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-57e023e6-c695-4530-b2fc-dde2eb39c6cf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:10.295805 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-57e023e6-c695-4530-b2fc-dde2eb39c6cf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:10.296247 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-57e023e6-c695-4530-b2fc-dde2eb39c6cf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:10.359241 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-57e023e6-c695-4530-b2fc-dde2eb39c6cf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:10.367624 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-57e023e6-c695-4530-b2fc-dde2eb39c6cf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.084376 Jul 20 19:37:10.368119 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 760/1391] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:10 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:37:11.283834 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c32ba7ad-234b-48e0-82da-2160c0412f73 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:11.284563 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c32ba7ad-234b-48e0-82da-2160c0412f73 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:11.291196 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c32ba7ad-234b-48e0-82da-2160c0412f73 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:11.291649 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c32ba7ad-234b-48e0-82da-2160c0412f73 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:11.292452 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c32ba7ad-234b-48e0-82da-2160c0412f73 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:11.292889 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c32ba7ad-234b-48e0-82da-2160c0412f73 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:11.427182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c32ba7ad-234b-48e0-82da-2160c0412f73 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:11.434818 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c32ba7ad-234b-48e0-82da-2160c0412f73 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.154853 Jul 20 19:37:11.435379 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 761/1392] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:11 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:11.439773 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-f8cd30ec-279d-497d-aa35-319abb67987f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:11.440369 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-f8cd30ec-279d-497d-aa35-319abb67987f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:11.446155 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f8cd30ec-279d-497d-aa35-319abb67987f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:11.446602 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f8cd30ec-279d-497d-aa35-319abb67987f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:11.447358 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f8cd30ec-279d-497d-aa35-319abb67987f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:11.447782 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f8cd30ec-279d-497d-aa35-319abb67987f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:11.511312 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-f8cd30ec-279d-497d-aa35-319abb67987f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:11.513661 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:11.520333 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-f8cd30ec-279d-497d-aa35-319abb67987f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.083962 Jul 20 19:37:11.520893 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 762/1393] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:11 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:12.453031 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-5f81f9b6-495b-4fcb-8134-05dddd5ee645 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:12.453710 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-5f81f9b6-495b-4fcb-8134-05dddd5ee645 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:12.461294 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5f81f9b6-495b-4fcb-8134-05dddd5ee645 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:12.461779 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5f81f9b6-495b-4fcb-8134-05dddd5ee645 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:12.462553 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5f81f9b6-495b-4fcb-8134-05dddd5ee645 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:12.462983 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5f81f9b6-495b-4fcb-8134-05dddd5ee645 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:12.608062 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-5f81f9b6-495b-4fcb-8134-05dddd5ee645 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:12.616439 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-5f81f9b6-495b-4fcb-8134-05dddd5ee645 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.167571 Jul 20 19:37:12.617006 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 763/1394] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:12 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:37:12.621643 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-95e90aff-2ebb-4040-a9d6-faddc91b581b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:12.622168 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-95e90aff-2ebb-4040-a9d6-faddc91b581b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:12.628814 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-95e90aff-2ebb-4040-a9d6-faddc91b581b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:12.629271 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-95e90aff-2ebb-4040-a9d6-faddc91b581b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:12.630080 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-95e90aff-2ebb-4040-a9d6-faddc91b581b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:12.630520 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-95e90aff-2ebb-4040-a9d6-faddc91b581b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:12.694287 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-95e90aff-2ebb-4040-a9d6-faddc91b581b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:12.703148 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-95e90aff-2ebb-4040-a9d6-faddc91b581b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.085137 Jul 20 19:37:12.703728 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 764/1395] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:12 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:13.634192 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-33ea379b-2de1-4900-a1c7-328ea04d0f42 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:13.634817 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-33ea379b-2de1-4900-a1c7-328ea04d0f42 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:13.641487 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-33ea379b-2de1-4900-a1c7-328ea04d0f42 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:13.641961 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-33ea379b-2de1-4900-a1c7-328ea04d0f42 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:13.643574 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-33ea379b-2de1-4900-a1c7-328ea04d0f42 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:13.644014 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-33ea379b-2de1-4900-a1c7-328ea04d0f42 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:13.783514 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-33ea379b-2de1-4900-a1c7-328ea04d0f42 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:13.791562 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-33ea379b-2de1-4900-a1c7-328ea04d0f42 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.161308 Jul 20 19:37:13.792143 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 765/1396] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:13 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:37:13.796859 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-28ecdde1-cfe2-41ea-8189-4b026dfc1623 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:13.797636 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-28ecdde1-cfe2-41ea-8189-4b026dfc1623 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:13.804663 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-28ecdde1-cfe2-41ea-8189-4b026dfc1623 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:13.805186 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-28ecdde1-cfe2-41ea-8189-4b026dfc1623 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:13.805988 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-28ecdde1-cfe2-41ea-8189-4b026dfc1623 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:13.806420 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-28ecdde1-cfe2-41ea-8189-4b026dfc1623 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:14.112983 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-28ecdde1-cfe2-41ea-8189-4b026dfc1623 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:14.120762 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-28ecdde1-cfe2-41ea-8189-4b026dfc1623 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.327363 Jul 20 19:37:14.121454 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 766/1397] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:13 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:14.810207 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c00b24a3-f39c-4e5c-9ade-275e95a9318e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:14.810867 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c00b24a3-f39c-4e5c-9ade-275e95a9318e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:14.818061 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c00b24a3-f39c-4e5c-9ade-275e95a9318e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:14.818518 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c00b24a3-f39c-4e5c-9ade-275e95a9318e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:14.819310 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c00b24a3-f39c-4e5c-9ade-275e95a9318e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:14.819744 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c00b24a3-f39c-4e5c-9ade-275e95a9318e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:14.956858 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c00b24a3-f39c-4e5c-9ade-275e95a9318e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:14.964357 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c00b24a3-f39c-4e5c-9ade-275e95a9318e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.158261 Jul 20 19:37:14.965181 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 767/1398] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:14 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:37:15.138039 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-3ff88ef4-e3e4-48ad-8f53-917559b0aaaf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:15.138560 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-3ff88ef4-e3e4-48ad-8f53-917559b0aaaf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:15.145317 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3ff88ef4-e3e4-48ad-8f53-917559b0aaaf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:15.145791 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3ff88ef4-e3e4-48ad-8f53-917559b0aaaf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:15.146572 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3ff88ef4-e3e4-48ad-8f53-917559b0aaaf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:15.147011 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3ff88ef4-e3e4-48ad-8f53-917559b0aaaf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:15.208646 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3ff88ef4-e3e4-48ad-8f53-917559b0aaaf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:15.222651 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-3ff88ef4-e3e4-48ad-8f53-917559b0aaaf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.088456 Jul 20 19:37:15.223326 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 768/1399] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:15 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:37:15.981558 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-06bf3c18-9e4d-4675-96f3-fee8fe7cc9a3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:15.982246 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-06bf3c18-9e4d-4675-96f3-fee8fe7cc9a3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:15.984420 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_api:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:15.989965 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-06bf3c18-9e4d-4675-96f3-fee8fe7cc9a3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:15.990409 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-06bf3c18-9e4d-4675-96f3-fee8fe7cc9a3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:15.991169 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-06bf3c18-9e4d-4675-96f3-fee8fe7cc9a3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:15.991593 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-06bf3c18-9e4d-4675-96f3-fee8fe7cc9a3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:16.131886 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-06bf3c18-9e4d-4675-96f3-fee8fe7cc9a3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:16.139379 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-06bf3c18-9e4d-4675-96f3-fee8fe7cc9a3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.161731 Jul 20 19:37:16.139939 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 769/1400] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:15 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:37:16.239879 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-1ba65bfa-8179-4995-9354-38b3038fb1ce tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:16.240404 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-1ba65bfa-8179-4995-9354-38b3038fb1ce tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:16.246431 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1ba65bfa-8179-4995-9354-38b3038fb1ce tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:16.246866 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1ba65bfa-8179-4995-9354-38b3038fb1ce tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:16.247637 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1ba65bfa-8179-4995-9354-38b3038fb1ce tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:16.248075 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1ba65bfa-8179-4995-9354-38b3038fb1ce tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:16.310560 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1ba65bfa-8179-4995-9354-38b3038fb1ce tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:16.319233 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-1ba65bfa-8179-4995-9354-38b3038fb1ce tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.083495 Jul 20 19:37:16.319813 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 770/1401] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:16 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:37:17.158386 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-345074f6-3597-4ed5-a6f2-b05bfa042eed tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:17.159166 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-345074f6-3597-4ed5-a6f2-b05bfa042eed tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:17.166424 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-345074f6-3597-4ed5-a6f2-b05bfa042eed tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:17.166876 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-345074f6-3597-4ed5-a6f2-b05bfa042eed tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:17.167652 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-345074f6-3597-4ed5-a6f2-b05bfa042eed tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:17.168122 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-345074f6-3597-4ed5-a6f2-b05bfa042eed tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:17.310024 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-345074f6-3597-4ed5-a6f2-b05bfa042eed tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:17.318278 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-345074f6-3597-4ed5-a6f2-b05bfa042eed tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.164621 Jul 20 19:37:17.319055 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 771/1402] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:17 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:37:17.336354 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-534a36a8-1bb9-49c1-9465-e82eb91b69b0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:17.336993 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-534a36a8-1bb9-49c1-9465-e82eb91b69b0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:17.343559 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-534a36a8-1bb9-49c1-9465-e82eb91b69b0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:17.344005 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-534a36a8-1bb9-49c1-9465-e82eb91b69b0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:17.344763 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-534a36a8-1bb9-49c1-9465-e82eb91b69b0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:17.345258 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-534a36a8-1bb9-49c1-9465-e82eb91b69b0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:17.410659 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-534a36a8-1bb9-49c1-9465-e82eb91b69b0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:17.418527 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-534a36a8-1bb9-49c1-9465-e82eb91b69b0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.085914 Jul 20 19:37:17.419090 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 772/1403] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:17 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:37:18.336945 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-19c95676-c116-428f-be2e-cb8c86b7848e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:18.337622 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-19c95676-c116-428f-be2e-cb8c86b7848e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:18.345218 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-19c95676-c116-428f-be2e-cb8c86b7848e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:18.346841 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-19c95676-c116-428f-be2e-cb8c86b7848e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:18.347172 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-19c95676-c116-428f-be2e-cb8c86b7848e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:18.347608 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-19c95676-c116-428f-be2e-cb8c86b7848e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:18.487895 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-19c95676-c116-428f-be2e-cb8c86b7848e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:18.495750 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-19c95676-c116-428f-be2e-cb8c86b7848e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.162838 Jul 20 19:37:18.496365 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 773/1404] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:18 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:37:18.501192 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-56b12f94-b7fb-4c58-a79f-09eb372d793c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:18.502510 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-56b12f94-b7fb-4c58-a79f-09eb372d793c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:18.508877 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-56b12f94-b7fb-4c58-a79f-09eb372d793c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:18.509293 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-56b12f94-b7fb-4c58-a79f-09eb372d793c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:18.510240 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-56b12f94-b7fb-4c58-a79f-09eb372d793c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:18.510676 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-56b12f94-b7fb-4c58-a79f-09eb372d793c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:18.575920 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-56b12f94-b7fb-4c58-a79f-09eb372d793c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:18.584509 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-56b12f94-b7fb-4c58-a79f-09eb372d793c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.086980 Jul 20 19:37:18.585233 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 774/1405] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:18 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:19.513310 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-2b6fc0a0-11eb-437b-9eed-48b780ed18b2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:19.514210 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-2b6fc0a0-11eb-437b-9eed-48b780ed18b2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:19.521335 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2b6fc0a0-11eb-437b-9eed-48b780ed18b2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:19.521807 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2b6fc0a0-11eb-437b-9eed-48b780ed18b2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:19.522568 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2b6fc0a0-11eb-437b-9eed-48b780ed18b2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:19.523000 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2b6fc0a0-11eb-437b-9eed-48b780ed18b2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:19.658603 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-2b6fc0a0-11eb-437b-9eed-48b780ed18b2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:19.666287 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-2b6fc0a0-11eb-437b-9eed-48b780ed18b2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.156781 Jul 20 19:37:19.666865 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 775/1406] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:19 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:37:19.671359 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-44b46a6f-725b-42db-86d8-fcd4790958af tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:19.671963 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-44b46a6f-725b-42db-86d8-fcd4790958af tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:19.678469 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-44b46a6f-725b-42db-86d8-fcd4790958af tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:19.678919 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-44b46a6f-725b-42db-86d8-fcd4790958af tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:19.679691 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-44b46a6f-725b-42db-86d8-fcd4790958af tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:19.680124 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-44b46a6f-725b-42db-86d8-fcd4790958af tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:19.741005 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-44b46a6f-725b-42db-86d8-fcd4790958af tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:19.748801 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-44b46a6f-725b-42db-86d8-fcd4790958af tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080984 Jul 20 19:37:19.749361 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 776/1407] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:19 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:20.684856 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-7c3e9d7a-878a-4ceb-a26a-631ad6d4f10a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:20.685632 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-7c3e9d7a-878a-4ceb-a26a-631ad6d4f10a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:20.692315 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7c3e9d7a-878a-4ceb-a26a-631ad6d4f10a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:20.692768 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7c3e9d7a-878a-4ceb-a26a-631ad6d4f10a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:20.693577 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7c3e9d7a-878a-4ceb-a26a-631ad6d4f10a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:20.694020 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7c3e9d7a-878a-4ceb-a26a-631ad6d4f10a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:20.844831 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-7c3e9d7a-878a-4ceb-a26a-631ad6d4f10a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:20.853839 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-7c3e9d7a-878a-4ceb-a26a-631ad6d4f10a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.173149 Jul 20 19:37:20.854622 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 777/1408] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:20 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:37:20.859333 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-bfdf8020-5dbc-4a38-9c6c-e27b94f4538a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:20.859948 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-bfdf8020-5dbc-4a38-9c6c-e27b94f4538a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:20.866116 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bfdf8020-5dbc-4a38-9c6c-e27b94f4538a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:20.866573 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bfdf8020-5dbc-4a38-9c6c-e27b94f4538a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:20.867416 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bfdf8020-5dbc-4a38-9c6c-e27b94f4538a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:20.867855 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bfdf8020-5dbc-4a38-9c6c-e27b94f4538a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:20.931591 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-bfdf8020-5dbc-4a38-9c6c-e27b94f4538a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:20.941771 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-bfdf8020-5dbc-4a38-9c6c-e27b94f4538a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.085927 Jul 20 19:37:20.942268 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 778/1409] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:20 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:21.870924 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-0b89205b-39e2-4d3b-b666-441caede7335 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:21.871625 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-0b89205b-39e2-4d3b-b666-441caede7335 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:21.878087 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0b89205b-39e2-4d3b-b666-441caede7335 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:21.878453 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0b89205b-39e2-4d3b-b666-441caede7335 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:21.879210 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0b89205b-39e2-4d3b-b666-441caede7335 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:21.879633 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0b89205b-39e2-4d3b-b666-441caede7335 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:21.895710 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:22.012837 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0b89205b-39e2-4d3b-b666-441caede7335 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:22.021081 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-0b89205b-39e2-4d3b-b666-441caede7335 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.154078 Jul 20 19:37:22.021666 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 779/1410] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:21 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:37:22.026093 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-fe056002-91cc-43f2-bf73-25b829b671ae tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:22.026684 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-fe056002-91cc-43f2-bf73-25b829b671ae tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:22.032477 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fe056002-91cc-43f2-bf73-25b829b671ae tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:22.032918 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fe056002-91cc-43f2-bf73-25b829b671ae tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:22.034392 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fe056002-91cc-43f2-bf73-25b829b671ae tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:22.035057 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fe056002-91cc-43f2-bf73-25b829b671ae tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:22.095332 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-fe056002-91cc-43f2-bf73-25b829b671ae tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:22.103928 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-fe056002-91cc-43f2-bf73-25b829b671ae tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.081265 Jul 20 19:37:22.104497 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 780/1411] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:22 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:23.038426 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-efd75f01-5ef2-446c-b96d-57be5928378e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:23.039072 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-efd75f01-5ef2-446c-b96d-57be5928378e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:23.045711 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-efd75f01-5ef2-446c-b96d-57be5928378e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:23.046153 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-efd75f01-5ef2-446c-b96d-57be5928378e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:23.046911 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-efd75f01-5ef2-446c-b96d-57be5928378e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:23.047335 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-efd75f01-5ef2-446c-b96d-57be5928378e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:23.116428 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 19:37:23.116675 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Wed Jul 20 19:37:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 (ip 10.222.0.69) !!! Jul 20 19:37:23.184453 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-efd75f01-5ef2-446c-b96d-57be5928378e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:23.193289 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-efd75f01-5ef2-446c-b96d-57be5928378e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.158814 Jul 20 19:37:23.193894 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 781/1412] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:23 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:37:23.198338 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-61a62ef3-f935-4e9a-88c6-ab770e9f2830 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:23.198932 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-61a62ef3-f935-4e9a-88c6-ab770e9f2830 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:23.204644 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-61a62ef3-f935-4e9a-88c6-ab770e9f2830 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:23.205084 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-61a62ef3-f935-4e9a-88c6-ab770e9f2830 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:23.206458 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-61a62ef3-f935-4e9a-88c6-ab770e9f2830 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:23.206885 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-61a62ef3-f935-4e9a-88c6-ab770e9f2830 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:23.267794 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-61a62ef3-f935-4e9a-88c6-ab770e9f2830 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:23.276219 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-61a62ef3-f935-4e9a-88c6-ab770e9f2830 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.081325 Jul 20 19:37:23.276810 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 782/1413] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:23 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:24.210271 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-cf809914-1e08-44dc-9117-a400e0169690 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:24.210959 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-cf809914-1e08-44dc-9117-a400e0169690 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:24.217760 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cf809914-1e08-44dc-9117-a400e0169690 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:24.218212 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cf809914-1e08-44dc-9117-a400e0169690 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:24.218980 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cf809914-1e08-44dc-9117-a400e0169690 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:24.219413 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cf809914-1e08-44dc-9117-a400e0169690 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:24.358213 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-cf809914-1e08-44dc-9117-a400e0169690 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:24.366669 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-cf809914-1e08-44dc-9117-a400e0169690 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.160259 Jul 20 19:37:24.367232 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 783/1414] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:24 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:37:24.371696 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a5048105-7763-4886-85ee-0d2dbe14b20b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:24.372295 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a5048105-7763-4886-85ee-0d2dbe14b20b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:24.379688 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a5048105-7763-4886-85ee-0d2dbe14b20b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:24.380172 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a5048105-7763-4886-85ee-0d2dbe14b20b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:24.380990 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a5048105-7763-4886-85ee-0d2dbe14b20b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:24.381433 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a5048105-7763-4886-85ee-0d2dbe14b20b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:24.445050 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a5048105-7763-4886-85ee-0d2dbe14b20b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:24.452690 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a5048105-7763-4886-85ee-0d2dbe14b20b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.084488 Jul 20 19:37:24.453223 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 784/1415] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:24 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:25.383302 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-3179fc85-98cd-40a4-a776-506497ac806d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:25.383963 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-3179fc85-98cd-40a4-a776-506497ac806d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:25.390517 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3179fc85-98cd-40a4-a776-506497ac806d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:25.390964 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3179fc85-98cd-40a4-a776-506497ac806d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:25.391733 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3179fc85-98cd-40a4-a776-506497ac806d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:25.392167 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3179fc85-98cd-40a4-a776-506497ac806d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:25.526116 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3179fc85-98cd-40a4-a776-506497ac806d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:25.534002 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-3179fc85-98cd-40a4-a776-506497ac806d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.154328 Jul 20 19:37:25.534590 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 785/1416] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:25 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:37:25.539237 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-db88484b-8aa6-4a08-af7f-b471875375e0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:25.539848 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-db88484b-8aa6-4a08-af7f-b471875375e0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:25.545818 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-db88484b-8aa6-4a08-af7f-b471875375e0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:25.546498 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-db88484b-8aa6-4a08-af7f-b471875375e0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:25.547277 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-db88484b-8aa6-4a08-af7f-b471875375e0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:25.547709 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-db88484b-8aa6-4a08-af7f-b471875375e0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:25.614536 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-db88484b-8aa6-4a08-af7f-b471875375e0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:25.622037 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-db88484b-8aa6-4a08-af7f-b471875375e0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.086490 Jul 20 19:37:25.622610 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 786/1417] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:25 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:26.554968 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4617c5b8-96cc-490b-ab06-92937cc50aba tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:26.555751 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-4617c5b8-96cc-490b-ab06-92937cc50aba tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:26.563240 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4617c5b8-96cc-490b-ab06-92937cc50aba tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:26.563681 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4617c5b8-96cc-490b-ab06-92937cc50aba tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:26.564429 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4617c5b8-96cc-490b-ab06-92937cc50aba tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:26.564858 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4617c5b8-96cc-490b-ab06-92937cc50aba tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:26.708137 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-4617c5b8-96cc-490b-ab06-92937cc50aba tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:26.715693 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-4617c5b8-96cc-490b-ab06-92937cc50aba tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.167689 Jul 20 19:37:26.716274 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 787/1418] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:26 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:37:26.721052 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-12a26e40-c5ac-47fd-b1f4-608524e914f0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:26.722251 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-12a26e40-c5ac-47fd-b1f4-608524e914f0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:26.728114 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-12a26e40-c5ac-47fd-b1f4-608524e914f0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:26.728557 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-12a26e40-c5ac-47fd-b1f4-608524e914f0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:26.729322 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-12a26e40-c5ac-47fd-b1f4-608524e914f0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:26.729782 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-12a26e40-c5ac-47fd-b1f4-608524e914f0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:26.794350 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-12a26e40-c5ac-47fd-b1f4-608524e914f0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:26.801968 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-12a26e40-c5ac-47fd-b1f4-608524e914f0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.084693 Jul 20 19:37:26.802537 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 788/1419] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:26 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:27.733462 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-0baf846e-b6c4-4235-bdfc-420e78679974 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:27.734186 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-0baf846e-b6c4-4235-bdfc-420e78679974 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:27.740778 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0baf846e-b6c4-4235-bdfc-420e78679974 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:27.741228 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0baf846e-b6c4-4235-bdfc-420e78679974 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:27.742025 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0baf846e-b6c4-4235-bdfc-420e78679974 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:27.742469 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0baf846e-b6c4-4235-bdfc-420e78679974 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:27.878454 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0baf846e-b6c4-4235-bdfc-420e78679974 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:27.886085 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-0baf846e-b6c4-4235-bdfc-420e78679974 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.156509 Jul 20 19:37:27.886653 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 789/1420] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:27 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:37:27.891081 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-3e9e47bb-cc5b-4cd1-8e48-cafa97b93627 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:27.891680 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-3e9e47bb-cc5b-4cd1-8e48-cafa97b93627 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:27.898156 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3e9e47bb-cc5b-4cd1-8e48-cafa97b93627 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:27.898592 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3e9e47bb-cc5b-4cd1-8e48-cafa97b93627 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:27.899341 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3e9e47bb-cc5b-4cd1-8e48-cafa97b93627 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:27.899769 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3e9e47bb-cc5b-4cd1-8e48-cafa97b93627 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:27.961018 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3e9e47bb-cc5b-4cd1-8e48-cafa97b93627 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:27.968828 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-3e9e47bb-cc5b-4cd1-8e48-cafa97b93627 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.081234 Jul 20 19:37:27.969380 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 790/1421] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:27 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:28.904176 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-911f7362-d095-4176-ab81-17fe4bc723b2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:28.904849 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-911f7362-d095-4176-ab81-17fe4bc723b2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:28.912499 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-911f7362-d095-4176-ab81-17fe4bc723b2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:28.912872 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-911f7362-d095-4176-ab81-17fe4bc723b2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:28.913670 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-911f7362-d095-4176-ab81-17fe4bc723b2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:28.914101 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-911f7362-d095-4176-ab81-17fe4bc723b2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:29.047847 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-911f7362-d095-4176-ab81-17fe4bc723b2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:29.055362 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-911f7362-d095-4176-ab81-17fe4bc723b2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.155042 Jul 20 19:37:29.056091 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 791/1422] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:28 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:37:29.060509 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-5e4cce46-a0eb-49eb-b8d7-f2e0e00c285a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:29.061116 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-5e4cce46-a0eb-49eb-b8d7-f2e0e00c285a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:29.066912 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5e4cce46-a0eb-49eb-b8d7-f2e0e00c285a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:29.067357 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5e4cce46-a0eb-49eb-b8d7-f2e0e00c285a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:29.068116 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5e4cce46-a0eb-49eb-b8d7-f2e0e00c285a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:29.068547 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5e4cce46-a0eb-49eb-b8d7-f2e0e00c285a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:29.145685 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-5e4cce46-a0eb-49eb-b8d7-f2e0e00c285a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:29.153888 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-5e4cce46-a0eb-49eb-b8d7-f2e0e00c285a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.096722 Jul 20 19:37:29.154468 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 792/1423] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:29 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:30.072957 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-8b6a953e-5c29-4af1-9df3-190d33d0c896 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:30.073658 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-8b6a953e-5c29-4af1-9df3-190d33d0c896 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:30.080001 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8b6a953e-5c29-4af1-9df3-190d33d0c896 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:30.081089 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8b6a953e-5c29-4af1-9df3-190d33d0c896 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:30.081947 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8b6a953e-5c29-4af1-9df3-190d33d0c896 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:30.082763 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8b6a953e-5c29-4af1-9df3-190d33d0c896 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:30.219838 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8b6a953e-5c29-4af1-9df3-190d33d0c896 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:30.227373 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-8b6a953e-5c29-4af1-9df3-190d33d0c896 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.158237 Jul 20 19:37:30.227927 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 793/1424] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:30 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:37:30.232317 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-56e59475-3acd-4b0f-a18f-8403771790b0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:30.232971 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-56e59475-3acd-4b0f-a18f-8403771790b0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:30.238919 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-56e59475-3acd-4b0f-a18f-8403771790b0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:30.239361 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-56e59475-3acd-4b0f-a18f-8403771790b0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:30.240118 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-56e59475-3acd-4b0f-a18f-8403771790b0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:30.240543 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-56e59475-3acd-4b0f-a18f-8403771790b0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:30.302457 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-56e59475-3acd-4b0f-a18f-8403771790b0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:30.310210 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-56e59475-3acd-4b0f-a18f-8403771790b0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.081333 Jul 20 19:37:30.310769 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 794/1425] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:30 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:31.244813 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-1425c0d5-39ec-4e66-9a09-a05d3cc76d13 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:31.245536 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-1425c0d5-39ec-4e66-9a09-a05d3cc76d13 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:31.251916 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1425c0d5-39ec-4e66-9a09-a05d3cc76d13 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:31.252362 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1425c0d5-39ec-4e66-9a09-a05d3cc76d13 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:31.253107 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1425c0d5-39ec-4e66-9a09-a05d3cc76d13 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:31.253549 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1425c0d5-39ec-4e66-9a09-a05d3cc76d13 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:31.388289 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1425c0d5-39ec-4e66-9a09-a05d3cc76d13 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:31.396368 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-1425c0d5-39ec-4e66-9a09-a05d3cc76d13 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.155441 Jul 20 19:37:31.396934 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 795/1426] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:31 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:37:31.401239 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-5e508620-2970-45f1-8d89-e977e3764f2e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:31.401888 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-5e508620-2970-45f1-8d89-e977e3764f2e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:31.407395 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5e508620-2970-45f1-8d89-e977e3764f2e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:31.407838 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5e508620-2970-45f1-8d89-e977e3764f2e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:31.409342 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5e508620-2970-45f1-8d89-e977e3764f2e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:31.409913 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5e508620-2970-45f1-8d89-e977e3764f2e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:31.413792 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:31.470427 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-5e508620-2970-45f1-8d89-e977e3764f2e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:31.478438 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-5e508620-2970-45f1-8d89-e977e3764f2e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080574 Jul 20 19:37:31.478991 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 796/1427] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:31 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:32.413941 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-cca0cf20-69e9-463a-a18d-6aaf3643997b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:32.414625 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-cca0cf20-69e9-463a-a18d-6aaf3643997b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:32.421216 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cca0cf20-69e9-463a-a18d-6aaf3643997b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:32.421691 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cca0cf20-69e9-463a-a18d-6aaf3643997b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:32.422450 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cca0cf20-69e9-463a-a18d-6aaf3643997b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:32.422872 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cca0cf20-69e9-463a-a18d-6aaf3643997b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:32.560151 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-cca0cf20-69e9-463a-a18d-6aaf3643997b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:32.568384 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-cca0cf20-69e9-463a-a18d-6aaf3643997b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.158624 Jul 20 19:37:32.568948 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 797/1428] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:32 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:37:32.573799 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-2e5b2e28-1060-4678-87bb-64f584242ab8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:32.574394 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-2e5b2e28-1060-4678-87bb-64f584242ab8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:32.580161 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2e5b2e28-1060-4678-87bb-64f584242ab8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:32.581287 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2e5b2e28-1060-4678-87bb-64f584242ab8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:32.582244 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2e5b2e28-1060-4678-87bb-64f584242ab8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:32.582614 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2e5b2e28-1060-4678-87bb-64f584242ab8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:32.644708 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-2e5b2e28-1060-4678-87bb-64f584242ab8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:32.652322 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-2e5b2e28-1060-4678-87bb-64f584242ab8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.082381 Jul 20 19:37:32.652894 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 798/1429] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:32 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:33.586028 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-6cb61d39-e0f6-42cd-96e1-4e233e841e01 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:33.586677 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-6cb61d39-e0f6-42cd-96e1-4e233e841e01 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:33.593163 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6cb61d39-e0f6-42cd-96e1-4e233e841e01 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:33.593645 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6cb61d39-e0f6-42cd-96e1-4e233e841e01 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:33.594403 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6cb61d39-e0f6-42cd-96e1-4e233e841e01 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:33.594829 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6cb61d39-e0f6-42cd-96e1-4e233e841e01 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:33.728532 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6cb61d39-e0f6-42cd-96e1-4e233e841e01 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:33.735878 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-6cb61d39-e0f6-42cd-96e1-4e233e841e01 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.153845 Jul 20 19:37:33.736443 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 799/1430] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:33 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:37:33.740762 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-1e90c5c5-2152-4593-b3d9-6468f3b44e5c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:33.741352 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-1e90c5c5-2152-4593-b3d9-6468f3b44e5c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:33.746875 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1e90c5c5-2152-4593-b3d9-6468f3b44e5c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:33.747315 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1e90c5c5-2152-4593-b3d9-6468f3b44e5c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:33.748059 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1e90c5c5-2152-4593-b3d9-6468f3b44e5c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:33.748484 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1e90c5c5-2152-4593-b3d9-6468f3b44e5c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:33.808559 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1e90c5c5-2152-4593-b3d9-6468f3b44e5c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:33.816452 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-1e90c5c5-2152-4593-b3d9-6468f3b44e5c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.079083 Jul 20 19:37:33.817001 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 800/1431] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:33 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:34.753372 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-0b7a55aa-492d-4b8d-bd28-751a26623bc6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:34.754102 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-0b7a55aa-492d-4b8d-bd28-751a26623bc6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:34.760844 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0b7a55aa-492d-4b8d-bd28-751a26623bc6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:34.761497 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0b7a55aa-492d-4b8d-bd28-751a26623bc6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:34.762308 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0b7a55aa-492d-4b8d-bd28-751a26623bc6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:34.762742 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0b7a55aa-492d-4b8d-bd28-751a26623bc6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:34.903449 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0b7a55aa-492d-4b8d-bd28-751a26623bc6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:34.912303 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-0b7a55aa-492d-4b8d-bd28-751a26623bc6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.163289 Jul 20 19:37:34.912879 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 801/1432] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:34 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:37:34.917381 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-2b134dfe-63f7-4c17-9d37-584f9782b47f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:34.918019 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-2b134dfe-63f7-4c17-9d37-584f9782b47f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:34.926860 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2b134dfe-63f7-4c17-9d37-584f9782b47f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:34.927315 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2b134dfe-63f7-4c17-9d37-584f9782b47f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:34.928091 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2b134dfe-63f7-4c17-9d37-584f9782b47f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:34.928523 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2b134dfe-63f7-4c17-9d37-584f9782b47f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:34.992988 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-2b134dfe-63f7-4c17-9d37-584f9782b47f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:35.000675 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-2b134dfe-63f7-4c17-9d37-584f9782b47f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.086839 Jul 20 19:37:35.001235 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 802/1433] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:34 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:35.929450 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4fc8b6d9-58a6-4489-be7e-ee93a38de90e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:35.930160 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-4fc8b6d9-58a6-4489-be7e-ee93a38de90e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:35.936618 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4fc8b6d9-58a6-4489-be7e-ee93a38de90e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:35.937072 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4fc8b6d9-58a6-4489-be7e-ee93a38de90e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:35.937879 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4fc8b6d9-58a6-4489-be7e-ee93a38de90e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:35.938318 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4fc8b6d9-58a6-4489-be7e-ee93a38de90e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:36.066974 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-4fc8b6d9-58a6-4489-be7e-ee93a38de90e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:36.074479 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-4fc8b6d9-58a6-4489-be7e-ee93a38de90e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.148879 Jul 20 19:37:36.075039 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 803/1434] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:35 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:37:36.079364 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-582ef1bf-0511-4d52-9077-9f61d90231b1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:36.079971 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-582ef1bf-0511-4d52-9077-9f61d90231b1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:36.086330 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-582ef1bf-0511-4d52-9077-9f61d90231b1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:36.086777 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-582ef1bf-0511-4d52-9077-9f61d90231b1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:36.087542 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-582ef1bf-0511-4d52-9077-9f61d90231b1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:36.087976 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-582ef1bf-0511-4d52-9077-9f61d90231b1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:36.149835 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-582ef1bf-0511-4d52-9077-9f61d90231b1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:36.157419 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-582ef1bf-0511-4d52-9077-9f61d90231b1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.081414 Jul 20 19:37:36.158022 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 804/1435] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:36 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:37.091949 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-63fb3553-8281-4196-a1cd-945c8f499846 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:37.092834 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-63fb3553-8281-4196-a1cd-945c8f499846 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:37.099918 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-63fb3553-8281-4196-a1cd-945c8f499846 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:37.100362 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-63fb3553-8281-4196-a1cd-945c8f499846 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:37.101122 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-63fb3553-8281-4196-a1cd-945c8f499846 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:37.101577 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-63fb3553-8281-4196-a1cd-945c8f499846 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:37.235185 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-63fb3553-8281-4196-a1cd-945c8f499846 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:37.243346 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-63fb3553-8281-4196-a1cd-945c8f499846 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.155261 Jul 20 19:37:37.243903 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 805/1436] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:37 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:37:37.248326 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d0dec7c0-0aa1-4e4f-bbba-8ebddf1dd095 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:37.248926 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d0dec7c0-0aa1-4e4f-bbba-8ebddf1dd095 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:37.255623 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d0dec7c0-0aa1-4e4f-bbba-8ebddf1dd095 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:37.256067 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d0dec7c0-0aa1-4e4f-bbba-8ebddf1dd095 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:37.256832 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d0dec7c0-0aa1-4e4f-bbba-8ebddf1dd095 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:37.257263 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d0dec7c0-0aa1-4e4f-bbba-8ebddf1dd095 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:37.317489 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d0dec7c0-0aa1-4e4f-bbba-8ebddf1dd095 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:37.324948 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d0dec7c0-0aa1-4e4f-bbba-8ebddf1dd095 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080096 Jul 20 19:37:37.325525 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 806/1437] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:37 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:38.260972 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d7d6b5e8-25fd-41a2-b36a-14b639c31843 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:38.261977 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d7d6b5e8-25fd-41a2-b36a-14b639c31843 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:38.268769 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d7d6b5e8-25fd-41a2-b36a-14b639c31843 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:38.269211 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d7d6b5e8-25fd-41a2-b36a-14b639c31843 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:38.270002 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d7d6b5e8-25fd-41a2-b36a-14b639c31843 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:38.270433 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d7d6b5e8-25fd-41a2-b36a-14b639c31843 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:38.407372 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d7d6b5e8-25fd-41a2-b36a-14b639c31843 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:38.414995 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d7d6b5e8-25fd-41a2-b36a-14b639c31843 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.157871 Jul 20 19:37:38.415561 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 807/1438] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:38 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:37:38.419953 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-7f305de2-dbf5-4c04-b632-f872f4830611 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:38.420548 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-7f305de2-dbf5-4c04-b632-f872f4830611 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:38.426622 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7f305de2-dbf5-4c04-b632-f872f4830611 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:38.427078 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7f305de2-dbf5-4c04-b632-f872f4830611 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:38.427881 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7f305de2-dbf5-4c04-b632-f872f4830611 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:38.428316 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7f305de2-dbf5-4c04-b632-f872f4830611 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:38.500383 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-7f305de2-dbf5-4c04-b632-f872f4830611 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:38.508847 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-7f305de2-dbf5-4c04-b632-f872f4830611 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.092354 Jul 20 19:37:38.509406 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 808/1439] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:38 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:39.432100 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-96691936-6b58-48dd-a4b4-2c2278d77339 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:39.432743 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-96691936-6b58-48dd-a4b4-2c2278d77339 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:39.439316 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-96691936-6b58-48dd-a4b4-2c2278d77339 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:39.439927 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-96691936-6b58-48dd-a4b4-2c2278d77339 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:39.440704 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-96691936-6b58-48dd-a4b4-2c2278d77339 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:39.441141 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-96691936-6b58-48dd-a4b4-2c2278d77339 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:39.572652 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-96691936-6b58-48dd-a4b4-2c2278d77339 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:39.580566 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-96691936-6b58-48dd-a4b4-2c2278d77339 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.151778 Jul 20 19:37:39.581372 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 809/1440] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:39 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:37:39.585755 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ba2a747c-8832-4e9a-9137-4160ef051b9d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:39.586359 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ba2a747c-8832-4e9a-9137-4160ef051b9d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:39.592073 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ba2a747c-8832-4e9a-9137-4160ef051b9d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:39.592522 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ba2a747c-8832-4e9a-9137-4160ef051b9d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:39.593562 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ba2a747c-8832-4e9a-9137-4160ef051b9d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:39.594005 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ba2a747c-8832-4e9a-9137-4160ef051b9d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:39.655791 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ba2a747c-8832-4e9a-9137-4160ef051b9d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:39.663800 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ba2a747c-8832-4e9a-9137-4160ef051b9d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.081568 Jul 20 19:37:39.664367 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 810/1441] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:39 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:40.598248 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-246ca9d5-2cf2-4ced-a4c7-bda7d5cce592 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:40.598867 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-246ca9d5-2cf2-4ced-a4c7-bda7d5cce592 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:40.605290 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-246ca9d5-2cf2-4ced-a4c7-bda7d5cce592 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:40.605781 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-246ca9d5-2cf2-4ced-a4c7-bda7d5cce592 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:40.606554 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-246ca9d5-2cf2-4ced-a4c7-bda7d5cce592 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:40.606988 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-246ca9d5-2cf2-4ced-a4c7-bda7d5cce592 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:40.742001 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-246ca9d5-2cf2-4ced-a4c7-bda7d5cce592 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:40.749435 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-246ca9d5-2cf2-4ced-a4c7-bda7d5cce592 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.155209 Jul 20 19:37:40.750022 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 811/1442] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:40 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:37:40.755335 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-3ff61ea2-2d1b-4d94-9c63-f0ac073ba507 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:40.755936 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-3ff61ea2-2d1b-4d94-9c63-f0ac073ba507 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:40.761755 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3ff61ea2-2d1b-4d94-9c63-f0ac073ba507 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:40.762208 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3ff61ea2-2d1b-4d94-9c63-f0ac073ba507 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:40.762972 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3ff61ea2-2d1b-4d94-9c63-f0ac073ba507 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:40.763400 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3ff61ea2-2d1b-4d94-9c63-f0ac073ba507 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:40.845244 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3ff61ea2-2d1b-4d94-9c63-f0ac073ba507 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:40.847514 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:40.854157 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-3ff61ea2-2d1b-4d94-9c63-f0ac073ba507 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.103123 Jul 20 19:37:40.854663 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 812/1443] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:40 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:41.766189 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-61827cc7-f009-41a3-a88f-894833deacd0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:41.766878 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-61827cc7-f009-41a3-a88f-894833deacd0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:41.773266 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-61827cc7-f009-41a3-a88f-894833deacd0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:41.773743 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-61827cc7-f009-41a3-a88f-894833deacd0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:41.774505 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-61827cc7-f009-41a3-a88f-894833deacd0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:41.775007 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-61827cc7-f009-41a3-a88f-894833deacd0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:41.911047 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-61827cc7-f009-41a3-a88f-894833deacd0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:41.919043 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-61827cc7-f009-41a3-a88f-894833deacd0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.156705 Jul 20 19:37:41.919606 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 813/1444] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:41 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:37:41.924542 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-568c6fe9-24bd-4a55-9c2c-a5d941b9e2d8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:41.925134 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-568c6fe9-24bd-4a55-9c2c-a5d941b9e2d8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:41.930920 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-568c6fe9-24bd-4a55-9c2c-a5d941b9e2d8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:41.931363 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-568c6fe9-24bd-4a55-9c2c-a5d941b9e2d8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:41.932118 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-568c6fe9-24bd-4a55-9c2c-a5d941b9e2d8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:41.932543 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-568c6fe9-24bd-4a55-9c2c-a5d941b9e2d8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:41.993349 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-568c6fe9-24bd-4a55-9c2c-a5d941b9e2d8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:42.000681 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-568c6fe9-24bd-4a55-9c2c-a5d941b9e2d8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080156 Jul 20 19:37:42.001237 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 814/1445] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:41 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:42.936394 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-31220027-d6fa-44a6-827a-d3f90dd7f0f7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:42.937075 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-31220027-d6fa-44a6-827a-d3f90dd7f0f7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:42.943976 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-31220027-d6fa-44a6-827a-d3f90dd7f0f7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:42.944414 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-31220027-d6fa-44a6-827a-d3f90dd7f0f7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:42.945160 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-31220027-d6fa-44a6-827a-d3f90dd7f0f7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:42.945611 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-31220027-d6fa-44a6-827a-d3f90dd7f0f7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:43.077103 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-31220027-d6fa-44a6-827a-d3f90dd7f0f7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:43.085681 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-31220027-d6fa-44a6-827a-d3f90dd7f0f7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.153064 Jul 20 19:37:43.086255 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 815/1446] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:42 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:37:43.090670 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-fc600941-44e2-4496-bed6-6b42f0c79f19 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:43.091273 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-fc600941-44e2-4496-bed6-6b42f0c79f19 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:43.097323 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fc600941-44e2-4496-bed6-6b42f0c79f19 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:43.097867 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fc600941-44e2-4496-bed6-6b42f0c79f19 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:43.098847 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fc600941-44e2-4496-bed6-6b42f0c79f19 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:43.099286 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fc600941-44e2-4496-bed6-6b42f0c79f19 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:43.159874 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-fc600941-44e2-4496-bed6-6b42f0c79f19 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:43.167563 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-fc600941-44e2-4496-bed6-6b42f0c79f19 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080277 Jul 20 19:37:43.168058 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 816/1447] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:43 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:44.103155 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a5e9b8b2-ec48-4905-81bf-a6153a778e25 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:44.103833 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a5e9b8b2-ec48-4905-81bf-a6153a778e25 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:44.110308 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a5e9b8b2-ec48-4905-81bf-a6153a778e25 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:44.110762 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a5e9b8b2-ec48-4905-81bf-a6153a778e25 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:44.111527 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a5e9b8b2-ec48-4905-81bf-a6153a778e25 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:44.111959 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a5e9b8b2-ec48-4905-81bf-a6153a778e25 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:44.257736 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a5e9b8b2-ec48-4905-81bf-a6153a778e25 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:44.265235 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a5e9b8b2-ec48-4905-81bf-a6153a778e25 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.165982 Jul 20 19:37:44.265829 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 817/1448] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:44 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:37:44.271327 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ad5bc5ea-fb28-451e-bb44-3e76de3561d5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:44.271629 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ad5bc5ea-fb28-451e-bb44-3e76de3561d5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:44.277605 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ad5bc5ea-fb28-451e-bb44-3e76de3561d5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:44.278061 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ad5bc5ea-fb28-451e-bb44-3e76de3561d5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:44.278834 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ad5bc5ea-fb28-451e-bb44-3e76de3561d5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:44.279273 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ad5bc5ea-fb28-451e-bb44-3e76de3561d5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:44.341716 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ad5bc5ea-fb28-451e-bb44-3e76de3561d5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:44.349571 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ad5bc5ea-fb28-451e-bb44-3e76de3561d5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.082758 Jul 20 19:37:44.350142 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 818/1449] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:44 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:45.282604 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-2b501570-8815-4529-ab9f-824e29b695a6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:45.283930 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-2b501570-8815-4529-ab9f-824e29b695a6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:45.286564 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_api:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:45.291757 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2b501570-8815-4529-ab9f-824e29b695a6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:45.292197 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2b501570-8815-4529-ab9f-824e29b695a6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:45.292964 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2b501570-8815-4529-ab9f-824e29b695a6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:45.293396 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2b501570-8815-4529-ab9f-824e29b695a6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:45.507609 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-2b501570-8815-4529-ab9f-824e29b695a6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:45.515381 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-2b501570-8815-4529-ab9f-824e29b695a6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.236570 Jul 20 19:37:45.515959 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 819/1450] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:45 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:37:45.521463 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-3ce07c3f-cfcf-4cd1-9e0c-6bbc58214bb8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:45.522095 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-3ce07c3f-cfcf-4cd1-9e0c-6bbc58214bb8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:45.528261 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3ce07c3f-cfcf-4cd1-9e0c-6bbc58214bb8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:45.528711 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3ce07c3f-cfcf-4cd1-9e0c-6bbc58214bb8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:45.529478 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3ce07c3f-cfcf-4cd1-9e0c-6bbc58214bb8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:45.529941 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3ce07c3f-cfcf-4cd1-9e0c-6bbc58214bb8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:45.619775 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3ce07c3f-cfcf-4cd1-9e0c-6bbc58214bb8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:45.627435 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-3ce07c3f-cfcf-4cd1-9e0c-6bbc58214bb8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.110425 Jul 20 19:37:45.628454 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 820/1451] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:45 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:46.553956 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e23be4d8-7d25-480f-8195-a28ce528d845 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:46.554636 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e23be4d8-7d25-480f-8195-a28ce528d845 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:46.562135 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e23be4d8-7d25-480f-8195-a28ce528d845 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:46.562586 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e23be4d8-7d25-480f-8195-a28ce528d845 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:46.563376 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e23be4d8-7d25-480f-8195-a28ce528d845 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:46.563808 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e23be4d8-7d25-480f-8195-a28ce528d845 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:46.698772 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e23be4d8-7d25-480f-8195-a28ce528d845 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:46.706343 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e23be4d8-7d25-480f-8195-a28ce528d845 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.156590 Jul 20 19:37:46.706940 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 821/1452] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:46 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:46.711566 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-0a638725-a6fe-4ee5-9e83-77fbd1450108 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:46.712163 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-0a638725-a6fe-4ee5-9e83-77fbd1450108 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:46.718100 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0a638725-a6fe-4ee5-9e83-77fbd1450108 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:46.718546 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0a638725-a6fe-4ee5-9e83-77fbd1450108 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:46.719312 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0a638725-a6fe-4ee5-9e83-77fbd1450108 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:46.719742 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0a638725-a6fe-4ee5-9e83-77fbd1450108 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:46.786196 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0a638725-a6fe-4ee5-9e83-77fbd1450108 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:46.795066 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-0a638725-a6fe-4ee5-9e83-77fbd1450108 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.085830 Jul 20 19:37:46.795066 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 822/1453] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:46 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:47.723659 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-57f80a1a-7cce-430a-80ae-bed5a7ef1ad1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:47.724403 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-57f80a1a-7cce-430a-80ae-bed5a7ef1ad1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:47.730897 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-57f80a1a-7cce-430a-80ae-bed5a7ef1ad1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:47.731341 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-57f80a1a-7cce-430a-80ae-bed5a7ef1ad1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:47.732103 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-57f80a1a-7cce-430a-80ae-bed5a7ef1ad1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:47.732536 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-57f80a1a-7cce-430a-80ae-bed5a7ef1ad1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:47.865470 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-57f80a1a-7cce-430a-80ae-bed5a7ef1ad1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:47.872882 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-57f80a1a-7cce-430a-80ae-bed5a7ef1ad1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.153217 Jul 20 19:37:47.873440 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 823/1454] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:47 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:37:47.878909 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-95e06bd5-cf3c-439b-a708-3cd945334f9d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:47.879506 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-95e06bd5-cf3c-439b-a708-3cd945334f9d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:47.885708 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-95e06bd5-cf3c-439b-a708-3cd945334f9d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:47.886150 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-95e06bd5-cf3c-439b-a708-3cd945334f9d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:47.886915 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-95e06bd5-cf3c-439b-a708-3cd945334f9d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:47.887344 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-95e06bd5-cf3c-439b-a708-3cd945334f9d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:47.949855 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-95e06bd5-cf3c-439b-a708-3cd945334f9d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:47.957396 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-95e06bd5-cf3c-439b-a708-3cd945334f9d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.082967 Jul 20 19:37:47.957982 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 824/1455] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:47 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:48.890550 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-08c98d0f-dbcb-4846-ad2c-e5195b860970 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:48.891228 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-08c98d0f-dbcb-4846-ad2c-e5195b860970 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:48.897815 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-08c98d0f-dbcb-4846-ad2c-e5195b860970 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:48.898263 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-08c98d0f-dbcb-4846-ad2c-e5195b860970 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:48.899021 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-08c98d0f-dbcb-4846-ad2c-e5195b860970 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:48.899457 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-08c98d0f-dbcb-4846-ad2c-e5195b860970 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:49.032603 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-08c98d0f-dbcb-4846-ad2c-e5195b860970 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:49.040656 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-08c98d0f-dbcb-4846-ad2c-e5195b860970 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.154083 Jul 20 19:37:49.041222 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 825/1456] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:48 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:37:49.045662 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-5615cf2b-070f-412c-89f8-18f102b30041 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:49.046269 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-5615cf2b-070f-412c-89f8-18f102b30041 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:49.052908 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5615cf2b-070f-412c-89f8-18f102b30041 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:49.053364 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5615cf2b-070f-412c-89f8-18f102b30041 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:49.054193 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5615cf2b-070f-412c-89f8-18f102b30041 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:49.054633 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5615cf2b-070f-412c-89f8-18f102b30041 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:49.115322 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-5615cf2b-070f-412c-89f8-18f102b30041 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:49.122807 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-5615cf2b-070f-412c-89f8-18f102b30041 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080611 Jul 20 19:37:49.123371 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 826/1457] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:49 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:50.059614 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-146015d9-2cdb-44d5-8c0c-c4051f25ef03 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:50.060291 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-146015d9-2cdb-44d5-8c0c-c4051f25ef03 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:50.067910 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-146015d9-2cdb-44d5-8c0c-c4051f25ef03 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:50.068401 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-146015d9-2cdb-44d5-8c0c-c4051f25ef03 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:50.069241 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-146015d9-2cdb-44d5-8c0c-c4051f25ef03 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:50.069775 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-146015d9-2cdb-44d5-8c0c-c4051f25ef03 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:50.208395 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-146015d9-2cdb-44d5-8c0c-c4051f25ef03 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:50.216263 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-146015d9-2cdb-44d5-8c0c-c4051f25ef03 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.160425 Jul 20 19:37:50.216840 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 827/1458] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:50 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:37:50.222328 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-31f58bfb-330c-4c99-a758-ed450f16a121 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:50.222937 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-31f58bfb-330c-4c99-a758-ed450f16a121 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:50.229027 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-31f58bfb-330c-4c99-a758-ed450f16a121 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:50.229480 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-31f58bfb-330c-4c99-a758-ed450f16a121 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:50.230280 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-31f58bfb-330c-4c99-a758-ed450f16a121 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:50.230712 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-31f58bfb-330c-4c99-a758-ed450f16a121 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:50.307003 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-31f58bfb-330c-4c99-a758-ed450f16a121 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:50.316078 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-31f58bfb-330c-4c99-a758-ed450f16a121 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.098077 Jul 20 19:37:50.316661 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 828/1459] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:50 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:51.233097 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-1ae0500b-bbb4-4d58-9631-3fa9a5b02611 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:51.233813 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-1ae0500b-bbb4-4d58-9631-3fa9a5b02611 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:51.240434 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1ae0500b-bbb4-4d58-9631-3fa9a5b02611 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:51.240879 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1ae0500b-bbb4-4d58-9631-3fa9a5b02611 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:51.241663 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1ae0500b-bbb4-4d58-9631-3fa9a5b02611 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:51.242093 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1ae0500b-bbb4-4d58-9631-3fa9a5b02611 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:51.258819 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:51.379117 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1ae0500b-bbb4-4d58-9631-3fa9a5b02611 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:51.387046 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-1ae0500b-bbb4-4d58-9631-3fa9a5b02611 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.157732 Jul 20 19:37:51.387618 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 829/1460] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:51 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:37:51.392055 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-92e1165a-2899-4cfe-89c3-6be049147547 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:51.393355 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-92e1165a-2899-4cfe-89c3-6be049147547 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:51.399414 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-92e1165a-2899-4cfe-89c3-6be049147547 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:51.399869 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-92e1165a-2899-4cfe-89c3-6be049147547 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:51.400644 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-92e1165a-2899-4cfe-89c3-6be049147547 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:51.401080 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-92e1165a-2899-4cfe-89c3-6be049147547 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:51.463178 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-92e1165a-2899-4cfe-89c3-6be049147547 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:51.471276 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-92e1165a-2899-4cfe-89c3-6be049147547 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.082680 Jul 20 19:37:51.471934 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 830/1461] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:51 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:52.404422 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-623ca509-106b-4283-ab94-0c8acbe042fe tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:52.405122 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-623ca509-106b-4283-ab94-0c8acbe042fe tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:52.412141 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-623ca509-106b-4283-ab94-0c8acbe042fe tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:52.412579 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-623ca509-106b-4283-ab94-0c8acbe042fe tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:52.413334 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-623ca509-106b-4283-ab94-0c8acbe042fe tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:52.413784 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-623ca509-106b-4283-ab94-0c8acbe042fe tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:52.549780 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-623ca509-106b-4283-ab94-0c8acbe042fe tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:52.557718 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-623ca509-106b-4283-ab94-0c8acbe042fe tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.157280 Jul 20 19:37:52.558314 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 831/1462] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:52 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:37:52.566005 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-31415eac-3afd-4c75-9a77-d63532659470 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:52.566005 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-31415eac-3afd-4c75-9a77-d63532659470 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:52.571054 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-31415eac-3afd-4c75-9a77-d63532659470 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:52.571497 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-31415eac-3afd-4c75-9a77-d63532659470 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:52.572267 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-31415eac-3afd-4c75-9a77-d63532659470 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:52.572694 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-31415eac-3afd-4c75-9a77-d63532659470 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:52.635786 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-31415eac-3afd-4c75-9a77-d63532659470 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:52.643457 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-31415eac-3afd-4c75-9a77-d63532659470 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.083868 Jul 20 19:37:52.644678 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 832/1463] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:52 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:53.575353 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-fdf2dbef-767c-4f8e-b67a-787109f93f20 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:53.575996 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-fdf2dbef-767c-4f8e-b67a-787109f93f20 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:53.583394 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fdf2dbef-767c-4f8e-b67a-787109f93f20 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:53.583861 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fdf2dbef-767c-4f8e-b67a-787109f93f20 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:53.584620 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fdf2dbef-767c-4f8e-b67a-787109f93f20 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:53.585041 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fdf2dbef-767c-4f8e-b67a-787109f93f20 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:53.720924 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-fdf2dbef-767c-4f8e-b67a-787109f93f20 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:53.729176 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-fdf2dbef-767c-4f8e-b67a-787109f93f20 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.157727 Jul 20 19:37:53.729781 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 833/1464] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:53 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:37:53.734350 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-823241bb-98b2-4c0b-a0db-c99277af60eb tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:53.734950 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-823241bb-98b2-4c0b-a0db-c99277af60eb tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:53.741020 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-823241bb-98b2-4c0b-a0db-c99277af60eb tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:53.741470 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-823241bb-98b2-4c0b-a0db-c99277af60eb tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:53.742274 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-823241bb-98b2-4c0b-a0db-c99277af60eb tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:53.742710 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-823241bb-98b2-4c0b-a0db-c99277af60eb tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:53.808922 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-823241bb-98b2-4c0b-a0db-c99277af60eb tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:53.816512 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-823241bb-98b2-4c0b-a0db-c99277af60eb tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.085753 Jul 20 19:37:53.817074 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 834/1465] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:53 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:54.746889 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4ba512c4-baf1-423a-9421-8f0c0e18b57a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:54.747598 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-4ba512c4-baf1-423a-9421-8f0c0e18b57a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:54.755076 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4ba512c4-baf1-423a-9421-8f0c0e18b57a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:54.755525 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4ba512c4-baf1-423a-9421-8f0c0e18b57a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:54.756301 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4ba512c4-baf1-423a-9421-8f0c0e18b57a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:54.756733 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4ba512c4-baf1-423a-9421-8f0c0e18b57a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:54.891528 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-4ba512c4-baf1-423a-9421-8f0c0e18b57a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:54.899360 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-4ba512c4-baf1-423a-9421-8f0c0e18b57a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.156424 Jul 20 19:37:54.900345 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 835/1466] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:54 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:37:54.905873 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-bcb6e298-704b-4152-9140-ad9551733e9c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:54.906482 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-bcb6e298-704b-4152-9140-ad9551733e9c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:54.913252 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bcb6e298-704b-4152-9140-ad9551733e9c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:54.913727 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bcb6e298-704b-4152-9140-ad9551733e9c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:54.914492 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bcb6e298-704b-4152-9140-ad9551733e9c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:54.914930 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bcb6e298-704b-4152-9140-ad9551733e9c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:54.980678 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-bcb6e298-704b-4152-9140-ad9551733e9c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:54.989227 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-bcb6e298-704b-4152-9140-ad9551733e9c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.087867 Jul 20 19:37:54.990259 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 836/1467] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:54 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:55.917361 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-daf5746b-5b06-4af9-bc72-dda36107c32c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:55.918059 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-daf5746b-5b06-4af9-bc72-dda36107c32c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:55.925619 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-daf5746b-5b06-4af9-bc72-dda36107c32c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:55.926056 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-daf5746b-5b06-4af9-bc72-dda36107c32c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:55.926878 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-daf5746b-5b06-4af9-bc72-dda36107c32c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:55.927359 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-daf5746b-5b06-4af9-bc72-dda36107c32c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:56.083279 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-daf5746b-5b06-4af9-bc72-dda36107c32c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:56.091204 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-daf5746b-5b06-4af9-bc72-dda36107c32c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.177634 Jul 20 19:37:56.091789 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 837/1468] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:55 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:37:56.097656 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ac7eb55d-a4ad-47fb-a6b1-20f660253885 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:56.099515 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ac7eb55d-a4ad-47fb-a6b1-20f660253885 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:56.104600 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ac7eb55d-a4ad-47fb-a6b1-20f660253885 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:56.105046 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ac7eb55d-a4ad-47fb-a6b1-20f660253885 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:56.105864 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ac7eb55d-a4ad-47fb-a6b1-20f660253885 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:56.106275 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ac7eb55d-a4ad-47fb-a6b1-20f660253885 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:56.169928 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ac7eb55d-a4ad-47fb-a6b1-20f660253885 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:56.177901 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ac7eb55d-a4ad-47fb-a6b1-20f660253885 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.085061 Jul 20 19:37:56.178489 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 838/1469] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:56 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:57.110871 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ee10c1ba-394e-4b16-bfce-fbdd856790ec tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:57.111537 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ee10c1ba-394e-4b16-bfce-fbdd856790ec tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:57.119192 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ee10c1ba-394e-4b16-bfce-fbdd856790ec tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:57.119632 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ee10c1ba-394e-4b16-bfce-fbdd856790ec tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:57.120392 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ee10c1ba-394e-4b16-bfce-fbdd856790ec tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:57.120816 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ee10c1ba-394e-4b16-bfce-fbdd856790ec tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:57.254386 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ee10c1ba-394e-4b16-bfce-fbdd856790ec tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:57.261999 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ee10c1ba-394e-4b16-bfce-fbdd856790ec tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.155079 Jul 20 19:37:57.262567 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 839/1470] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:57 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:37:57.267577 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-8da1fe03-e197-4edf-b541-27bb3369b0c7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:57.268180 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-8da1fe03-e197-4edf-b541-27bb3369b0c7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:57.275352 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8da1fe03-e197-4edf-b541-27bb3369b0c7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:57.275799 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8da1fe03-e197-4edf-b541-27bb3369b0c7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:57.276567 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8da1fe03-e197-4edf-b541-27bb3369b0c7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:57.277009 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8da1fe03-e197-4edf-b541-27bb3369b0c7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:57.344154 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8da1fe03-e197-4edf-b541-27bb3369b0c7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:57.352151 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-8da1fe03-e197-4edf-b541-27bb3369b0c7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.088561 Jul 20 19:37:57.352857 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 840/1471] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:57 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:58.279320 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-370970b8-86e6-4ac5-a455-b7de300f6412 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:58.280006 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-370970b8-86e6-4ac5-a455-b7de300f6412 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:58.287126 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-370970b8-86e6-4ac5-a455-b7de300f6412 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:58.287582 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-370970b8-86e6-4ac5-a455-b7de300f6412 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:58.288624 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-370970b8-86e6-4ac5-a455-b7de300f6412 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:58.288782 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-370970b8-86e6-4ac5-a455-b7de300f6412 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:58.428354 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-370970b8-86e6-4ac5-a455-b7de300f6412 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:58.436938 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-370970b8-86e6-4ac5-a455-b7de300f6412 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.161388 Jul 20 19:37:58.437522 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 841/1472] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:58 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:37:58.442421 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d92b77ac-75c8-4d1d-8d6f-3076d766fdfc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:58.443035 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d92b77ac-75c8-4d1d-8d6f-3076d766fdfc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:58.449259 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d92b77ac-75c8-4d1d-8d6f-3076d766fdfc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:58.449749 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d92b77ac-75c8-4d1d-8d6f-3076d766fdfc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:58.450511 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d92b77ac-75c8-4d1d-8d6f-3076d766fdfc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:58.450945 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d92b77ac-75c8-4d1d-8d6f-3076d766fdfc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:58.516293 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d92b77ac-75c8-4d1d-8d6f-3076d766fdfc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:58.526781 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d92b77ac-75c8-4d1d-8d6f-3076d766fdfc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.088160 Jul 20 19:37:58.527783 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 842/1473] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:58 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:59.454776 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-04551950-ac8d-4f51-ab9a-3106799dfcf6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:59.455455 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-04551950-ac8d-4f51-ab9a-3106799dfcf6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:59.462567 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-04551950-ac8d-4f51-ab9a-3106799dfcf6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:59.463003 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-04551950-ac8d-4f51-ab9a-3106799dfcf6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:59.463758 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-04551950-ac8d-4f51-ab9a-3106799dfcf6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:59.464188 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-04551950-ac8d-4f51-ab9a-3106799dfcf6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:59.598973 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-04551950-ac8d-4f51-ab9a-3106799dfcf6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:59.606725 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-04551950-ac8d-4f51-ab9a-3106799dfcf6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.155804 Jul 20 19:37:59.607287 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 843/1474] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:59 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:37:59.611664 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-20062ba1-17e2-490e-be2e-b1f7dcb9f551 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:59.612390 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-20062ba1-17e2-490e-be2e-b1f7dcb9f551 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:59.618222 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-20062ba1-17e2-490e-be2e-b1f7dcb9f551 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:59.618663 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-20062ba1-17e2-490e-be2e-b1f7dcb9f551 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:59.619420 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-20062ba1-17e2-490e-be2e-b1f7dcb9f551 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:59.619845 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-20062ba1-17e2-490e-be2e-b1f7dcb9f551 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:59.681677 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-20062ba1-17e2-490e-be2e-b1f7dcb9f551 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:59.689290 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-20062ba1-17e2-490e-be2e-b1f7dcb9f551 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080947 Jul 20 19:37:59.689877 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 844/1475] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:59 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:00.624941 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c004d485-de78-49f3-9e1d-025f2804f095 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:00.625598 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c004d485-de78-49f3-9e1d-025f2804f095 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:00.632164 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c004d485-de78-49f3-9e1d-025f2804f095 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:00.632613 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c004d485-de78-49f3-9e1d-025f2804f095 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:00.633385 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c004d485-de78-49f3-9e1d-025f2804f095 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:00.633869 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c004d485-de78-49f3-9e1d-025f2804f095 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:00.769345 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c004d485-de78-49f3-9e1d-025f2804f095 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:00.777261 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c004d485-de78-49f3-9e1d-025f2804f095 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.156211 Jul 20 19:38:00.777970 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 845/1476] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:00 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:38:00.782509 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-cc40ddb4-80b1-4eae-9c0b-22a27d86d258 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:00.783236 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-cc40ddb4-80b1-4eae-9c0b-22a27d86d258 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:00.790233 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cc40ddb4-80b1-4eae-9c0b-22a27d86d258 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:00.790677 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cc40ddb4-80b1-4eae-9c0b-22a27d86d258 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:00.791475 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cc40ddb4-80b1-4eae-9c0b-22a27d86d258 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:00.791910 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cc40ddb4-80b1-4eae-9c0b-22a27d86d258 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:00.794662 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:00.858111 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-cc40ddb4-80b1-4eae-9c0b-22a27d86d258 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:00.865826 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-cc40ddb4-80b1-4eae-9c0b-22a27d86d258 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.086912 Jul 20 19:38:00.866388 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 846/1477] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:00 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:01.795157 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-00fb58d2-8a81-450b-89a0-5a925de683c9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:01.795800 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-00fb58d2-8a81-450b-89a0-5a925de683c9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:01.802872 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-00fb58d2-8a81-450b-89a0-5a925de683c9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:01.803326 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-00fb58d2-8a81-450b-89a0-5a925de683c9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:01.804101 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-00fb58d2-8a81-450b-89a0-5a925de683c9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:01.804536 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-00fb58d2-8a81-450b-89a0-5a925de683c9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:01.945443 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-00fb58d2-8a81-450b-89a0-5a925de683c9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:01.953415 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-00fb58d2-8a81-450b-89a0-5a925de683c9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.162242 Jul 20 19:38:01.954024 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 847/1478] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:01 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:38:01.959170 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ae8b8da6-2ffe-4573-b37d-76df31c1886b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:01.959774 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ae8b8da6-2ffe-4573-b37d-76df31c1886b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:01.965902 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ae8b8da6-2ffe-4573-b37d-76df31c1886b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:01.966350 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ae8b8da6-2ffe-4573-b37d-76df31c1886b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:01.967122 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ae8b8da6-2ffe-4573-b37d-76df31c1886b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:01.967561 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ae8b8da6-2ffe-4573-b37d-76df31c1886b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:02.033027 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ae8b8da6-2ffe-4573-b37d-76df31c1886b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:02.042215 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ae8b8da6-2ffe-4573-b37d-76df31c1886b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.087198 Jul 20 19:38:02.042799 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 848/1479] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:01 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:02.972523 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d221b1bf-0252-4bb5-b965-e5615cc14565 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:02.973177 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d221b1bf-0252-4bb5-b965-e5615cc14565 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:02.979575 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d221b1bf-0252-4bb5-b965-e5615cc14565 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:02.980165 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d221b1bf-0252-4bb5-b965-e5615cc14565 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:02.980930 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d221b1bf-0252-4bb5-b965-e5615cc14565 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:02.981359 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d221b1bf-0252-4bb5-b965-e5615cc14565 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:03.117716 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d221b1bf-0252-4bb5-b965-e5615cc14565 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:03.125365 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d221b1bf-0252-4bb5-b965-e5615cc14565 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.157634 Jul 20 19:38:03.125965 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 849/1480] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:02 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:38:03.131043 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-f3d30c6e-f923-4f78-bbea-b8308c9c20cf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:03.131655 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-f3d30c6e-f923-4f78-bbea-b8308c9c20cf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:03.137330 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f3d30c6e-f923-4f78-bbea-b8308c9c20cf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:03.137989 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f3d30c6e-f923-4f78-bbea-b8308c9c20cf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:03.138584 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f3d30c6e-f923-4f78-bbea-b8308c9c20cf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:03.139021 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f3d30c6e-f923-4f78-bbea-b8308c9c20cf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:03.204967 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-f3d30c6e-f923-4f78-bbea-b8308c9c20cf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:03.213089 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-f3d30c6e-f923-4f78-bbea-b8308c9c20cf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.086185 Jul 20 19:38:03.213676 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 850/1481] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:03 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:04.142866 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-f351aa52-21f5-47ad-a7ec-aff5db217aac tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:04.143551 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-f351aa52-21f5-47ad-a7ec-aff5db217aac tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:04.149598 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f351aa52-21f5-47ad-a7ec-aff5db217aac tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:04.150126 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f351aa52-21f5-47ad-a7ec-aff5db217aac tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:04.150896 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f351aa52-21f5-47ad-a7ec-aff5db217aac tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:04.151328 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f351aa52-21f5-47ad-a7ec-aff5db217aac tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:04.309562 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-f351aa52-21f5-47ad-a7ec-aff5db217aac tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:04.317381 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-f351aa52-21f5-47ad-a7ec-aff5db217aac tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.178465 Jul 20 19:38:04.318009 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 851/1482] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:04 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:38:04.322633 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-6629bb84-3706-4afb-9da3-aafa73dd5aca tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:04.323239 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-6629bb84-3706-4afb-9da3-aafa73dd5aca tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:04.329214 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6629bb84-3706-4afb-9da3-aafa73dd5aca tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:04.329705 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6629bb84-3706-4afb-9da3-aafa73dd5aca tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:04.330477 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6629bb84-3706-4afb-9da3-aafa73dd5aca tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:04.331552 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6629bb84-3706-4afb-9da3-aafa73dd5aca tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:04.397328 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6629bb84-3706-4afb-9da3-aafa73dd5aca tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:04.404859 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-6629bb84-3706-4afb-9da3-aafa73dd5aca tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.085909 Jul 20 19:38:04.405425 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 852/1483] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:04 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:05.335169 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-061de5ca-07aa-4355-92df-06f6d3fddd9c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:05.335774 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-061de5ca-07aa-4355-92df-06f6d3fddd9c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:05.342543 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-061de5ca-07aa-4355-92df-06f6d3fddd9c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:05.343004 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-061de5ca-07aa-4355-92df-06f6d3fddd9c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:05.344050 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-061de5ca-07aa-4355-92df-06f6d3fddd9c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:05.344484 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-061de5ca-07aa-4355-92df-06f6d3fddd9c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:05.492145 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-061de5ca-07aa-4355-92df-06f6d3fddd9c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:05.499749 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-061de5ca-07aa-4355-92df-06f6d3fddd9c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.168739 Jul 20 19:38:05.500320 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 853/1484] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:05 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:38:05.505014 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-19054493-87dc-44b7-b125-7ec32b775202 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:05.505624 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-19054493-87dc-44b7-b125-7ec32b775202 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:05.513678 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-19054493-87dc-44b7-b125-7ec32b775202 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:05.514142 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-19054493-87dc-44b7-b125-7ec32b775202 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:05.514877 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-19054493-87dc-44b7-b125-7ec32b775202 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:05.515299 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-19054493-87dc-44b7-b125-7ec32b775202 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:05.579260 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-19054493-87dc-44b7-b125-7ec32b775202 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:05.587255 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-19054493-87dc-44b7-b125-7ec32b775202 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.085935 Jul 20 19:38:05.587831 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 854/1485] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:05 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:06.516511 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4e97b2a1-6d8f-48fb-9bdb-74e2b350a867 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:06.517206 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-4e97b2a1-6d8f-48fb-9bdb-74e2b350a867 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:06.524109 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4e97b2a1-6d8f-48fb-9bdb-74e2b350a867 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:06.524561 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4e97b2a1-6d8f-48fb-9bdb-74e2b350a867 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:06.525357 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4e97b2a1-6d8f-48fb-9bdb-74e2b350a867 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:06.526084 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4e97b2a1-6d8f-48fb-9bdb-74e2b350a867 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:06.675094 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-4e97b2a1-6d8f-48fb-9bdb-74e2b350a867 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:06.683005 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-4e97b2a1-6d8f-48fb-9bdb-74e2b350a867 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.170451 Jul 20 19:38:06.683933 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 855/1486] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:06 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:38:06.695008 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-84c1df30-321e-4996-b88e-a8f295c76e1a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:06.695659 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-84c1df30-321e-4996-b88e-a8f295c76e1a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:06.702179 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-84c1df30-321e-4996-b88e-a8f295c76e1a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:06.702628 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-84c1df30-321e-4996-b88e-a8f295c76e1a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:06.703407 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-84c1df30-321e-4996-b88e-a8f295c76e1a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:06.703844 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-84c1df30-321e-4996-b88e-a8f295c76e1a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:06.767067 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-84c1df30-321e-4996-b88e-a8f295c76e1a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:06.776324 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-84c1df30-321e-4996-b88e-a8f295c76e1a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.091317 Jul 20 19:38:06.776896 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 856/1487] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:06 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:07.702394 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-0ad3d3f5-f4b4-491a-979d-0b1b6ea0dec4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:07.703129 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-0ad3d3f5-f4b4-491a-979d-0b1b6ea0dec4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:07.710801 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0ad3d3f5-f4b4-491a-979d-0b1b6ea0dec4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:07.711252 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0ad3d3f5-f4b4-491a-979d-0b1b6ea0dec4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:07.712038 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0ad3d3f5-f4b4-491a-979d-0b1b6ea0dec4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:07.712519 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0ad3d3f5-f4b4-491a-979d-0b1b6ea0dec4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:07.857119 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0ad3d3f5-f4b4-491a-979d-0b1b6ea0dec4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:07.867255 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-0ad3d3f5-f4b4-491a-979d-0b1b6ea0dec4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.168774 Jul 20 19:38:07.867888 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 857/1488] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:07 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:38:07.872464 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e6cc366e-2c5e-4863-ad0e-65779308b829 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:07.873684 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e6cc366e-2c5e-4863-ad0e-65779308b829 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:07.879933 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e6cc366e-2c5e-4863-ad0e-65779308b829 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:07.880286 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e6cc366e-2c5e-4863-ad0e-65779308b829 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:07.881066 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e6cc366e-2c5e-4863-ad0e-65779308b829 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:07.881502 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e6cc366e-2c5e-4863-ad0e-65779308b829 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:07.952502 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e6cc366e-2c5e-4863-ad0e-65779308b829 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:07.961256 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e6cc366e-2c5e-4863-ad0e-65779308b829 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.092338 Jul 20 19:38:07.961870 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 858/1489] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:07 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:08.884791 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-9753b593-6391-4f28-8e16-6ff9a8d076d4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:08.885492 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-9753b593-6391-4f28-8e16-6ff9a8d076d4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:08.894597 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9753b593-6391-4f28-8e16-6ff9a8d076d4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:08.895047 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9753b593-6391-4f28-8e16-6ff9a8d076d4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:08.896081 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9753b593-6391-4f28-8e16-6ff9a8d076d4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:08.896538 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9753b593-6391-4f28-8e16-6ff9a8d076d4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:09.039212 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-9753b593-6391-4f28-8e16-6ff9a8d076d4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:09.046991 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-9753b593-6391-4f28-8e16-6ff9a8d076d4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.166447 Jul 20 19:38:09.047566 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 859/1490] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:08 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:38:09.052220 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-bc22a63a-567c-4e11-a225-2a138e1d9fd2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:09.052821 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-bc22a63a-567c-4e11-a225-2a138e1d9fd2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:09.058991 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bc22a63a-567c-4e11-a225-2a138e1d9fd2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:09.059763 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bc22a63a-567c-4e11-a225-2a138e1d9fd2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:09.060559 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bc22a63a-567c-4e11-a225-2a138e1d9fd2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:09.060992 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bc22a63a-567c-4e11-a225-2a138e1d9fd2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:09.129372 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-bc22a63a-567c-4e11-a225-2a138e1d9fd2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:09.137022 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-bc22a63a-567c-4e11-a225-2a138e1d9fd2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.088509 Jul 20 19:38:09.137609 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 860/1491] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:09 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:10.064091 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-235a7119-782a-458b-9a0f-a854834da1bd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:10.064845 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-235a7119-782a-458b-9a0f-a854834da1bd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:10.071338 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-235a7119-782a-458b-9a0f-a854834da1bd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:10.071780 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-235a7119-782a-458b-9a0f-a854834da1bd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:10.072533 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-235a7119-782a-458b-9a0f-a854834da1bd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:10.072959 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-235a7119-782a-458b-9a0f-a854834da1bd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:10.211310 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-235a7119-782a-458b-9a0f-a854834da1bd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:10.219257 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-235a7119-782a-458b-9a0f-a854834da1bd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.159038 Jul 20 19:38:10.219840 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 861/1492] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:10 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:38:10.224801 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-7d66727e-071f-49fe-aedc-413193cc2b52 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:10.225404 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-7d66727e-071f-49fe-aedc-413193cc2b52 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:10.231024 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7d66727e-071f-49fe-aedc-413193cc2b52 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:10.231469 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7d66727e-071f-49fe-aedc-413193cc2b52 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:10.232231 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7d66727e-071f-49fe-aedc-413193cc2b52 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:10.232662 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7d66727e-071f-49fe-aedc-413193cc2b52 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:10.297089 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-7d66727e-071f-49fe-aedc-413193cc2b52 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:10.298349 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:10.305547 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-7d66727e-071f-49fe-aedc-413193cc2b52 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.084510 Jul 20 19:38:10.306136 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 862/1493] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:10 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:11.236916 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-1b0a5301-45a8-41f7-b595-3d8be67d7502 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:11.238178 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-1b0a5301-45a8-41f7-b595-3d8be67d7502 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:11.244624 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1b0a5301-45a8-41f7-b595-3d8be67d7502 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:11.245076 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1b0a5301-45a8-41f7-b595-3d8be67d7502 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:11.245868 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1b0a5301-45a8-41f7-b595-3d8be67d7502 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:11.246299 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1b0a5301-45a8-41f7-b595-3d8be67d7502 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:11.378597 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1b0a5301-45a8-41f7-b595-3d8be67d7502 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:11.385990 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-1b0a5301-45a8-41f7-b595-3d8be67d7502 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.152970 Jul 20 19:38:11.386563 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 863/1494] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:11 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:38:11.390855 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-862f3e7c-c131-47e5-b316-c5903450247d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:11.391450 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-862f3e7c-c131-47e5-b316-c5903450247d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:11.397859 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-862f3e7c-c131-47e5-b316-c5903450247d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:11.398311 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-862f3e7c-c131-47e5-b316-c5903450247d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:11.399236 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-862f3e7c-c131-47e5-b316-c5903450247d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:11.399685 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-862f3e7c-c131-47e5-b316-c5903450247d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:11.464880 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-862f3e7c-c131-47e5-b316-c5903450247d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:11.473189 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-862f3e7c-c131-47e5-b316-c5903450247d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.085686 Jul 20 19:38:11.473774 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 864/1495] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:11 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:12.403440 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-00ef6534-591e-4fc6-b60f-9a31dccb03a6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:12.404066 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-00ef6534-591e-4fc6-b60f-9a31dccb03a6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:12.411252 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-00ef6534-591e-4fc6-b60f-9a31dccb03a6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:12.411699 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-00ef6534-591e-4fc6-b60f-9a31dccb03a6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:12.412468 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-00ef6534-591e-4fc6-b60f-9a31dccb03a6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:12.412903 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-00ef6534-591e-4fc6-b60f-9a31dccb03a6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:12.541855 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-00ef6534-591e-4fc6-b60f-9a31dccb03a6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:12.549667 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-00ef6534-591e-4fc6-b60f-9a31dccb03a6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.149961 Jul 20 19:38:12.550768 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 865/1496] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:12 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:38:12.555403 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-67cd2e77-74d8-49b5-bd2e-c4c14f7372e3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:12.556005 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-67cd2e77-74d8-49b5-bd2e-c4c14f7372e3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:12.561741 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-67cd2e77-74d8-49b5-bd2e-c4c14f7372e3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:12.562191 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-67cd2e77-74d8-49b5-bd2e-c4c14f7372e3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:12.562956 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-67cd2e77-74d8-49b5-bd2e-c4c14f7372e3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:12.563392 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-67cd2e77-74d8-49b5-bd2e-c4c14f7372e3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:12.625557 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-67cd2e77-74d8-49b5-bd2e-c4c14f7372e3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:12.634208 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-67cd2e77-74d8-49b5-bd2e-c4c14f7372e3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.082449 Jul 20 19:38:12.634779 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 866/1497] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:12 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:13.567220 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-7d81a623-454a-4017-a62e-926ca0ea5893 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:13.567923 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-7d81a623-454a-4017-a62e-926ca0ea5893 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:13.574351 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7d81a623-454a-4017-a62e-926ca0ea5893 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:13.574736 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7d81a623-454a-4017-a62e-926ca0ea5893 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:13.575486 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7d81a623-454a-4017-a62e-926ca0ea5893 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:13.575911 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7d81a623-454a-4017-a62e-926ca0ea5893 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:13.710841 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-7d81a623-454a-4017-a62e-926ca0ea5893 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:13.718207 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-7d81a623-454a-4017-a62e-926ca0ea5893 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.154948 Jul 20 19:38:13.719053 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 867/1498] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:13 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:38:13.724024 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-36dfd594-8992-4272-9556-2b95180a4b59 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:13.724613 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-36dfd594-8992-4272-9556-2b95180a4b59 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:13.730105 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-36dfd594-8992-4272-9556-2b95180a4b59 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:13.730545 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-36dfd594-8992-4272-9556-2b95180a4b59 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:13.731293 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-36dfd594-8992-4272-9556-2b95180a4b59 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:13.731748 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-36dfd594-8992-4272-9556-2b95180a4b59 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:13.791620 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-36dfd594-8992-4272-9556-2b95180a4b59 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:13.799184 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-36dfd594-8992-4272-9556-2b95180a4b59 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.079143 Jul 20 19:38:13.799749 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 868/1499] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:13 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:14.736067 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ce6d007b-5256-48a6-b5d7-22058c4b7f60 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:14.736738 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ce6d007b-5256-48a6-b5d7-22058c4b7f60 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:14.739523 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_api:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:14.745034 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ce6d007b-5256-48a6-b5d7-22058c4b7f60 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:14.745470 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ce6d007b-5256-48a6-b5d7-22058c4b7f60 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:14.746267 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ce6d007b-5256-48a6-b5d7-22058c4b7f60 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:14.746695 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ce6d007b-5256-48a6-b5d7-22058c4b7f60 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:14.879647 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ce6d007b-5256-48a6-b5d7-22058c4b7f60 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:14.887185 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ce6d007b-5256-48a6-b5d7-22058c4b7f60 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.154995 Jul 20 19:38:14.887754 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 869/1500] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:14 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:38:14.892169 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-12243a13-c3d0-4278-b092-807092ff5425 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:14.892773 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-12243a13-c3d0-4278-b092-807092ff5425 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:14.898804 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-12243a13-c3d0-4278-b092-807092ff5425 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:14.899254 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-12243a13-c3d0-4278-b092-807092ff5425 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:14.900020 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-12243a13-c3d0-4278-b092-807092ff5425 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:14.900455 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-12243a13-c3d0-4278-b092-807092ff5425 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:14.964817 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-12243a13-c3d0-4278-b092-807092ff5425 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:14.972816 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-12243a13-c3d0-4278-b092-807092ff5425 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.083913 Jul 20 19:38:14.973376 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 870/1501] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:14 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:15.904246 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-62a6199c-bec1-4013-a11b-288b8b326635 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:15.904897 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-62a6199c-bec1-4013-a11b-288b8b326635 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:15.911577 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-62a6199c-bec1-4013-a11b-288b8b326635 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:15.912028 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-62a6199c-bec1-4013-a11b-288b8b326635 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:15.912789 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-62a6199c-bec1-4013-a11b-288b8b326635 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:15.913224 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-62a6199c-bec1-4013-a11b-288b8b326635 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:16.042150 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-62a6199c-bec1-4013-a11b-288b8b326635 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:16.049598 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-62a6199c-bec1-4013-a11b-288b8b326635 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.149226 Jul 20 19:38:16.050240 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 871/1502] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:15 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:38:16.054636 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-cf18c13e-881f-4476-9ecf-e08ab3787e4b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:16.055237 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-cf18c13e-881f-4476-9ecf-e08ab3787e4b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:16.060830 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cf18c13e-881f-4476-9ecf-e08ab3787e4b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:16.061280 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cf18c13e-881f-4476-9ecf-e08ab3787e4b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:16.062081 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cf18c13e-881f-4476-9ecf-e08ab3787e4b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:16.062518 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cf18c13e-881f-4476-9ecf-e08ab3787e4b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:16.123487 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-cf18c13e-881f-4476-9ecf-e08ab3787e4b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:16.131428 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-cf18c13e-881f-4476-9ecf-e08ab3787e4b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080264 Jul 20 19:38:16.131989 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 872/1503] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:16 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:17.066555 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-526724f6-32ad-4c33-9bb3-3d94e1b0f253 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:17.067232 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-526724f6-32ad-4c33-9bb3-3d94e1b0f253 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:17.073754 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-526724f6-32ad-4c33-9bb3-3d94e1b0f253 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:17.074206 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-526724f6-32ad-4c33-9bb3-3d94e1b0f253 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:17.074971 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-526724f6-32ad-4c33-9bb3-3d94e1b0f253 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:17.075407 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-526724f6-32ad-4c33-9bb3-3d94e1b0f253 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:17.207820 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-526724f6-32ad-4c33-9bb3-3d94e1b0f253 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:17.215414 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-526724f6-32ad-4c33-9bb3-3d94e1b0f253 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.152887 Jul 20 19:38:17.215980 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 873/1504] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:17 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:38:17.220789 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ec1b51ce-7fcf-45d3-99bf-c38e5743f2ca tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:17.221397 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ec1b51ce-7fcf-45d3-99bf-c38e5743f2ca tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:17.228788 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ec1b51ce-7fcf-45d3-99bf-c38e5743f2ca tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:17.229238 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ec1b51ce-7fcf-45d3-99bf-c38e5743f2ca tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:17.230036 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ec1b51ce-7fcf-45d3-99bf-c38e5743f2ca tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:17.230476 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ec1b51ce-7fcf-45d3-99bf-c38e5743f2ca tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:17.290071 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ec1b51ce-7fcf-45d3-99bf-c38e5743f2ca tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:17.297463 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ec1b51ce-7fcf-45d3-99bf-c38e5743f2ca tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080530 Jul 20 19:38:17.298048 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 874/1505] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:17 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:18.233540 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-62071b6d-d4ec-4f96-8fd0-225da9ad4ba4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:18.234313 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-62071b6d-d4ec-4f96-8fd0-225da9ad4ba4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:18.240600 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-62071b6d-d4ec-4f96-8fd0-225da9ad4ba4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:18.241040 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-62071b6d-d4ec-4f96-8fd0-225da9ad4ba4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:18.241830 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-62071b6d-d4ec-4f96-8fd0-225da9ad4ba4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:18.242259 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-62071b6d-d4ec-4f96-8fd0-225da9ad4ba4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:18.372270 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-62071b6d-d4ec-4f96-8fd0-225da9ad4ba4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:18.380660 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-62071b6d-d4ec-4f96-8fd0-225da9ad4ba4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.151073 Jul 20 19:38:18.381231 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 875/1506] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:18 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:38:18.385654 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-6cf9c09e-e031-4833-bb4c-35eb130487f4 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:18.386260 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-6cf9c09e-e031-4833-bb4c-35eb130487f4 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:18.391874 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6cf9c09e-e031-4833-bb4c-35eb130487f4 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:18.392323 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6cf9c09e-e031-4833-bb4c-35eb130487f4 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:18.393085 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6cf9c09e-e031-4833-bb4c-35eb130487f4 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:18.393538 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6cf9c09e-e031-4833-bb4c-35eb130487f4 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:18.457920 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6cf9c09e-e031-4833-bb4c-35eb130487f4 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:18.465456 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-6cf9c09e-e031-4833-bb4c-35eb130487f4 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.083253 Jul 20 19:38:18.466053 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 876/1507] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:18 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:19.398045 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-3a89ffb1-5be2-40ee-b895-a1b0e8b2d5c7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:19.398664 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-3a89ffb1-5be2-40ee-b895-a1b0e8b2d5c7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:19.405237 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3a89ffb1-5be2-40ee-b895-a1b0e8b2d5c7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:19.405723 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3a89ffb1-5be2-40ee-b895-a1b0e8b2d5c7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:19.406496 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3a89ffb1-5be2-40ee-b895-a1b0e8b2d5c7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:19.406928 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3a89ffb1-5be2-40ee-b895-a1b0e8b2d5c7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:19.539351 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3a89ffb1-5be2-40ee-b895-a1b0e8b2d5c7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:19.546909 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-3a89ffb1-5be2-40ee-b895-a1b0e8b2d5c7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.152950 Jul 20 19:38:19.547485 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 877/1508] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:19 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:38:19.552569 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-64af3f12-e91b-4287-9bc5-258aec6c327b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:19.553163 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-64af3f12-e91b-4287-9bc5-258aec6c327b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:19.558718 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-64af3f12-e91b-4287-9bc5-258aec6c327b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:19.559160 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-64af3f12-e91b-4287-9bc5-258aec6c327b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:19.559911 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-64af3f12-e91b-4287-9bc5-258aec6c327b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:19.560337 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-64af3f12-e91b-4287-9bc5-258aec6c327b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:19.621881 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-64af3f12-e91b-4287-9bc5-258aec6c327b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:19.629257 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-64af3f12-e91b-4287-9bc5-258aec6c327b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080833 Jul 20 19:38:19.629849 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 878/1509] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:19 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:20.563725 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-3d04dc16-bf8d-4469-872b-695b6fda7dd0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:20.564359 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-3d04dc16-bf8d-4469-872b-695b6fda7dd0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:20.571310 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3d04dc16-bf8d-4469-872b-695b6fda7dd0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:20.571752 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3d04dc16-bf8d-4469-872b-695b6fda7dd0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:20.572520 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3d04dc16-bf8d-4469-872b-695b6fda7dd0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:20.572950 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3d04dc16-bf8d-4469-872b-695b6fda7dd0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:20.589919 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:20.709047 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3d04dc16-bf8d-4469-872b-695b6fda7dd0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:20.716704 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-3d04dc16-bf8d-4469-872b-695b6fda7dd0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.156950 Jul 20 19:38:20.717273 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 879/1510] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:20 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:38:20.721961 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-1612b34d-e5a1-4efe-8e00-fef61a8f873d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:20.722558 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-1612b34d-e5a1-4efe-8e00-fef61a8f873d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:20.728226 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1612b34d-e5a1-4efe-8e00-fef61a8f873d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:20.728671 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1612b34d-e5a1-4efe-8e00-fef61a8f873d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:20.729425 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1612b34d-e5a1-4efe-8e00-fef61a8f873d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:20.729881 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1612b34d-e5a1-4efe-8e00-fef61a8f873d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:20.790667 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1612b34d-e5a1-4efe-8e00-fef61a8f873d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:20.798215 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-1612b34d-e5a1-4efe-8e00-fef61a8f873d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.079980 Jul 20 19:38:20.798770 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 880/1511] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:20 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:21.737677 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-5244e364-dad4-440e-a93a-522a93579008 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:21.738421 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-5244e364-dad4-440e-a93a-522a93579008 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:21.745685 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5244e364-dad4-440e-a93a-522a93579008 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:21.746176 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5244e364-dad4-440e-a93a-522a93579008 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:21.747056 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5244e364-dad4-440e-a93a-522a93579008 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:21.747489 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5244e364-dad4-440e-a93a-522a93579008 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:21.902557 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-5244e364-dad4-440e-a93a-522a93579008 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:21.910424 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-5244e364-dad4-440e-a93a-522a93579008 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.178393 Jul 20 19:38:21.910997 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 881/1512] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:21 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:38:21.916093 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e4c2cf76-cf7e-40f1-b980-a00aff10c139 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:21.917023 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e4c2cf76-cf7e-40f1-b980-a00aff10c139 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:21.925880 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e4c2cf76-cf7e-40f1-b980-a00aff10c139 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:21.926626 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e4c2cf76-cf7e-40f1-b980-a00aff10c139 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:21.927454 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e4c2cf76-cf7e-40f1-b980-a00aff10c139 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:21.928832 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e4c2cf76-cf7e-40f1-b980-a00aff10c139 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:22.003558 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e4c2cf76-cf7e-40f1-b980-a00aff10c139 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:22.011244 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e4c2cf76-cf7e-40f1-b980-a00aff10c139 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.099290 Jul 20 19:38:22.011808 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 882/1513] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:21 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:22.929635 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-fde8e20b-30d1-4201-ba11-02bdc1d01739 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:22.930305 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-fde8e20b-30d1-4201-ba11-02bdc1d01739 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:22.936872 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fde8e20b-30d1-4201-ba11-02bdc1d01739 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:22.937324 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fde8e20b-30d1-4201-ba11-02bdc1d01739 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:22.938126 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fde8e20b-30d1-4201-ba11-02bdc1d01739 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:22.938562 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fde8e20b-30d1-4201-ba11-02bdc1d01739 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:23.068286 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-fde8e20b-30d1-4201-ba11-02bdc1d01739 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:23.075831 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-fde8e20b-30d1-4201-ba11-02bdc1d01739 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.150340 Jul 20 19:38:23.076396 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 883/1514] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:22 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:38:23.080743 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-1d3b8e22-3ccb-4a0a-a47e-06d17e1f47a8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:23.082028 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-1d3b8e22-3ccb-4a0a-a47e-06d17e1f47a8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:23.087694 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1d3b8e22-3ccb-4a0a-a47e-06d17e1f47a8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:23.088146 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1d3b8e22-3ccb-4a0a-a47e-06d17e1f47a8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:23.088914 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1d3b8e22-3ccb-4a0a-a47e-06d17e1f47a8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:23.089372 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1d3b8e22-3ccb-4a0a-a47e-06d17e1f47a8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:23.152278 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1d3b8e22-3ccb-4a0a-a47e-06d17e1f47a8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:23.160306 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-1d3b8e22-3ccb-4a0a-a47e-06d17e1f47a8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.082442 Jul 20 19:38:23.160965 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 884/1515] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:23 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:24.093091 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-af0af3d2-9624-4dea-b381-07d6884982fd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:24.094072 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-af0af3d2-9624-4dea-b381-07d6884982fd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:24.101121 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-af0af3d2-9624-4dea-b381-07d6884982fd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:24.101613 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-af0af3d2-9624-4dea-b381-07d6884982fd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:24.102446 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-af0af3d2-9624-4dea-b381-07d6884982fd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:24.102879 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-af0af3d2-9624-4dea-b381-07d6884982fd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:24.235054 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-af0af3d2-9624-4dea-b381-07d6884982fd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:24.243168 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-af0af3d2-9624-4dea-b381-07d6884982fd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.153956 Jul 20 19:38:24.243730 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 885/1516] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:24 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:38:24.248295 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-9aee05bd-1cdd-4bfd-b24c-eceabf93ab5e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:24.248886 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-9aee05bd-1cdd-4bfd-b24c-eceabf93ab5e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:24.255067 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9aee05bd-1cdd-4bfd-b24c-eceabf93ab5e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:24.255547 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9aee05bd-1cdd-4bfd-b24c-eceabf93ab5e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:24.256334 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9aee05bd-1cdd-4bfd-b24c-eceabf93ab5e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:24.256767 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9aee05bd-1cdd-4bfd-b24c-eceabf93ab5e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:24.317100 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-9aee05bd-1cdd-4bfd-b24c-eceabf93ab5e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:24.324796 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-9aee05bd-1cdd-4bfd-b24c-eceabf93ab5e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080117 Jul 20 19:38:24.325361 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 886/1517] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:24 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:25.260378 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-7aaa63f5-88c1-4027-9033-057ba6264889 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:25.261084 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-7aaa63f5-88c1-4027-9033-057ba6264889 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:25.267538 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7aaa63f5-88c1-4027-9033-057ba6264889 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:25.268064 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7aaa63f5-88c1-4027-9033-057ba6264889 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:25.268873 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7aaa63f5-88c1-4027-9033-057ba6264889 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:25.269298 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7aaa63f5-88c1-4027-9033-057ba6264889 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:25.400645 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-7aaa63f5-88c1-4027-9033-057ba6264889 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:25.408076 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-7aaa63f5-88c1-4027-9033-057ba6264889 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.151697 Jul 20 19:38:25.408704 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 887/1518] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:25 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:38:25.413306 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-02d12ef6-6bb6-4958-acd0-4ad041a4ad31 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:25.413943 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-02d12ef6-6bb6-4958-acd0-4ad041a4ad31 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:25.419649 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-02d12ef6-6bb6-4958-acd0-4ad041a4ad31 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:25.420093 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-02d12ef6-6bb6-4958-acd0-4ad041a4ad31 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:25.420876 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-02d12ef6-6bb6-4958-acd0-4ad041a4ad31 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:25.421306 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-02d12ef6-6bb6-4958-acd0-4ad041a4ad31 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:25.484540 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-02d12ef6-6bb6-4958-acd0-4ad041a4ad31 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:25.492704 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-02d12ef6-6bb6-4958-acd0-4ad041a4ad31 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.082869 Jul 20 19:38:25.493262 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 888/1519] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:25 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:26.425616 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c6e2f357-be1b-4162-914e-695ee5e6c306 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:26.426292 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c6e2f357-be1b-4162-914e-695ee5e6c306 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:26.432661 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c6e2f357-be1b-4162-914e-695ee5e6c306 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:26.433109 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c6e2f357-be1b-4162-914e-695ee5e6c306 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:26.433888 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c6e2f357-be1b-4162-914e-695ee5e6c306 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:26.434322 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c6e2f357-be1b-4162-914e-695ee5e6c306 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:26.563851 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c6e2f357-be1b-4162-914e-695ee5e6c306 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:26.571640 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c6e2f357-be1b-4162-914e-695ee5e6c306 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.150475 Jul 20 19:38:26.572203 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 889/1520] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:26 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:38:26.576582 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-90cb72b2-3d76-453e-afaa-3779244dedf6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:26.577205 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-90cb72b2-3d76-453e-afaa-3779244dedf6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:26.583063 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-90cb72b2-3d76-453e-afaa-3779244dedf6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:26.583508 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-90cb72b2-3d76-453e-afaa-3779244dedf6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:26.584262 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-90cb72b2-3d76-453e-afaa-3779244dedf6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:26.584697 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-90cb72b2-3d76-453e-afaa-3779244dedf6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:26.645115 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-90cb72b2-3d76-453e-afaa-3779244dedf6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:26.652833 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-90cb72b2-3d76-453e-afaa-3779244dedf6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.079679 Jul 20 19:38:26.653399 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 890/1521] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:26 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:27.589103 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-1ba9021a-ec16-4716-94d3-9e5eb4a615ed tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:27.589784 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-1ba9021a-ec16-4716-94d3-9e5eb4a615ed tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:27.596476 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1ba9021a-ec16-4716-94d3-9e5eb4a615ed tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:27.597503 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1ba9021a-ec16-4716-94d3-9e5eb4a615ed tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:27.598371 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1ba9021a-ec16-4716-94d3-9e5eb4a615ed tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:27.598798 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1ba9021a-ec16-4716-94d3-9e5eb4a615ed tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:27.730240 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1ba9021a-ec16-4716-94d3-9e5eb4a615ed tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:27.737850 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-1ba9021a-ec16-4716-94d3-9e5eb4a615ed tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.152880 Jul 20 19:38:27.738420 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 891/1522] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:27 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:38:27.807812 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-2da1b8c7-6668-47ad-8f1c-7ad0047ae326 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:27.808456 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-2da1b8c7-6668-47ad-8f1c-7ad0047ae326 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:27.814475 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2da1b8c7-6668-47ad-8f1c-7ad0047ae326 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:27.814919 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2da1b8c7-6668-47ad-8f1c-7ad0047ae326 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:27.816188 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2da1b8c7-6668-47ad-8f1c-7ad0047ae326 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:27.816631 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2da1b8c7-6668-47ad-8f1c-7ad0047ae326 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:27.876218 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-2da1b8c7-6668-47ad-8f1c-7ad0047ae326 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:27.884333 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-2da1b8c7-6668-47ad-8f1c-7ad0047ae326 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.144969 Jul 20 19:38:27.884906 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 892/1523] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:27 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:28.755737 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d175d76f-1bbe-4c7b-8aab-b6f9d80db66f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:28.756413 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d175d76f-1bbe-4c7b-8aab-b6f9d80db66f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:28.763220 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d175d76f-1bbe-4c7b-8aab-b6f9d80db66f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:28.763664 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d175d76f-1bbe-4c7b-8aab-b6f9d80db66f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:28.764420 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d175d76f-1bbe-4c7b-8aab-b6f9d80db66f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:28.764843 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d175d76f-1bbe-4c7b-8aab-b6f9d80db66f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:28.895945 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d175d76f-1bbe-4c7b-8aab-b6f9d80db66f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:28.903451 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d175d76f-1bbe-4c7b-8aab-b6f9d80db66f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.152440 Jul 20 19:38:28.904001 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 893/1524] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:28 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:38:28.908319 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-60ad683d-8047-484c-9492-7ee76f632f99 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:28.908909 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-60ad683d-8047-484c-9492-7ee76f632f99 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:28.914825 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-60ad683d-8047-484c-9492-7ee76f632f99 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:28.915269 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-60ad683d-8047-484c-9492-7ee76f632f99 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:28.916019 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-60ad683d-8047-484c-9492-7ee76f632f99 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:28.916443 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-60ad683d-8047-484c-9492-7ee76f632f99 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:28.981821 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-60ad683d-8047-484c-9492-7ee76f632f99 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:28.990177 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-60ad683d-8047-484c-9492-7ee76f632f99 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.085250 Jul 20 19:38:28.990792 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 894/1525] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:28 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:29.920125 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-05e698c3-b166-4428-868d-7c2a71bde3ea tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:29.920795 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-05e698c3-b166-4428-868d-7c2a71bde3ea tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:29.927228 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-05e698c3-b166-4428-868d-7c2a71bde3ea tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:29.927672 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-05e698c3-b166-4428-868d-7c2a71bde3ea tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:29.928423 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-05e698c3-b166-4428-868d-7c2a71bde3ea tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:29.928862 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-05e698c3-b166-4428-868d-7c2a71bde3ea tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:30.058113 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-05e698c3-b166-4428-868d-7c2a71bde3ea tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:30.067788 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-05e698c3-b166-4428-868d-7c2a71bde3ea tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.151486 Jul 20 19:38:30.068365 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 895/1526] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:29 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:38:30.072711 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a2a9be3b-8b49-4113-900f-6a8e1b920d56 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:30.073320 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a2a9be3b-8b49-4113-900f-6a8e1b920d56 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:30.078968 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a2a9be3b-8b49-4113-900f-6a8e1b920d56 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:30.079422 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a2a9be3b-8b49-4113-900f-6a8e1b920d56 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:30.080192 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a2a9be3b-8b49-4113-900f-6a8e1b920d56 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:30.080630 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a2a9be3b-8b49-4113-900f-6a8e1b920d56 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:30.085119 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:30.142566 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a2a9be3b-8b49-4113-900f-6a8e1b920d56 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:30.150643 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a2a9be3b-8b49-4113-900f-6a8e1b920d56 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.081340 Jul 20 19:38:30.151242 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 896/1527] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:30 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:31.084566 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-f70d184d-9ab9-4f51-9a3c-9d1cf5ab6d53 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:31.085247 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-f70d184d-9ab9-4f51-9a3c-9d1cf5ab6d53 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:31.091810 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f70d184d-9ab9-4f51-9a3c-9d1cf5ab6d53 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:31.092260 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f70d184d-9ab9-4f51-9a3c-9d1cf5ab6d53 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:31.093024 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f70d184d-9ab9-4f51-9a3c-9d1cf5ab6d53 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:31.093455 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f70d184d-9ab9-4f51-9a3c-9d1cf5ab6d53 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:31.226415 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-f70d184d-9ab9-4f51-9a3c-9d1cf5ab6d53 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:31.233759 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-f70d184d-9ab9-4f51-9a3c-9d1cf5ab6d53 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.153113 Jul 20 19:38:31.234330 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 897/1528] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:31 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:38:31.239197 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-cefd8f9a-5dfa-4ac1-bc9f-0b78f7f10d8e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:31.239797 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-cefd8f9a-5dfa-4ac1-bc9f-0b78f7f10d8e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:31.245477 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cefd8f9a-5dfa-4ac1-bc9f-0b78f7f10d8e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:31.245945 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cefd8f9a-5dfa-4ac1-bc9f-0b78f7f10d8e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:31.246702 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cefd8f9a-5dfa-4ac1-bc9f-0b78f7f10d8e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:31.247132 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cefd8f9a-5dfa-4ac1-bc9f-0b78f7f10d8e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:31.306822 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-cefd8f9a-5dfa-4ac1-bc9f-0b78f7f10d8e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:31.314185 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-cefd8f9a-5dfa-4ac1-bc9f-0b78f7f10d8e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.078908 Jul 20 19:38:31.314751 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 898/1529] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:31 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:32.251514 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-aeaaea2a-1e28-437a-83ea-b3bf9961a176 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:32.252167 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-aeaaea2a-1e28-437a-83ea-b3bf9961a176 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:32.259149 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aeaaea2a-1e28-437a-83ea-b3bf9961a176 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:32.259588 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aeaaea2a-1e28-437a-83ea-b3bf9961a176 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:32.260342 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aeaaea2a-1e28-437a-83ea-b3bf9961a176 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:32.260764 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aeaaea2a-1e28-437a-83ea-b3bf9961a176 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:32.390741 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-aeaaea2a-1e28-437a-83ea-b3bf9961a176 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:32.400145 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-aeaaea2a-1e28-437a-83ea-b3bf9961a176 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.152464 Jul 20 19:38:32.400718 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 899/1530] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:32 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:38:32.405129 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-f8c8e64d-4553-4950-ae59-ae3531cdb8ca tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:32.405829 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-f8c8e64d-4553-4950-ae59-ae3531cdb8ca tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:32.411713 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f8c8e64d-4553-4950-ae59-ae3531cdb8ca tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:32.412161 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f8c8e64d-4553-4950-ae59-ae3531cdb8ca tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:32.412921 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f8c8e64d-4553-4950-ae59-ae3531cdb8ca tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:32.413358 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f8c8e64d-4553-4950-ae59-ae3531cdb8ca tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:32.476672 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-f8c8e64d-4553-4950-ae59-ae3531cdb8ca tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:32.484120 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-f8c8e64d-4553-4950-ae59-ae3531cdb8ca tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.082465 Jul 20 19:38:32.484682 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 900/1531] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:32 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:33.417767 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4261e910-dada-4365-9c57-9cf169476736 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:33.418406 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-4261e910-dada-4365-9c57-9cf169476736 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:33.424521 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4261e910-dada-4365-9c57-9cf169476736 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:33.425027 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4261e910-dada-4365-9c57-9cf169476736 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:33.425813 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4261e910-dada-4365-9c57-9cf169476736 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:33.426250 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4261e910-dada-4365-9c57-9cf169476736 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:33.791712 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-4261e910-dada-4365-9c57-9cf169476736 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:33.799120 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-4261e910-dada-4365-9c57-9cf169476736 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.385302 Jul 20 19:38:33.799684 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 901/1532] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:33 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:38:33.804166 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e0c8f429-0a0a-495b-9655-61f9e8bf59ef tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:33.804763 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e0c8f429-0a0a-495b-9655-61f9e8bf59ef tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:33.810527 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e0c8f429-0a0a-495b-9655-61f9e8bf59ef tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:33.810975 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e0c8f429-0a0a-495b-9655-61f9e8bf59ef tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:33.811735 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e0c8f429-0a0a-495b-9655-61f9e8bf59ef tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:33.812168 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e0c8f429-0a0a-495b-9655-61f9e8bf59ef tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:33.873133 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e0c8f429-0a0a-495b-9655-61f9e8bf59ef tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:33.881255 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e0c8f429-0a0a-495b-9655-61f9e8bf59ef tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080497 Jul 20 19:38:33.881861 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 902/1533] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:33 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:34.816468 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-8abb7ad9-4d48-43b9-8317-8ba6796f116c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:34.817150 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-8abb7ad9-4d48-43b9-8317-8ba6796f116c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:34.823712 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8abb7ad9-4d48-43b9-8317-8ba6796f116c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:34.824159 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8abb7ad9-4d48-43b9-8317-8ba6796f116c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:34.824918 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8abb7ad9-4d48-43b9-8317-8ba6796f116c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:34.825348 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8abb7ad9-4d48-43b9-8317-8ba6796f116c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:34.957384 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8abb7ad9-4d48-43b9-8317-8ba6796f116c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:34.964761 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-8abb7ad9-4d48-43b9-8317-8ba6796f116c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.152450 Jul 20 19:38:34.965325 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 903/1534] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:34 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:38:34.969924 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-3d85a2b1-438e-45d9-a5e3-5699e39f2fda tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:34.970517 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-3d85a2b1-438e-45d9-a5e3-5699e39f2fda tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:34.976680 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3d85a2b1-438e-45d9-a5e3-5699e39f2fda tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:34.977123 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3d85a2b1-438e-45d9-a5e3-5699e39f2fda tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:34.977909 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3d85a2b1-438e-45d9-a5e3-5699e39f2fda tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:34.978336 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3d85a2b1-438e-45d9-a5e3-5699e39f2fda tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:35.038981 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3d85a2b1-438e-45d9-a5e3-5699e39f2fda tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:35.046700 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-3d85a2b1-438e-45d9-a5e3-5699e39f2fda tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080418 Jul 20 19:38:35.047258 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 904/1535] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:34 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:35.982003 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d104e937-d8c7-4ad7-bc80-5635e3a1f8cb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:35.982643 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d104e937-d8c7-4ad7-bc80-5635e3a1f8cb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:35.989837 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d104e937-d8c7-4ad7-bc80-5635e3a1f8cb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:35.990232 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d104e937-d8c7-4ad7-bc80-5635e3a1f8cb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:35.991034 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d104e937-d8c7-4ad7-bc80-5635e3a1f8cb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:35.991469 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d104e937-d8c7-4ad7-bc80-5635e3a1f8cb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:36.120726 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d104e937-d8c7-4ad7-bc80-5635e3a1f8cb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:36.128226 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d104e937-d8c7-4ad7-bc80-5635e3a1f8cb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.150138 Jul 20 19:38:36.128801 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 905/1536] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:35 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:38:36.133185 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-55c14230-3939-41fa-a386-01695c1e0566 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:36.133811 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-55c14230-3939-41fa-a386-01695c1e0566 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:36.139500 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-55c14230-3939-41fa-a386-01695c1e0566 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:36.139948 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-55c14230-3939-41fa-a386-01695c1e0566 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:36.140707 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-55c14230-3939-41fa-a386-01695c1e0566 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:36.141140 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-55c14230-3939-41fa-a386-01695c1e0566 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:36.204396 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-55c14230-3939-41fa-a386-01695c1e0566 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:36.212007 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-55c14230-3939-41fa-a386-01695c1e0566 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.082268 Jul 20 19:38:36.212581 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 906/1537] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:36 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:37.146019 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-6fcdf620-e6a5-42ee-af19-944d142e21fb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:37.146706 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-6fcdf620-e6a5-42ee-af19-944d142e21fb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:37.153029 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6fcdf620-e6a5-42ee-af19-944d142e21fb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:37.153472 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6fcdf620-e6a5-42ee-af19-944d142e21fb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:37.154260 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6fcdf620-e6a5-42ee-af19-944d142e21fb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:37.154688 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6fcdf620-e6a5-42ee-af19-944d142e21fb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:37.284764 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6fcdf620-e6a5-42ee-af19-944d142e21fb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:37.292174 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-6fcdf620-e6a5-42ee-af19-944d142e21fb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.150728 Jul 20 19:38:37.292732 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 907/1538] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:37 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:38:37.297029 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-9f47af99-c286-44f4-af18-66707e94e50f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:37.297678 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-9f47af99-c286-44f4-af18-66707e94e50f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:37.303853 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9f47af99-c286-44f4-af18-66707e94e50f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:37.304301 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9f47af99-c286-44f4-af18-66707e94e50f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:37.305048 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9f47af99-c286-44f4-af18-66707e94e50f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:37.305470 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9f47af99-c286-44f4-af18-66707e94e50f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:37.367712 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-9f47af99-c286-44f4-af18-66707e94e50f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:37.374983 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-9f47af99-c286-44f4-af18-66707e94e50f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.081334 Jul 20 19:38:37.375539 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 908/1539] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:37 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:38.308759 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4f436db0-8b0a-4321-a7fe-cb3b794e2b23 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:38.309488 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-4f436db0-8b0a-4321-a7fe-cb3b794e2b23 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:38.316248 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4f436db0-8b0a-4321-a7fe-cb3b794e2b23 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:38.316694 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4f436db0-8b0a-4321-a7fe-cb3b794e2b23 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:38.317478 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4f436db0-8b0a-4321-a7fe-cb3b794e2b23 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:38.317909 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4f436db0-8b0a-4321-a7fe-cb3b794e2b23 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:38.449310 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-4f436db0-8b0a-4321-a7fe-cb3b794e2b23 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:38.457188 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-4f436db0-8b0a-4321-a7fe-cb3b794e2b23 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.152225 Jul 20 19:38:38.458097 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 909/1540] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:38 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:38:38.462657 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-f53844df-e3ca-46cf-bc93-0b86c19ee31c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:38.463247 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-f53844df-e3ca-46cf-bc93-0b86c19ee31c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:38.469179 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f53844df-e3ca-46cf-bc93-0b86c19ee31c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:38.469668 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f53844df-e3ca-46cf-bc93-0b86c19ee31c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:38.470424 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f53844df-e3ca-46cf-bc93-0b86c19ee31c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:38.470857 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f53844df-e3ca-46cf-bc93-0b86c19ee31c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:38.531834 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-f53844df-e3ca-46cf-bc93-0b86c19ee31c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:38.540257 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-f53844df-e3ca-46cf-bc93-0b86c19ee31c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.081164 Jul 20 19:38:38.540822 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 910/1541] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:38 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:39.475540 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-7fc83e8b-bfb1-4856-ab28-d45dbb58839e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:39.476162 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-7fc83e8b-bfb1-4856-ab28-d45dbb58839e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:39.482688 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7fc83e8b-bfb1-4856-ab28-d45dbb58839e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:39.483143 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7fc83e8b-bfb1-4856-ab28-d45dbb58839e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:39.483905 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7fc83e8b-bfb1-4856-ab28-d45dbb58839e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:39.484342 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7fc83e8b-bfb1-4856-ab28-d45dbb58839e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:39.615156 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-7fc83e8b-bfb1-4856-ab28-d45dbb58839e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:39.622577 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-7fc83e8b-bfb1-4856-ab28-d45dbb58839e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.150945 Jul 20 19:38:39.623135 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 911/1542] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:39 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:38:39.627460 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-57875b7f-4ce3-4e2a-af0a-e3c4d162bab2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:39.628890 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-57875b7f-4ce3-4e2a-af0a-e3c4d162bab2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:39.634660 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-57875b7f-4ce3-4e2a-af0a-e3c4d162bab2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:39.635101 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-57875b7f-4ce3-4e2a-af0a-e3c4d162bab2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:39.635881 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-57875b7f-4ce3-4e2a-af0a-e3c4d162bab2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:39.636308 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-57875b7f-4ce3-4e2a-af0a-e3c4d162bab2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:39.701822 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-57875b7f-4ce3-4e2a-af0a-e3c4d162bab2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:39.704001 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:39.710803 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-57875b7f-4ce3-4e2a-af0a-e3c4d162bab2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.086713 Jul 20 19:38:39.711404 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 912/1543] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:39 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:40.640164 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-2e4375c5-3505-49bf-b1a4-2be65e9badd9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:40.640836 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-2e4375c5-3505-49bf-b1a4-2be65e9badd9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:40.648121 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2e4375c5-3505-49bf-b1a4-2be65e9badd9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:40.648569 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2e4375c5-3505-49bf-b1a4-2be65e9badd9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:40.649339 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2e4375c5-3505-49bf-b1a4-2be65e9badd9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:40.649791 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2e4375c5-3505-49bf-b1a4-2be65e9badd9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:40.779331 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-2e4375c5-3505-49bf-b1a4-2be65e9badd9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:40.787015 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-2e4375c5-3505-49bf-b1a4-2be65e9badd9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.150793 Jul 20 19:38:40.787578 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 913/1544] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:40 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:38:40.792071 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-58dc59ee-6e40-407f-9cac-f0c78775a295 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:40.792664 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-58dc59ee-6e40-407f-9cac-f0c78775a295 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:40.798239 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-58dc59ee-6e40-407f-9cac-f0c78775a295 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:40.798690 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-58dc59ee-6e40-407f-9cac-f0c78775a295 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:40.799470 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-58dc59ee-6e40-407f-9cac-f0c78775a295 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:40.800222 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-58dc59ee-6e40-407f-9cac-f0c78775a295 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:40.861570 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-58dc59ee-6e40-407f-9cac-f0c78775a295 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:40.869501 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-58dc59ee-6e40-407f-9cac-f0c78775a295 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080957 Jul 20 19:38:40.870099 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 914/1545] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:40 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:41.803912 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-26eb3f69-54b5-46ed-8e89-840e7d72f343 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:41.804877 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-26eb3f69-54b5-46ed-8e89-840e7d72f343 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:41.811000 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-26eb3f69-54b5-46ed-8e89-840e7d72f343 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:41.811436 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-26eb3f69-54b5-46ed-8e89-840e7d72f343 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:41.812183 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-26eb3f69-54b5-46ed-8e89-840e7d72f343 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:41.812607 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-26eb3f69-54b5-46ed-8e89-840e7d72f343 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:41.944419 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-26eb3f69-54b5-46ed-8e89-840e7d72f343 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:41.951864 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-26eb3f69-54b5-46ed-8e89-840e7d72f343 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.151840 Jul 20 19:38:41.952423 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 915/1546] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:41 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:38:41.957265 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-8d6d5b0b-0218-41d1-8d05-48d3f797aa4e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:41.957889 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-8d6d5b0b-0218-41d1-8d05-48d3f797aa4e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:41.963586 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8d6d5b0b-0218-41d1-8d05-48d3f797aa4e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:41.964025 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8d6d5b0b-0218-41d1-8d05-48d3f797aa4e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:41.964780 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8d6d5b0b-0218-41d1-8d05-48d3f797aa4e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:41.965210 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8d6d5b0b-0218-41d1-8d05-48d3f797aa4e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:42.026397 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8d6d5b0b-0218-41d1-8d05-48d3f797aa4e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:42.033886 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-8d6d5b0b-0218-41d1-8d05-48d3f797aa4e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080498 Jul 20 19:38:42.034829 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 916/1547] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:41 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:42.969745 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-cced5dee-c9d0-4e46-bc43-291e88a38cc9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:42.970426 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-cced5dee-c9d0-4e46-bc43-291e88a38cc9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:42.977417 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cced5dee-c9d0-4e46-bc43-291e88a38cc9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:42.977893 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cced5dee-c9d0-4e46-bc43-291e88a38cc9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:42.978649 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cced5dee-c9d0-4e46-bc43-291e88a38cc9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:42.979078 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cced5dee-c9d0-4e46-bc43-291e88a38cc9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:43.106148 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-cced5dee-c9d0-4e46-bc43-291e88a38cc9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:43.114231 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-cced5dee-c9d0-4e46-bc43-291e88a38cc9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.148800 Jul 20 19:38:43.114810 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 917/1548] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:42 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:38:43.119212 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4028ab45-eb69-4fc6-b572-71ed5905785d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:43.119811 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-4028ab45-eb69-4fc6-b572-71ed5905785d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:43.125409 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4028ab45-eb69-4fc6-b572-71ed5905785d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:43.125958 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4028ab45-eb69-4fc6-b572-71ed5905785d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:43.126721 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4028ab45-eb69-4fc6-b572-71ed5905785d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:43.127159 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4028ab45-eb69-4fc6-b572-71ed5905785d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:43.191172 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-4028ab45-eb69-4fc6-b572-71ed5905785d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:43.199094 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-4028ab45-eb69-4fc6-b572-71ed5905785d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.083333 Jul 20 19:38:43.199654 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 918/1549] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:43 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:44.131215 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c88e6ae0-1b1b-4855-aad7-c7ec0981d594 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:44.131892 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c88e6ae0-1b1b-4855-aad7-c7ec0981d594 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:44.134161 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_api:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:44.139464 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c88e6ae0-1b1b-4855-aad7-c7ec0981d594 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:44.139902 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c88e6ae0-1b1b-4855-aad7-c7ec0981d594 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:44.140662 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c88e6ae0-1b1b-4855-aad7-c7ec0981d594 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:44.141084 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c88e6ae0-1b1b-4855-aad7-c7ec0981d594 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:44.357354 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c88e6ae0-1b1b-4855-aad7-c7ec0981d594 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:44.365736 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c88e6ae0-1b1b-4855-aad7-c7ec0981d594 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.239051 Jul 20 19:38:44.366309 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 919/1550] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:44 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:38:44.370658 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-2e1e6fb2-57e3-4774-813a-f6083f242663 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:44.371272 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-2e1e6fb2-57e3-4774-813a-f6083f242663 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:44.376732 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2e1e6fb2-57e3-4774-813a-f6083f242663 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:44.377182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2e1e6fb2-57e3-4774-813a-f6083f242663 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:44.378000 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2e1e6fb2-57e3-4774-813a-f6083f242663 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:44.378442 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2e1e6fb2-57e3-4774-813a-f6083f242663 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:44.441598 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-2e1e6fb2-57e3-4774-813a-f6083f242663 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:44.449062 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-2e1e6fb2-57e3-4774-813a-f6083f242663 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.081814 Jul 20 19:38:44.449654 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 920/1551] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:44 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:45.064606 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 19:38:45.064858 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Wed Jul 20 19:38:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 19:38:45.383442 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-52d0e7a1-e754-4589-b95e-20c93d231ca8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:45.384090 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-52d0e7a1-e754-4589-b95e-20c93d231ca8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:45.390480 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-52d0e7a1-e754-4589-b95e-20c93d231ca8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:45.390919 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-52d0e7a1-e754-4589-b95e-20c93d231ca8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:45.391696 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-52d0e7a1-e754-4589-b95e-20c93d231ca8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:45.392122 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-52d0e7a1-e754-4589-b95e-20c93d231ca8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:45.525382 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-52d0e7a1-e754-4589-b95e-20c93d231ca8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:45.533178 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-52d0e7a1-e754-4589-b95e-20c93d231ca8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.153516 Jul 20 19:38:45.533773 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 921/1552] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:45 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:45.538266 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-19bb1692-8369-4d4b-8884-f437387374f7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:45.539034 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-19bb1692-8369-4d4b-8884-f437387374f7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:45.544926 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-19bb1692-8369-4d4b-8884-f437387374f7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:45.545361 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-19bb1692-8369-4d4b-8884-f437387374f7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:45.546148 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-19bb1692-8369-4d4b-8884-f437387374f7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:45.546574 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-19bb1692-8369-4d4b-8884-f437387374f7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:45.607779 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-19bb1692-8369-4d4b-8884-f437387374f7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:45.615398 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-19bb1692-8369-4d4b-8884-f437387374f7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080663 Jul 20 19:38:45.615968 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 922/1553] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:45 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:46.550645 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-1b65c545-c737-4fcb-8f3a-f42215b90ebf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:46.551348 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-1b65c545-c737-4fcb-8f3a-f42215b90ebf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:46.557740 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1b65c545-c737-4fcb-8f3a-f42215b90ebf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:46.558199 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1b65c545-c737-4fcb-8f3a-f42215b90ebf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:46.558982 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1b65c545-c737-4fcb-8f3a-f42215b90ebf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:46.559425 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1b65c545-c737-4fcb-8f3a-f42215b90ebf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:46.736674 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1b65c545-c737-4fcb-8f3a-f42215b90ebf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:46.744352 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-1b65c545-c737-4fcb-8f3a-f42215b90ebf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.197661 Jul 20 19:38:46.744905 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 923/1554] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:46 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:38:46.749228 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-15d7a595-3575-436a-8026-ccef26169524 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:46.749880 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-15d7a595-3575-436a-8026-ccef26169524 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:46.756119 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-15d7a595-3575-436a-8026-ccef26169524 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:46.756570 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-15d7a595-3575-436a-8026-ccef26169524 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:46.757340 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-15d7a595-3575-436a-8026-ccef26169524 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:46.757810 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-15d7a595-3575-436a-8026-ccef26169524 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:46.822647 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-15d7a595-3575-436a-8026-ccef26169524 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:46.830100 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-15d7a595-3575-436a-8026-ccef26169524 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.084245 Jul 20 19:38:46.830679 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 924/1555] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:46 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:47.161258 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 19:38:47.161440 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Wed Jul 20 19:38:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 19:38:47.761790 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-92b7a2c3-8fa0-439b-b0ae-16f717e8f757 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:47.762492 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-92b7a2c3-8fa0-439b-b0ae-16f717e8f757 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:47.768909 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-92b7a2c3-8fa0-439b-b0ae-16f717e8f757 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:47.769375 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-92b7a2c3-8fa0-439b-b0ae-16f717e8f757 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:47.770168 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-92b7a2c3-8fa0-439b-b0ae-16f717e8f757 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:47.770603 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-92b7a2c3-8fa0-439b-b0ae-16f717e8f757 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:47.903036 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-92b7a2c3-8fa0-439b-b0ae-16f717e8f757 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:47.911044 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-92b7a2c3-8fa0-439b-b0ae-16f717e8f757 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.153180 Jul 20 19:38:47.911605 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 925/1556] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:47 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:38:47.915955 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-1c444f5b-6c01-4b8e-90ea-77eea8cbd7f1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:47.916556 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-1c444f5b-6c01-4b8e-90ea-77eea8cbd7f1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:47.922111 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1c444f5b-6c01-4b8e-90ea-77eea8cbd7f1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:47.922561 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1c444f5b-6c01-4b8e-90ea-77eea8cbd7f1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:47.923322 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1c444f5b-6c01-4b8e-90ea-77eea8cbd7f1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:47.923760 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1c444f5b-6c01-4b8e-90ea-77eea8cbd7f1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:47.985137 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1c444f5b-6c01-4b8e-90ea-77eea8cbd7f1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:47.993308 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-1c444f5b-6c01-4b8e-90ea-77eea8cbd7f1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080763 Jul 20 19:38:47.993899 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 926/1557] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:47 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:48.928109 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-bdd05872-b49b-44df-810b-2cf62abab87d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:48.928851 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-bdd05872-b49b-44df-810b-2cf62abab87d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:48.935242 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bdd05872-b49b-44df-810b-2cf62abab87d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:48.935693 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bdd05872-b49b-44df-810b-2cf62abab87d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:48.936457 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bdd05872-b49b-44df-810b-2cf62abab87d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:48.936921 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bdd05872-b49b-44df-810b-2cf62abab87d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:49.070959 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-bdd05872-b49b-44df-810b-2cf62abab87d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:49.078491 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-bdd05872-b49b-44df-810b-2cf62abab87d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.154428 Jul 20 19:38:49.079062 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 927/1558] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:48 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:38:49.084196 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-0d1b4958-1de7-4443-97de-4e2cc2454176 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:49.084810 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-0d1b4958-1de7-4443-97de-4e2cc2454176 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:49.090824 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0d1b4958-1de7-4443-97de-4e2cc2454176 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:49.091275 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0d1b4958-1de7-4443-97de-4e2cc2454176 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:49.092050 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0d1b4958-1de7-4443-97de-4e2cc2454176 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:49.092488 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0d1b4958-1de7-4443-97de-4e2cc2454176 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:49.155479 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0d1b4958-1de7-4443-97de-4e2cc2454176 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:49.163138 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-0d1b4958-1de7-4443-97de-4e2cc2454176 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.083126 Jul 20 19:38:49.163771 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 928/1559] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:49 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:50.096405 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-93ca7fd0-ab23-481b-8c0f-e05eca29cbbd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:50.097226 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-93ca7fd0-ab23-481b-8c0f-e05eca29cbbd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:50.103551 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-93ca7fd0-ab23-481b-8c0f-e05eca29cbbd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:50.104008 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-93ca7fd0-ab23-481b-8c0f-e05eca29cbbd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:50.104887 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-93ca7fd0-ab23-481b-8c0f-e05eca29cbbd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:50.105317 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-93ca7fd0-ab23-481b-8c0f-e05eca29cbbd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:50.120560 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:50.235849 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-93ca7fd0-ab23-481b-8c0f-e05eca29cbbd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:50.243856 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-93ca7fd0-ab23-481b-8c0f-e05eca29cbbd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.151557 Jul 20 19:38:50.244415 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 929/1560] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:50 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:38:50.248776 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-2332bb0e-55aa-4b56-8a46-25c1116d53b9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:50.249372 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-2332bb0e-55aa-4b56-8a46-25c1116d53b9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:50.255717 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2332bb0e-55aa-4b56-8a46-25c1116d53b9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:50.256187 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2332bb0e-55aa-4b56-8a46-25c1116d53b9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:50.256941 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2332bb0e-55aa-4b56-8a46-25c1116d53b9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:50.257372 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2332bb0e-55aa-4b56-8a46-25c1116d53b9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:50.320646 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-2332bb0e-55aa-4b56-8a46-25c1116d53b9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:50.328219 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-2332bb0e-55aa-4b56-8a46-25c1116d53b9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.082846 Jul 20 19:38:50.328786 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 930/1561] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:50 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:51.260970 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-051d07cc-044c-40e6-955d-59302560104c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:51.261691 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-051d07cc-044c-40e6-955d-59302560104c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:51.268057 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-051d07cc-044c-40e6-955d-59302560104c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:51.268495 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-051d07cc-044c-40e6-955d-59302560104c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:51.269895 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-051d07cc-044c-40e6-955d-59302560104c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:51.270336 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-051d07cc-044c-40e6-955d-59302560104c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:51.405971 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-051d07cc-044c-40e6-955d-59302560104c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:51.414514 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-051d07cc-044c-40e6-955d-59302560104c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.157382 Jul 20 19:38:51.415100 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 931/1562] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:51 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:38:51.419647 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a1cd931d-4c7f-472d-a8c5-c87c2c1a5852 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:51.420246 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a1cd931d-4c7f-472d-a8c5-c87c2c1a5852 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:51.426515 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a1cd931d-4c7f-472d-a8c5-c87c2c1a5852 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:51.427002 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a1cd931d-4c7f-472d-a8c5-c87c2c1a5852 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:51.427716 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a1cd931d-4c7f-472d-a8c5-c87c2c1a5852 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:51.428165 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a1cd931d-4c7f-472d-a8c5-c87c2c1a5852 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:51.494904 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a1cd931d-4c7f-472d-a8c5-c87c2c1a5852 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:51.502449 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a1cd931d-4c7f-472d-a8c5-c87c2c1a5852 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.086418 Jul 20 19:38:51.503519 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 932/1563] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:51 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:52.432227 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-5e32fa6e-b047-4053-9385-21995e1cbe4c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:52.432863 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-5e32fa6e-b047-4053-9385-21995e1cbe4c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:52.439417 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5e32fa6e-b047-4053-9385-21995e1cbe4c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:52.439865 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5e32fa6e-b047-4053-9385-21995e1cbe4c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:52.440728 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5e32fa6e-b047-4053-9385-21995e1cbe4c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:52.441174 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5e32fa6e-b047-4053-9385-21995e1cbe4c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:52.575884 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-5e32fa6e-b047-4053-9385-21995e1cbe4c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:52.583915 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-5e32fa6e-b047-4053-9385-21995e1cbe4c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.155652 Jul 20 19:38:52.584476 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 933/1564] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:52 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:38:52.588791 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d489c8a6-4e09-4daf-bd4a-36feffdf74a0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:52.589370 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d489c8a6-4e09-4daf-bd4a-36feffdf74a0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:52.595183 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d489c8a6-4e09-4daf-bd4a-36feffdf74a0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:52.595618 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d489c8a6-4e09-4daf-bd4a-36feffdf74a0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:52.596393 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d489c8a6-4e09-4daf-bd4a-36feffdf74a0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:52.597452 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d489c8a6-4e09-4daf-bd4a-36feffdf74a0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:52.659370 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d489c8a6-4e09-4daf-bd4a-36feffdf74a0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:52.667549 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d489c8a6-4e09-4daf-bd4a-36feffdf74a0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.082130 Jul 20 19:38:52.668111 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 934/1565] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:52 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:53.601184 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-31325cc2-d5a3-4bcc-8f70-a3cbdde3ec39 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:53.601934 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-31325cc2-d5a3-4bcc-8f70-a3cbdde3ec39 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:53.608268 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-31325cc2-d5a3-4bcc-8f70-a3cbdde3ec39 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:53.608716 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-31325cc2-d5a3-4bcc-8f70-a3cbdde3ec39 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:53.609480 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-31325cc2-d5a3-4bcc-8f70-a3cbdde3ec39 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:53.609940 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-31325cc2-d5a3-4bcc-8f70-a3cbdde3ec39 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:53.741615 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-31325cc2-d5a3-4bcc-8f70-a3cbdde3ec39 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:53.749131 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-31325cc2-d5a3-4bcc-8f70-a3cbdde3ec39 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.151989 Jul 20 19:38:53.749729 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 935/1566] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:53 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:38:53.754766 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-aa446e9a-c1bf-42d9-b552-fd7868f374a6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:53.755377 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-aa446e9a-c1bf-42d9-b552-fd7868f374a6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:53.761188 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aa446e9a-c1bf-42d9-b552-fd7868f374a6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:53.761674 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aa446e9a-c1bf-42d9-b552-fd7868f374a6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:53.762443 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aa446e9a-c1bf-42d9-b552-fd7868f374a6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:53.762881 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aa446e9a-c1bf-42d9-b552-fd7868f374a6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:53.828255 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-aa446e9a-c1bf-42d9-b552-fd7868f374a6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:53.835835 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-aa446e9a-c1bf-42d9-b552-fd7868f374a6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.085083 Jul 20 19:38:53.836437 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 936/1567] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:53 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:54.767083 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-cbcdcf75-4630-4649-a547-4753e707dac7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:54.767757 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-cbcdcf75-4630-4649-a547-4753e707dac7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:54.774318 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cbcdcf75-4630-4649-a547-4753e707dac7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:54.774770 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cbcdcf75-4630-4649-a547-4753e707dac7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:54.775533 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cbcdcf75-4630-4649-a547-4753e707dac7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:54.775969 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cbcdcf75-4630-4649-a547-4753e707dac7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:54.911740 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-cbcdcf75-4630-4649-a547-4753e707dac7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:54.919916 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-cbcdcf75-4630-4649-a547-4753e707dac7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.156690 Jul 20 19:38:54.920486 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 937/1568] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:54 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:38:54.925729 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-39b5e551-18ca-4fc2-bfab-1df6712d02c6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:54.926451 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-39b5e551-18ca-4fc2-bfab-1df6712d02c6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:54.932229 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-39b5e551-18ca-4fc2-bfab-1df6712d02c6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:54.932670 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-39b5e551-18ca-4fc2-bfab-1df6712d02c6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:54.933423 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-39b5e551-18ca-4fc2-bfab-1df6712d02c6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:54.933896 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-39b5e551-18ca-4fc2-bfab-1df6712d02c6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:54.994488 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-39b5e551-18ca-4fc2-bfab-1df6712d02c6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:55.001764 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-39b5e551-18ca-4fc2-bfab-1df6712d02c6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080310 Jul 20 19:38:55.002323 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 938/1569] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:54 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:55.936828 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-f14d422b-f2f3-481f-ba3c-d06922a5c082 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:55.937460 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-f14d422b-f2f3-481f-ba3c-d06922a5c082 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:55.945080 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f14d422b-f2f3-481f-ba3c-d06922a5c082 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:55.945466 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f14d422b-f2f3-481f-ba3c-d06922a5c082 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:55.946267 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f14d422b-f2f3-481f-ba3c-d06922a5c082 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:55.946700 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f14d422b-f2f3-481f-ba3c-d06922a5c082 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:56.081987 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-f14d422b-f2f3-481f-ba3c-d06922a5c082 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:56.089599 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-f14d422b-f2f3-481f-ba3c-d06922a5c082 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.156533 Jul 20 19:38:56.090170 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 939/1570] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:55 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:38:56.094884 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a324ea25-25fb-4a98-b43a-b4fed1a05ec8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:56.095484 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a324ea25-25fb-4a98-b43a-b4fed1a05ec8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:56.101247 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a324ea25-25fb-4a98-b43a-b4fed1a05ec8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:56.101735 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a324ea25-25fb-4a98-b43a-b4fed1a05ec8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:56.102495 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a324ea25-25fb-4a98-b43a-b4fed1a05ec8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:56.102928 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a324ea25-25fb-4a98-b43a-b4fed1a05ec8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:56.163814 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a324ea25-25fb-4a98-b43a-b4fed1a05ec8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:56.171284 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a324ea25-25fb-4a98-b43a-b4fed1a05ec8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080182 Jul 20 19:38:56.171842 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 940/1571] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:56 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:57.107555 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-519f5746-8187-406f-9178-de1df42345b2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:57.108210 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-519f5746-8187-406f-9178-de1df42345b2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:57.114689 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-519f5746-8187-406f-9178-de1df42345b2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:57.115130 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-519f5746-8187-406f-9178-de1df42345b2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:57.115884 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-519f5746-8187-406f-9178-de1df42345b2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:57.116313 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-519f5746-8187-406f-9178-de1df42345b2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:57.249378 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-519f5746-8187-406f-9178-de1df42345b2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:57.257386 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-519f5746-8187-406f-9178-de1df42345b2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.153724 Jul 20 19:38:57.257982 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 941/1572] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:57 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:38:57.262304 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-10623fc5-78ed-4aa3-8707-c31498bbdeba tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:57.262933 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-10623fc5-78ed-4aa3-8707-c31498bbdeba tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:57.268601 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-10623fc5-78ed-4aa3-8707-c31498bbdeba tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:57.269634 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-10623fc5-78ed-4aa3-8707-c31498bbdeba tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:57.270408 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-10623fc5-78ed-4aa3-8707-c31498bbdeba tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:57.270842 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-10623fc5-78ed-4aa3-8707-c31498bbdeba tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:57.335698 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-10623fc5-78ed-4aa3-8707-c31498bbdeba tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:57.343253 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-10623fc5-78ed-4aa3-8707-c31498bbdeba tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.084331 Jul 20 19:38:57.343815 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 942/1573] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:57 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:58.275291 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e8a25511-e965-42aa-9197-7aa078e955cd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:58.275940 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e8a25511-e965-42aa-9197-7aa078e955cd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:58.282600 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e8a25511-e965-42aa-9197-7aa078e955cd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:58.283045 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e8a25511-e965-42aa-9197-7aa078e955cd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:58.283802 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e8a25511-e965-42aa-9197-7aa078e955cd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:58.284885 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e8a25511-e965-42aa-9197-7aa078e955cd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:58.417469 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e8a25511-e965-42aa-9197-7aa078e955cd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:58.425118 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e8a25511-e965-42aa-9197-7aa078e955cd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.153753 Jul 20 19:38:58.425789 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 943/1574] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:58 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:38:58.430225 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-9927289b-683f-4823-9869-59758daa33e0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:58.430825 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-9927289b-683f-4823-9869-59758daa33e0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:58.436698 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9927289b-683f-4823-9869-59758daa33e0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:58.437143 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9927289b-683f-4823-9869-59758daa33e0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:58.437966 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9927289b-683f-4823-9869-59758daa33e0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:58.438415 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9927289b-683f-4823-9869-59758daa33e0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:58.501381 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-9927289b-683f-4823-9869-59758daa33e0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:58.509668 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-9927289b-683f-4823-9869-59758daa33e0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.082850 Jul 20 19:38:58.510242 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 944/1575] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:58 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:59.442254 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-04fcb9a3-e8b4-4464-8783-74ad8c979515 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:59.442920 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-04fcb9a3-e8b4-4464-8783-74ad8c979515 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:59.449432 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-04fcb9a3-e8b4-4464-8783-74ad8c979515 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:59.449938 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-04fcb9a3-e8b4-4464-8783-74ad8c979515 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:59.450706 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-04fcb9a3-e8b4-4464-8783-74ad8c979515 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:59.451136 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-04fcb9a3-e8b4-4464-8783-74ad8c979515 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:59.584212 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-04fcb9a3-e8b4-4464-8783-74ad8c979515 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:59.591751 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-04fcb9a3-e8b4-4464-8783-74ad8c979515 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.153481 Jul 20 19:38:59.592308 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 945/1576] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:59 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:38:59.597906 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-f0c317a3-fbc3-4678-9cc8-d933fa4a4d1e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:59.598651 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-f0c317a3-fbc3-4678-9cc8-d933fa4a4d1e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:59.604492 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f0c317a3-fbc3-4678-9cc8-d933fa4a4d1e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:59.604927 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f0c317a3-fbc3-4678-9cc8-d933fa4a4d1e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:59.605702 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f0c317a3-fbc3-4678-9cc8-d933fa4a4d1e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:59.606133 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f0c317a3-fbc3-4678-9cc8-d933fa4a4d1e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:59.609960 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:59.667137 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-f0c317a3-fbc3-4678-9cc8-d933fa4a4d1e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:59.674531 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-f0c317a3-fbc3-4678-9cc8-d933fa4a4d1e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.081299 Jul 20 19:38:59.675797 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 946/1577] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:59 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:39:00.609084 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-da657e8e-b2d9-4910-b546-b798bda1901a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:00.609747 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-da657e8e-b2d9-4910-b546-b798bda1901a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:00.616915 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-da657e8e-b2d9-4910-b546-b798bda1901a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:00.617352 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-da657e8e-b2d9-4910-b546-b798bda1901a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:00.618133 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-da657e8e-b2d9-4910-b546-b798bda1901a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:00.618560 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-da657e8e-b2d9-4910-b546-b798bda1901a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:00.749108 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-da657e8e-b2d9-4910-b546-b798bda1901a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:00.757625 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-da657e8e-b2d9-4910-b546-b798bda1901a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.152559 Jul 20 19:39:00.758196 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 947/1578] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:00 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:39:00.762582 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-0cf1f1d6-0610-425a-980e-9f6646fd715e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:00.763173 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-0cf1f1d6-0610-425a-980e-9f6646fd715e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:00.769023 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0cf1f1d6-0610-425a-980e-9f6646fd715e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:00.769594 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0cf1f1d6-0610-425a-980e-9f6646fd715e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:00.770352 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0cf1f1d6-0610-425a-980e-9f6646fd715e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:00.770781 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0cf1f1d6-0610-425a-980e-9f6646fd715e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:00.835549 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0cf1f1d6-0610-425a-980e-9f6646fd715e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:00.843378 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-0cf1f1d6-0610-425a-980e-9f6646fd715e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.084257 Jul 20 19:39:00.843934 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 948/1579] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:00 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:39:01.775244 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-9611bfb5-63b2-4b89-a363-f9f512a4eb11 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:01.776071 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-9611bfb5-63b2-4b89-a363-f9f512a4eb11 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:01.782727 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9611bfb5-63b2-4b89-a363-f9f512a4eb11 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:01.783181 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9611bfb5-63b2-4b89-a363-f9f512a4eb11 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:01.784003 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9611bfb5-63b2-4b89-a363-f9f512a4eb11 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:01.784629 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9611bfb5-63b2-4b89-a363-f9f512a4eb11 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:01.916601 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-9611bfb5-63b2-4b89-a363-f9f512a4eb11 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:01.924203 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-9611bfb5-63b2-4b89-a363-f9f512a4eb11 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.152810 Jul 20 19:39:01.925389 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 949/1580] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:01 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:39:01.929979 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-65865477-9445-447d-b079-1ac995de126f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:01.930601 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-65865477-9445-447d-b079-1ac995de126f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:01.936702 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-65865477-9445-447d-b079-1ac995de126f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:01.937154 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-65865477-9445-447d-b079-1ac995de126f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:01.937992 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-65865477-9445-447d-b079-1ac995de126f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:01.938429 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-65865477-9445-447d-b079-1ac995de126f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:02.002119 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-65865477-9445-447d-b079-1ac995de126f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:02.009802 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-65865477-9445-447d-b079-1ac995de126f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.083402 Jul 20 19:39:02.010373 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 950/1581] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:01 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:39:02.942816 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-7533b825-d408-49d2-928e-1e2ef385c45a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:02.943434 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-7533b825-d408-49d2-928e-1e2ef385c45a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:02.949924 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7533b825-d408-49d2-928e-1e2ef385c45a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:02.950376 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7533b825-d408-49d2-928e-1e2ef385c45a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:02.951143 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7533b825-d408-49d2-928e-1e2ef385c45a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:02.951581 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7533b825-d408-49d2-928e-1e2ef385c45a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:03.251927 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-7533b825-d408-49d2-928e-1e2ef385c45a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:03.260048 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-7533b825-d408-49d2-928e-1e2ef385c45a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.321444 Jul 20 19:39:03.260618 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 951/1582] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:02 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:39:03.265037 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-15e0267c-0e4c-49b2-9f04-a66f551aff8f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:03.265662 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-15e0267c-0e4c-49b2-9f04-a66f551aff8f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:03.272410 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-15e0267c-0e4c-49b2-9f04-a66f551aff8f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:03.272857 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-15e0267c-0e4c-49b2-9f04-a66f551aff8f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:03.273655 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-15e0267c-0e4c-49b2-9f04-a66f551aff8f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:03.274090 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-15e0267c-0e4c-49b2-9f04-a66f551aff8f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:03.336890 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-15e0267c-0e4c-49b2-9f04-a66f551aff8f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:03.344830 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-15e0267c-0e4c-49b2-9f04-a66f551aff8f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.083274 Jul 20 19:39:03.345389 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 952/1583] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:03 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:39:04.276669 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-9ced074d-92f8-4071-9935-dda7b3635138 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:04.277357 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-9ced074d-92f8-4071-9935-dda7b3635138 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:04.283353 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9ced074d-92f8-4071-9935-dda7b3635138 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:04.283795 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9ced074d-92f8-4071-9935-dda7b3635138 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:04.284541 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9ced074d-92f8-4071-9935-dda7b3635138 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:04.285023 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9ced074d-92f8-4071-9935-dda7b3635138 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:04.417357 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-9ced074d-92f8-4071-9935-dda7b3635138 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:04.424885 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-9ced074d-92f8-4071-9935-dda7b3635138 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.152080 Jul 20 19:39:04.425446 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 953/1584] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:04 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:39:04.430500 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-75d6d23a-58ea-4d69-8e4e-241c0d12bf17 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:04.431101 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-75d6d23a-58ea-4d69-8e4e-241c0d12bf17 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:04.436649 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-75d6d23a-58ea-4d69-8e4e-241c0d12bf17 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:04.437098 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-75d6d23a-58ea-4d69-8e4e-241c0d12bf17 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:04.437969 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-75d6d23a-58ea-4d69-8e4e-241c0d12bf17 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:04.438407 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-75d6d23a-58ea-4d69-8e4e-241c0d12bf17 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:04.503339 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-75d6d23a-58ea-4d69-8e4e-241c0d12bf17 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:04.511744 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-75d6d23a-58ea-4d69-8e4e-241c0d12bf17 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.084753 Jul 20 19:39:04.512303 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 954/1585] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:04 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:39:05.443244 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a6975ca9-a4f8-4204-b5c0-e0874f293a9c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:05.443909 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a6975ca9-a4f8-4204-b5c0-e0874f293a9c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:05.450401 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a6975ca9-a4f8-4204-b5c0-e0874f293a9c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:05.450848 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a6975ca9-a4f8-4204-b5c0-e0874f293a9c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:05.451601 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a6975ca9-a4f8-4204-b5c0-e0874f293a9c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:05.452032 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a6975ca9-a4f8-4204-b5c0-e0874f293a9c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:05.583589 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a6975ca9-a4f8-4204-b5c0-e0874f293a9c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:05.591042 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a6975ca9-a4f8-4204-b5c0-e0874f293a9c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.152198 Jul 20 19:39:05.591609 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 955/1586] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:05 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:39:05.596204 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-291bffd4-2ace-47b4-a5c5-185c7eec2d8c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:05.596809 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-291bffd4-2ace-47b4-a5c5-185c7eec2d8c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:05.602463 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-291bffd4-2ace-47b4-a5c5-185c7eec2d8c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:05.602913 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-291bffd4-2ace-47b4-a5c5-185c7eec2d8c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:05.603672 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-291bffd4-2ace-47b4-a5c5-185c7eec2d8c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:05.604108 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-291bffd4-2ace-47b4-a5c5-185c7eec2d8c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:05.664392 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-291bffd4-2ace-47b4-a5c5-185c7eec2d8c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:05.671856 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-291bffd4-2ace-47b4-a5c5-185c7eec2d8c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.079305 Jul 20 19:39:05.672420 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 956/1587] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:05 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:39:06.608201 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a74af0d9-4a32-40ea-a38a-78310cbff38f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:06.608831 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a74af0d9-4a32-40ea-a38a-78310cbff38f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:06.615417 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a74af0d9-4a32-40ea-a38a-78310cbff38f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:06.615865 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a74af0d9-4a32-40ea-a38a-78310cbff38f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:06.616629 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a74af0d9-4a32-40ea-a38a-78310cbff38f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:06.617061 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a74af0d9-4a32-40ea-a38a-78310cbff38f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:06.749968 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a74af0d9-4a32-40ea-a38a-78310cbff38f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:06.757370 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a74af0d9-4a32-40ea-a38a-78310cbff38f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.153085 Jul 20 19:39:06.757973 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 957/1588] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:06 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:39:06.762336 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-50cf8776-18a7-423f-aea2-52b3727cfee7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:06.762937 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-50cf8776-18a7-423f-aea2-52b3727cfee7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:06.768544 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-50cf8776-18a7-423f-aea2-52b3727cfee7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:06.768994 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-50cf8776-18a7-423f-aea2-52b3727cfee7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:06.770306 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-50cf8776-18a7-423f-aea2-52b3727cfee7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:06.770740 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-50cf8776-18a7-423f-aea2-52b3727cfee7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:06.832864 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-50cf8776-18a7-423f-aea2-52b3727cfee7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:06.840693 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-50cf8776-18a7-423f-aea2-52b3727cfee7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.081690 Jul 20 19:39:06.841282 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 958/1589] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:06 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:39:07.313833 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-5389420a-01d0-49c6-b6aa-8225ed904fee tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:07.314332 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-5389420a-01d0-49c6-b6aa-8225ed904fee tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:07.321132 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5389420a-01d0-49c6-b6aa-8225ed904fee tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:07.321609 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5389420a-01d0-49c6-b6aa-8225ed904fee tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:07.322383 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5389420a-01d0-49c6-b6aa-8225ed904fee tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:07.322811 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5389420a-01d0-49c6-b6aa-8225ed904fee tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:07.347036 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-5389420a-01d0-49c6-b6aa-8225ed904fee tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Going to try to terminate instance {{(pid=117761) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 19:39:07.393894 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.compute.api [None req-5389420a-01d0-49c6-b6aa-8225ed904fee tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Instance is already in deleting state, ignoring this request Jul 20 19:39:07.394765 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-5389420a-01d0-49c6-b6aa-8225ed904fee tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "DELETE /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 204 len: 0 microversion: 2.1 time: 0.085412 Jul 20 19:39:07.395560 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 959/1590] 10.222.0.69 () {58 vars in 1238 bytes} [Wed Jul 20 19:39:07 2022] DELETE /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 19:39:07.403087 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-81f90bf1-55d4-4e20-8852-88db4351e801 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:07.403706 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-81f90bf1-55d4-4e20-8852-88db4351e801 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:07.409714 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-81f90bf1-55d4-4e20-8852-88db4351e801 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:07.410216 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-81f90bf1-55d4-4e20-8852-88db4351e801 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:07.410969 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-81f90bf1-55d4-4e20-8852-88db4351e801 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:07.411398 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-81f90bf1-55d4-4e20-8852-88db4351e801 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:07.473773 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-81f90bf1-55d4-4e20-8852-88db4351e801 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:07.481244 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-81f90bf1-55d4-4e20-8852-88db4351e801 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.081672 Jul 20 19:39:07.481796 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 960/1591] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:07 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:39:07.774552 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-5f4706b0-28d3-42fb-901f-fac72338f43f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:07.775199 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-5f4706b0-28d3-42fb-901f-fac72338f43f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:07.781486 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5f4706b0-28d3-42fb-901f-fac72338f43f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:07.781962 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5f4706b0-28d3-42fb-901f-fac72338f43f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:07.782723 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5f4706b0-28d3-42fb-901f-fac72338f43f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:07.783155 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5f4706b0-28d3-42fb-901f-fac72338f43f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:07.798912 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:39:07.917758 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-5f4706b0-28d3-42fb-901f-fac72338f43f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:07.925225 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-5f4706b0-28d3-42fb-901f-fac72338f43f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.154725 Jul 20 19:39:07.926364 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 961/1592] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:07 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:39:08.499191 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d2c1cf83-77e8-4227-866d-becd1db813fd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:08.499823 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d2c1cf83-77e8-4227-866d-becd1db813fd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:08.505857 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d2c1cf83-77e8-4227-866d-becd1db813fd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:08.506300 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d2c1cf83-77e8-4227-866d-becd1db813fd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:08.507050 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d2c1cf83-77e8-4227-866d-becd1db813fd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:08.507478 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d2c1cf83-77e8-4227-866d-becd1db813fd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:08.567743 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d2c1cf83-77e8-4227-866d-becd1db813fd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:08.575257 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d2c1cf83-77e8-4227-866d-becd1db813fd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080085 Jul 20 19:39:08.575757 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 962/1593] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:08 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:39:08.943066 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d5e95f33-b231-4304-9b6a-324f1d989a32 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:08.943749 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d5e95f33-b231-4304-9b6a-324f1d989a32 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:08.950232 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d5e95f33-b231-4304-9b6a-324f1d989a32 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:08.950680 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d5e95f33-b231-4304-9b6a-324f1d989a32 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:08.951444 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d5e95f33-b231-4304-9b6a-324f1d989a32 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:08.951877 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d5e95f33-b231-4304-9b6a-324f1d989a32 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:09.083453 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d5e95f33-b231-4304-9b6a-324f1d989a32 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:09.090993 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d5e95f33-b231-4304-9b6a-324f1d989a32 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.151929 Jul 20 19:39:09.091555 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 963/1594] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:08 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:39:09.592382 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-137e1631-d161-4e22-9051-bab6c54dd8fd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:09.592901 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-137e1631-d161-4e22-9051-bab6c54dd8fd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:09.599760 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-137e1631-d161-4e22-9051-bab6c54dd8fd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:09.600242 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-137e1631-d161-4e22-9051-bab6c54dd8fd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:09.601008 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-137e1631-d161-4e22-9051-bab6c54dd8fd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:09.601436 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-137e1631-d161-4e22-9051-bab6c54dd8fd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:09.664345 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-137e1631-d161-4e22-9051-bab6c54dd8fd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:09.671999 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-137e1631-d161-4e22-9051-bab6c54dd8fd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.083551 Jul 20 19:39:09.672556 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 964/1595] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:09 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:39:10.108290 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-2c7412eb-b184-4647-b2e2-b5e6e0c1f85a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:10.108942 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-2c7412eb-b184-4647-b2e2-b5e6e0c1f85a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:10.116623 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2c7412eb-b184-4647-b2e2-b5e6e0c1f85a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:10.117101 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2c7412eb-b184-4647-b2e2-b5e6e0c1f85a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:10.117885 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2c7412eb-b184-4647-b2e2-b5e6e0c1f85a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:10.118313 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2c7412eb-b184-4647-b2e2-b5e6e0c1f85a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:10.252478 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-2c7412eb-b184-4647-b2e2-b5e6e0c1f85a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:10.260241 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-2c7412eb-b184-4647-b2e2-b5e6e0c1f85a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.155900 Jul 20 19:39:10.260810 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 965/1596] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:10 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:39:10.688905 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-6faa7b1e-0525-49c4-8f50-e7158b34102c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:10.689554 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-6faa7b1e-0525-49c4-8f50-e7158b34102c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:10.696188 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6faa7b1e-0525-49c4-8f50-e7158b34102c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:10.696637 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6faa7b1e-0525-49c4-8f50-e7158b34102c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:10.697396 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6faa7b1e-0525-49c4-8f50-e7158b34102c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:10.697855 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6faa7b1e-0525-49c4-8f50-e7158b34102c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:10.759269 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6faa7b1e-0525-49c4-8f50-e7158b34102c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:10.766668 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-6faa7b1e-0525-49c4-8f50-e7158b34102c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.081667 Jul 20 19:39:10.767225 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 966/1597] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:10 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:39:11.277969 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-154f71b6-757a-49ad-bf3e-0fcfd1c924b6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:11.278659 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-154f71b6-757a-49ad-bf3e-0fcfd1c924b6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:11.285620 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-154f71b6-757a-49ad-bf3e-0fcfd1c924b6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:11.285992 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-154f71b6-757a-49ad-bf3e-0fcfd1c924b6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:11.286755 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-154f71b6-757a-49ad-bf3e-0fcfd1c924b6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:11.287190 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-154f71b6-757a-49ad-bf3e-0fcfd1c924b6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:11.419241 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-154f71b6-757a-49ad-bf3e-0fcfd1c924b6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:11.426843 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-154f71b6-757a-49ad-bf3e-0fcfd1c924b6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.152744 Jul 20 19:39:11.427399 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 967/1598] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:11 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:39:11.784271 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-6d0e4c50-03be-4c6c-b944-26bceeedb81b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:11.784962 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-6d0e4c50-03be-4c6c-b944-26bceeedb81b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:11.791471 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6d0e4c50-03be-4c6c-b944-26bceeedb81b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:11.791920 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6d0e4c50-03be-4c6c-b944-26bceeedb81b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:11.793428 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6d0e4c50-03be-4c6c-b944-26bceeedb81b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:11.794343 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6d0e4c50-03be-4c6c-b944-26bceeedb81b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:11.859502 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6d0e4c50-03be-4c6c-b944-26bceeedb81b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:11.867565 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-6d0e4c50-03be-4c6c-b944-26bceeedb81b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.087485 Jul 20 19:39:11.868122 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 968/1599] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:11 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:39:12.443984 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c37aac94-738e-4c9b-ba2b-bac35c143a24 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:12.444618 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c37aac94-738e-4c9b-ba2b-bac35c143a24 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:12.446939 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_api:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:39:12.452456 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c37aac94-738e-4c9b-ba2b-bac35c143a24 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:12.452905 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c37aac94-738e-4c9b-ba2b-bac35c143a24 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:12.453701 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c37aac94-738e-4c9b-ba2b-bac35c143a24 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:12.454142 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c37aac94-738e-4c9b-ba2b-bac35c143a24 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:12.584038 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c37aac94-738e-4c9b-ba2b-bac35c143a24 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:12.591541 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c37aac94-738e-4c9b-ba2b-bac35c143a24 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.151480 Jul 20 19:39:12.592138 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 969/1600] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:12 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:39:12.885318 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-2926f836-7b88-4e5e-a617-b2146f2cca8b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:12.885881 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-2926f836-7b88-4e5e-a617-b2146f2cca8b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:12.891826 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2926f836-7b88-4e5e-a617-b2146f2cca8b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:12.892262 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2926f836-7b88-4e5e-a617-b2146f2cca8b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:12.893016 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2926f836-7b88-4e5e-a617-b2146f2cca8b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:12.893437 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2926f836-7b88-4e5e-a617-b2146f2cca8b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:12.955850 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-2926f836-7b88-4e5e-a617-b2146f2cca8b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:12.963933 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-2926f836-7b88-4e5e-a617-b2146f2cca8b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.082887 Jul 20 19:39:12.964493 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 970/1601] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:12 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:39:13.609271 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-92915bbd-f70a-486f-a001-159a5d707600 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:13.609950 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-92915bbd-f70a-486f-a001-159a5d707600 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:13.617045 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-92915bbd-f70a-486f-a001-159a5d707600 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:13.617488 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-92915bbd-f70a-486f-a001-159a5d707600 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:13.618275 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-92915bbd-f70a-486f-a001-159a5d707600 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:13.618707 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-92915bbd-f70a-486f-a001-159a5d707600 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:13.752708 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-92915bbd-f70a-486f-a001-159a5d707600 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:13.760834 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-92915bbd-f70a-486f-a001-159a5d707600 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.155108 Jul 20 19:39:13.761483 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 971/1602] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:13 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:39:13.981801 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-5cbd3c72-334b-4b24-8013-88503d85c25a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:13.982407 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-5cbd3c72-334b-4b24-8013-88503d85c25a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:13.988436 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5cbd3c72-334b-4b24-8013-88503d85c25a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:13.988882 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5cbd3c72-334b-4b24-8013-88503d85c25a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:13.989676 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5cbd3c72-334b-4b24-8013-88503d85c25a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:13.990106 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5cbd3c72-334b-4b24-8013-88503d85c25a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:14.049939 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-5cbd3c72-334b-4b24-8013-88503d85c25a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:14.057701 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-5cbd3c72-334b-4b24-8013-88503d85c25a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.079738 Jul 20 19:39:14.058259 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 972/1603] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:13 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:39:14.778430 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-757c536f-8dc0-49c7-89fa-192b380d334e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:14.779155 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-757c536f-8dc0-49c7-89fa-192b380d334e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:14.785888 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-757c536f-8dc0-49c7-89fa-192b380d334e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:14.786329 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-757c536f-8dc0-49c7-89fa-192b380d334e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:14.787081 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-757c536f-8dc0-49c7-89fa-192b380d334e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:14.787516 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-757c536f-8dc0-49c7-89fa-192b380d334e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:14.919409 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-757c536f-8dc0-49c7-89fa-192b380d334e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:14.927742 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-757c536f-8dc0-49c7-89fa-192b380d334e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.153104 Jul 20 19:39:14.928326 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 973/1604] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:14 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:39:15.074653 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-1c81e685-b7b1-406c-9dc7-b78bb665ab77 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:15.075174 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-1c81e685-b7b1-406c-9dc7-b78bb665ab77 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:15.081233 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1c81e685-b7b1-406c-9dc7-b78bb665ab77 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:15.081790 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1c81e685-b7b1-406c-9dc7-b78bb665ab77 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:15.082649 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1c81e685-b7b1-406c-9dc7-b78bb665ab77 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:15.083079 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1c81e685-b7b1-406c-9dc7-b78bb665ab77 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:15.143761 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1c81e685-b7b1-406c-9dc7-b78bb665ab77 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:15.151400 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-1c81e685-b7b1-406c-9dc7-b78bb665ab77 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080614 Jul 20 19:39:15.151963 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 974/1605] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:15 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:39:15.945033 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-6dc5d7da-8a7b-4254-b99b-1e343fe1732e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:15.945746 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-6dc5d7da-8a7b-4254-b99b-1e343fe1732e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:15.952194 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6dc5d7da-8a7b-4254-b99b-1e343fe1732e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:15.952638 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6dc5d7da-8a7b-4254-b99b-1e343fe1732e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:15.953396 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6dc5d7da-8a7b-4254-b99b-1e343fe1732e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:15.953850 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6dc5d7da-8a7b-4254-b99b-1e343fe1732e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:16.083742 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6dc5d7da-8a7b-4254-b99b-1e343fe1732e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:16.091174 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-6dc5d7da-8a7b-4254-b99b-1e343fe1732e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.150723 Jul 20 19:39:16.091743 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 975/1606] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:15 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:39:16.167946 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-de7c7f7a-2c19-4b9e-a9de-ae41d6647c04 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:16.168573 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-de7c7f7a-2c19-4b9e-a9de-ae41d6647c04 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:16.174502 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-de7c7f7a-2c19-4b9e-a9de-ae41d6647c04 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:16.174949 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-de7c7f7a-2c19-4b9e-a9de-ae41d6647c04 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:16.176236 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-de7c7f7a-2c19-4b9e-a9de-ae41d6647c04 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:16.176750 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-de7c7f7a-2c19-4b9e-a9de-ae41d6647c04 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:16.238335 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-de7c7f7a-2c19-4b9e-a9de-ae41d6647c04 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:16.246171 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-de7c7f7a-2c19-4b9e-a9de-ae41d6647c04 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.081985 Jul 20 19:39:16.246732 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 976/1607] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:16 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:39:17.108149 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-56d88c8b-f0d8-4fb1-94d2-78f5adc0c155 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:17.108836 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-56d88c8b-f0d8-4fb1-94d2-78f5adc0c155 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:17.115553 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-56d88c8b-f0d8-4fb1-94d2-78f5adc0c155 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:17.116008 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-56d88c8b-f0d8-4fb1-94d2-78f5adc0c155 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:17.116775 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-56d88c8b-f0d8-4fb1-94d2-78f5adc0c155 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:17.117213 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-56d88c8b-f0d8-4fb1-94d2-78f5adc0c155 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:17.254029 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-56d88c8b-f0d8-4fb1-94d2-78f5adc0c155 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:17.261523 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-56d88c8b-f0d8-4fb1-94d2-78f5adc0c155 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.157244 Jul 20 19:39:17.262100 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 977/1608] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:17 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:39:17.266570 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d35e6553-d12d-4e7b-aafe-f70affb6fdc8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:17.267162 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d35e6553-d12d-4e7b-aafe-f70affb6fdc8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:17.273417 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d35e6553-d12d-4e7b-aafe-f70affb6fdc8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:17.273889 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d35e6553-d12d-4e7b-aafe-f70affb6fdc8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:17.274641 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d35e6553-d12d-4e7b-aafe-f70affb6fdc8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:17.275066 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d35e6553-d12d-4e7b-aafe-f70affb6fdc8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:17.278918 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:39:17.339580 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d35e6553-d12d-4e7b-aafe-f70affb6fdc8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:17.347370 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d35e6553-d12d-4e7b-aafe-f70affb6fdc8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.084264 Jul 20 19:39:17.348008 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 978/1609] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:17 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:39:18.278880 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e5ca85f8-75f5-4b0b-b26e-24553c234e08 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:18.279591 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e5ca85f8-75f5-4b0b-b26e-24553c234e08 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:18.286592 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e5ca85f8-75f5-4b0b-b26e-24553c234e08 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:18.287036 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e5ca85f8-75f5-4b0b-b26e-24553c234e08 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:18.287797 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e5ca85f8-75f5-4b0b-b26e-24553c234e08 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:18.288226 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e5ca85f8-75f5-4b0b-b26e-24553c234e08 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:18.419878 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e5ca85f8-75f5-4b0b-b26e-24553c234e08 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:18.428193 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e5ca85f8-75f5-4b0b-b26e-24553c234e08 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.153128 Jul 20 19:39:18.428981 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 979/1610] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:18 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:39:18.433181 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a97d7684-785c-4648-ad1a-7a65ae34c2ce tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:18.433836 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a97d7684-785c-4648-ad1a-7a65ae34c2ce tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:18.439483 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a97d7684-785c-4648-ad1a-7a65ae34c2ce tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:18.439931 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a97d7684-785c-4648-ad1a-7a65ae34c2ce tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:18.440691 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a97d7684-785c-4648-ad1a-7a65ae34c2ce tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:18.441370 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a97d7684-785c-4648-ad1a-7a65ae34c2ce tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:18.502481 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a97d7684-785c-4648-ad1a-7a65ae34c2ce tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:18.510852 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a97d7684-785c-4648-ad1a-7a65ae34c2ce tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.081138 Jul 20 19:39:18.511421 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 980/1611] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:18 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:39:19.444636 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-210cfa69-c788-4dc3-85e1-b23478326eff tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:19.445349 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-210cfa69-c788-4dc3-85e1-b23478326eff tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:19.451672 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-210cfa69-c788-4dc3-85e1-b23478326eff tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:19.452120 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-210cfa69-c788-4dc3-85e1-b23478326eff tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:19.452877 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-210cfa69-c788-4dc3-85e1-b23478326eff tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:19.453304 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-210cfa69-c788-4dc3-85e1-b23478326eff tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:19.583835 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-210cfa69-c788-4dc3-85e1-b23478326eff tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:19.591295 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-210cfa69-c788-4dc3-85e1-b23478326eff tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.150733 Jul 20 19:39:19.591859 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 981/1612] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:19 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:39:19.596426 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-fcca5944-ae97-4c9c-9d57-b0cdfa6313cd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:19.597020 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-fcca5944-ae97-4c9c-9d57-b0cdfa6313cd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:19.603443 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fcca5944-ae97-4c9c-9d57-b0cdfa6313cd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:19.603896 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fcca5944-ae97-4c9c-9d57-b0cdfa6313cd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:19.604657 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fcca5944-ae97-4c9c-9d57-b0cdfa6313cd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:19.605197 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fcca5944-ae97-4c9c-9d57-b0cdfa6313cd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:19.665534 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-fcca5944-ae97-4c9c-9d57-b0cdfa6313cd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:19.672811 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-fcca5944-ae97-4c9c-9d57-b0cdfa6313cd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080025 Jul 20 19:39:19.673369 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 982/1613] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:19 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:39:20.609061 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-03d57253-2444-437b-a93a-2f9b4847fa02 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:20.609815 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-03d57253-2444-437b-a93a-2f9b4847fa02 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:20.616847 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-03d57253-2444-437b-a93a-2f9b4847fa02 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:20.617294 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-03d57253-2444-437b-a93a-2f9b4847fa02 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:20.618084 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-03d57253-2444-437b-a93a-2f9b4847fa02 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:20.618519 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-03d57253-2444-437b-a93a-2f9b4847fa02 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:20.752937 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-03d57253-2444-437b-a93a-2f9b4847fa02 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:20.760996 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-03d57253-2444-437b-a93a-2f9b4847fa02 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.155896 Jul 20 19:39:20.761584 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 983/1614] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:20 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:39:20.765929 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-440d948b-47bf-498b-ab55-462aed57332b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:20.766520 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-440d948b-47bf-498b-ab55-462aed57332b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:20.772400 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-440d948b-47bf-498b-ab55-462aed57332b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:20.772843 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-440d948b-47bf-498b-ab55-462aed57332b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:20.773776 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-440d948b-47bf-498b-ab55-462aed57332b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:20.774208 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-440d948b-47bf-498b-ab55-462aed57332b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:20.837294 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-440d948b-47bf-498b-ab55-462aed57332b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:20.845028 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-440d948b-47bf-498b-ab55-462aed57332b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.082509 Jul 20 19:39:20.845601 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 984/1615] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:20 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:39:21.781685 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-0b10a22f-238a-4186-963e-b18ed03a8b33 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:21.782328 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-0b10a22f-238a-4186-963e-b18ed03a8b33 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:21.789539 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0b10a22f-238a-4186-963e-b18ed03a8b33 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:21.789995 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0b10a22f-238a-4186-963e-b18ed03a8b33 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:21.790745 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0b10a22f-238a-4186-963e-b18ed03a8b33 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:21.791172 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0b10a22f-238a-4186-963e-b18ed03a8b33 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:21.925305 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0b10a22f-238a-4186-963e-b18ed03a8b33 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:21.932931 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-0b10a22f-238a-4186-963e-b18ed03a8b33 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.155159 Jul 20 19:39:21.933504 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 985/1616] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:21 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:39:21.937861 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-5502d24b-81a3-43b8-94ff-31a5c07e41e3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:21.938465 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-5502d24b-81a3-43b8-94ff-31a5c07e41e3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:21.944766 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5502d24b-81a3-43b8-94ff-31a5c07e41e3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:21.945238 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5502d24b-81a3-43b8-94ff-31a5c07e41e3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:21.946021 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5502d24b-81a3-43b8-94ff-31a5c07e41e3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:21.946448 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5502d24b-81a3-43b8-94ff-31a5c07e41e3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:22.007930 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-5502d24b-81a3-43b8-94ff-31a5c07e41e3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:22.015283 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-5502d24b-81a3-43b8-94ff-31a5c07e41e3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080834 Jul 20 19:39:22.015836 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 986/1617] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:21 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:39:22.950302 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-14a82f04-5247-4944-a2b9-ed24e0877ed0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:22.950996 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-14a82f04-5247-4944-a2b9-ed24e0877ed0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:22.958334 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-14a82f04-5247-4944-a2b9-ed24e0877ed0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:22.958789 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-14a82f04-5247-4944-a2b9-ed24e0877ed0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:22.959915 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-14a82f04-5247-4944-a2b9-ed24e0877ed0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:22.960041 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-14a82f04-5247-4944-a2b9-ed24e0877ed0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:23.098996 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-14a82f04-5247-4944-a2b9-ed24e0877ed0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:23.106673 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-14a82f04-5247-4944-a2b9-ed24e0877ed0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.160313 Jul 20 19:39:23.107249 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 987/1618] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:22 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:39:23.114325 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-79928cd1-7645-4c0c-8a61-7b9340611b1a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:23.114964 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-79928cd1-7645-4c0c-8a61-7b9340611b1a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:23.124737 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-79928cd1-7645-4c0c-8a61-7b9340611b1a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:23.125587 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-79928cd1-7645-4c0c-8a61-7b9340611b1a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:23.126369 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-79928cd1-7645-4c0c-8a61-7b9340611b1a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:23.126803 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-79928cd1-7645-4c0c-8a61-7b9340611b1a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:23.190940 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-79928cd1-7645-4c0c-8a61-7b9340611b1a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:23.198684 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-79928cd1-7645-4c0c-8a61-7b9340611b1a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.090514 Jul 20 19:39:23.199242 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 988/1619] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:23 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:39:24.123876 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-1a1b1382-663f-4305-9bf5-0a2fc3df69d9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:24.124603 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-1a1b1382-663f-4305-9bf5-0a2fc3df69d9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:24.130920 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1a1b1382-663f-4305-9bf5-0a2fc3df69d9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:24.131368 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1a1b1382-663f-4305-9bf5-0a2fc3df69d9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:24.132128 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1a1b1382-663f-4305-9bf5-0a2fc3df69d9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:24.132557 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1a1b1382-663f-4305-9bf5-0a2fc3df69d9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:24.264522 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1a1b1382-663f-4305-9bf5-0a2fc3df69d9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:24.272011 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-1a1b1382-663f-4305-9bf5-0a2fc3df69d9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.152038 Jul 20 19:39:24.272568 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 989/1620] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:24 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:39:24.276986 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e13c5cc2-8935-4078-94c8-9afa04a09810 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:24.277607 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e13c5cc2-8935-4078-94c8-9afa04a09810 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:24.284026 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e13c5cc2-8935-4078-94c8-9afa04a09810 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:24.284995 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e13c5cc2-8935-4078-94c8-9afa04a09810 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:24.285864 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e13c5cc2-8935-4078-94c8-9afa04a09810 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:24.286289 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e13c5cc2-8935-4078-94c8-9afa04a09810 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:24.348925 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e13c5cc2-8935-4078-94c8-9afa04a09810 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:24.356482 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e13c5cc2-8935-4078-94c8-9afa04a09810 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.082885 Jul 20 19:39:24.357046 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 990/1621] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:24 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:39:25.289283 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-2b0e8884-513b-4f83-981d-13b0310f5a68 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:25.290013 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-2b0e8884-513b-4f83-981d-13b0310f5a68 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:25.296622 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2b0e8884-513b-4f83-981d-13b0310f5a68 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:25.297070 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2b0e8884-513b-4f83-981d-13b0310f5a68 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:25.297897 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2b0e8884-513b-4f83-981d-13b0310f5a68 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:25.298328 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2b0e8884-513b-4f83-981d-13b0310f5a68 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:25.432302 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-2b0e8884-513b-4f83-981d-13b0310f5a68 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:25.439768 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-2b0e8884-513b-4f83-981d-13b0310f5a68 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.154352 Jul 20 19:39:25.440326 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 991/1622] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:25 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:39:25.445780 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d1cf80e8-40b6-40b9-9b18-fad44f7ddeff tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:25.446377 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d1cf80e8-40b6-40b9-9b18-fad44f7ddeff tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:25.451900 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d1cf80e8-40b6-40b9-9b18-fad44f7ddeff tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:25.452359 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d1cf80e8-40b6-40b9-9b18-fad44f7ddeff tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:25.453090 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d1cf80e8-40b6-40b9-9b18-fad44f7ddeff tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:25.453536 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d1cf80e8-40b6-40b9-9b18-fad44f7ddeff tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:25.514353 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d1cf80e8-40b6-40b9-9b18-fad44f7ddeff tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:25.522206 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d1cf80e8-40b6-40b9-9b18-fad44f7ddeff tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080021 Jul 20 19:39:25.522727 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 992/1623] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:25 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:39:26.458171 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-031deda6-d2c8-420d-9a4f-95279ec9e1f9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:26.458839 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-031deda6-d2c8-420d-9a4f-95279ec9e1f9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:26.465394 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-031deda6-d2c8-420d-9a4f-95279ec9e1f9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:26.465873 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-031deda6-d2c8-420d-9a4f-95279ec9e1f9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:26.466622 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-031deda6-d2c8-420d-9a4f-95279ec9e1f9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:26.467045 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-031deda6-d2c8-420d-9a4f-95279ec9e1f9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:26.596324 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-031deda6-d2c8-420d-9a4f-95279ec9e1f9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:26.603867 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-031deda6-d2c8-420d-9a4f-95279ec9e1f9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.150248 Jul 20 19:39:26.604437 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 993/1624] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:26 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:39:26.608770 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e62f0d04-9f71-496b-a81a-1565af4fac98 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:26.609371 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e62f0d04-9f71-496b-a81a-1565af4fac98 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:26.615537 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e62f0d04-9f71-496b-a81a-1565af4fac98 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:26.615989 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e62f0d04-9f71-496b-a81a-1565af4fac98 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:26.616764 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e62f0d04-9f71-496b-a81a-1565af4fac98 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:26.617231 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e62f0d04-9f71-496b-a81a-1565af4fac98 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:26.680265 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e62f0d04-9f71-496b-a81a-1565af4fac98 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:26.682499 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:39:26.688821 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e62f0d04-9f71-496b-a81a-1565af4fac98 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.083443 Jul 20 19:39:26.689389 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 994/1625] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:26 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:39:27.621222 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-6d40ac22-32cc-4cf4-a5ab-b01300ea3ccc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:27.621896 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-6d40ac22-32cc-4cf4-a5ab-b01300ea3ccc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:27.628251 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6d40ac22-32cc-4cf4-a5ab-b01300ea3ccc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:27.628701 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6d40ac22-32cc-4cf4-a5ab-b01300ea3ccc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:27.629469 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6d40ac22-32cc-4cf4-a5ab-b01300ea3ccc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:27.629926 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6d40ac22-32cc-4cf4-a5ab-b01300ea3ccc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:27.764445 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6d40ac22-32cc-4cf4-a5ab-b01300ea3ccc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:27.772772 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-6d40ac22-32cc-4cf4-a5ab-b01300ea3ccc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.155473 Jul 20 19:39:27.773261 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 995/1626] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:27 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:39:27.777891 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-0ebb048e-6c6d-477c-92bb-4df42a7e8965 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:27.778531 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-0ebb048e-6c6d-477c-92bb-4df42a7e8965 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:27.786388 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0ebb048e-6c6d-477c-92bb-4df42a7e8965 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:27.787345 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0ebb048e-6c6d-477c-92bb-4df42a7e8965 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:27.788125 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0ebb048e-6c6d-477c-92bb-4df42a7e8965 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:27.788565 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0ebb048e-6c6d-477c-92bb-4df42a7e8965 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:27.850664 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0ebb048e-6c6d-477c-92bb-4df42a7e8965 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:27.858183 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-0ebb048e-6c6d-477c-92bb-4df42a7e8965 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.083940 Jul 20 19:39:27.858749 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 996/1627] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:27 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:39:28.790300 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-3c446e45-e31e-4b40-bb99-3bcfd7bb68a0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:28.790970 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-3c446e45-e31e-4b40-bb99-3bcfd7bb68a0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:28.797535 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3c446e45-e31e-4b40-bb99-3bcfd7bb68a0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:28.797992 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3c446e45-e31e-4b40-bb99-3bcfd7bb68a0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:28.798751 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3c446e45-e31e-4b40-bb99-3bcfd7bb68a0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:28.799301 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3c446e45-e31e-4b40-bb99-3bcfd7bb68a0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:28.936533 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3c446e45-e31e-4b40-bb99-3bcfd7bb68a0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:28.944441 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-3c446e45-e31e-4b40-bb99-3bcfd7bb68a0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.157944 Jul 20 19:39:28.945005 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 997/1628] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:28 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:39:28.949531 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-1986eb12-eeac-4fac-b6cd-2cdc9c43f991 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:28.950164 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-1986eb12-eeac-4fac-b6cd-2cdc9c43f991 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:28.955847 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1986eb12-eeac-4fac-b6cd-2cdc9c43f991 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:28.956927 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1986eb12-eeac-4fac-b6cd-2cdc9c43f991 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:28.957768 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1986eb12-eeac-4fac-b6cd-2cdc9c43f991 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:28.958180 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1986eb12-eeac-4fac-b6cd-2cdc9c43f991 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:29.018675 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1986eb12-eeac-4fac-b6cd-2cdc9c43f991 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:29.026960 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-1986eb12-eeac-4fac-b6cd-2cdc9c43f991 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080989 Jul 20 19:39:29.027558 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 998/1629] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:28 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:39:29.961383 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-68bc5013-1f7e-474d-9334-625895b8c259 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:29.962125 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-68bc5013-1f7e-474d-9334-625895b8c259 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:29.968665 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-68bc5013-1f7e-474d-9334-625895b8c259 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:29.969114 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-68bc5013-1f7e-474d-9334-625895b8c259 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:29.970183 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-68bc5013-1f7e-474d-9334-625895b8c259 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:29.970616 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-68bc5013-1f7e-474d-9334-625895b8c259 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:30.116214 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-68bc5013-1f7e-474d-9334-625895b8c259 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:30.123936 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-68bc5013-1f7e-474d-9334-625895b8c259 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.166440 Jul 20 19:39:30.124496 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 999/1630] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:29 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:39:30.128834 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-fda331bf-3ed7-47cc-936c-2327800f08ad tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:30.129426 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-fda331bf-3ed7-47cc-936c-2327800f08ad tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:30.135252 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fda331bf-3ed7-47cc-936c-2327800f08ad tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:30.135688 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fda331bf-3ed7-47cc-936c-2327800f08ad tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:30.136452 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fda331bf-3ed7-47cc-936c-2327800f08ad tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:30.136875 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fda331bf-3ed7-47cc-936c-2327800f08ad tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:30.200134 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-fda331bf-3ed7-47cc-936c-2327800f08ad tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:30.208203 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-fda331bf-3ed7-47cc-936c-2327800f08ad tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.082447 Jul 20 19:39:30.208802 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1000/1631] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:30 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:39:31.141699 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-46fdfa1a-75a8-4603-8d87-a140eae042a6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:31.142380 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-46fdfa1a-75a8-4603-8d87-a140eae042a6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:31.149327 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-46fdfa1a-75a8-4603-8d87-a140eae042a6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:31.149806 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-46fdfa1a-75a8-4603-8d87-a140eae042a6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:31.150573 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-46fdfa1a-75a8-4603-8d87-a140eae042a6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:31.151007 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-46fdfa1a-75a8-4603-8d87-a140eae042a6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:31.284538 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-46fdfa1a-75a8-4603-8d87-a140eae042a6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:31.292221 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-46fdfa1a-75a8-4603-8d87-a140eae042a6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.154396 Jul 20 19:39:31.292792 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1001/1632] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:31 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:39:31.297438 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-9c7e6d6b-b372-4c1c-b538-51001e31bbd1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:31.298089 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-9c7e6d6b-b372-4c1c-b538-51001e31bbd1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:31.304332 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9c7e6d6b-b372-4c1c-b538-51001e31bbd1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:31.304776 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9c7e6d6b-b372-4c1c-b538-51001e31bbd1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:31.305559 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9c7e6d6b-b372-4c1c-b538-51001e31bbd1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:31.305996 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9c7e6d6b-b372-4c1c-b538-51001e31bbd1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:31.367436 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-9c7e6d6b-b372-4c1c-b538-51001e31bbd1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:31.375052 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-9c7e6d6b-b372-4c1c-b538-51001e31bbd1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.081333 Jul 20 19:39:31.375613 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1002/1633] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:31 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:39:32.310204 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-734e1b89-3897-4875-b4d9-2faa45089dd8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:32.310901 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-734e1b89-3897-4875-b4d9-2faa45089dd8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:32.318045 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-734e1b89-3897-4875-b4d9-2faa45089dd8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:32.318483 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-734e1b89-3897-4875-b4d9-2faa45089dd8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:32.319248 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-734e1b89-3897-4875-b4d9-2faa45089dd8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:32.319675 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-734e1b89-3897-4875-b4d9-2faa45089dd8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:32.454458 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-734e1b89-3897-4875-b4d9-2faa45089dd8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:32.462560 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-734e1b89-3897-4875-b4d9-2faa45089dd8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.156202 Jul 20 19:39:32.463114 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1003/1634] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:32 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:39:32.467406 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-fa9db3fc-ab0e-464b-a3a8-351c447f3573 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:32.467997 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-fa9db3fc-ab0e-464b-a3a8-351c447f3573 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:32.473950 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fa9db3fc-ab0e-464b-a3a8-351c447f3573 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:32.474394 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fa9db3fc-ab0e-464b-a3a8-351c447f3573 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:32.475137 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fa9db3fc-ab0e-464b-a3a8-351c447f3573 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:32.475561 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fa9db3fc-ab0e-464b-a3a8-351c447f3573 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:32.536228 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-fa9db3fc-ab0e-464b-a3a8-351c447f3573 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:32.543586 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-fa9db3fc-ab0e-464b-a3a8-351c447f3573 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.079549 Jul 20 19:39:32.544268 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1004/1635] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:32 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:39:33.480371 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-7fdadf42-ff35-407e-8b9f-9a87120331d8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:33.481053 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-7fdadf42-ff35-407e-8b9f-9a87120331d8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:33.487572 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7fdadf42-ff35-407e-8b9f-9a87120331d8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:33.488016 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7fdadf42-ff35-407e-8b9f-9a87120331d8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:33.488783 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7fdadf42-ff35-407e-8b9f-9a87120331d8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:33.489215 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7fdadf42-ff35-407e-8b9f-9a87120331d8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:33.626763 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-7fdadf42-ff35-407e-8b9f-9a87120331d8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:33.634481 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-7fdadf42-ff35-407e-8b9f-9a87120331d8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.158059 Jul 20 19:39:33.635056 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1005/1636] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:33 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:39:33.639588 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-3d7a04a1-4b36-4a13-b391-4028a334900a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:33.640188 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-3d7a04a1-4b36-4a13-b391-4028a334900a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:33.646393 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3d7a04a1-4b36-4a13-b391-4028a334900a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:33.646840 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3d7a04a1-4b36-4a13-b391-4028a334900a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:33.647600 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3d7a04a1-4b36-4a13-b391-4028a334900a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:33.648036 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3d7a04a1-4b36-4a13-b391-4028a334900a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:33.709605 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3d7a04a1-4b36-4a13-b391-4028a334900a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:33.717054 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-3d7a04a1-4b36-4a13-b391-4028a334900a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.081047 Jul 20 19:39:33.717636 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1006/1637] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:33 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:39:34.650975 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-81d07be0-eb77-48ff-9d13-cedead65588a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:34.651625 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-81d07be0-eb77-48ff-9d13-cedead65588a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:34.658190 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-81d07be0-eb77-48ff-9d13-cedead65588a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:34.658637 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-81d07be0-eb77-48ff-9d13-cedead65588a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:34.660029 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-81d07be0-eb77-48ff-9d13-cedead65588a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:34.660466 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-81d07be0-eb77-48ff-9d13-cedead65588a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:34.793017 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-81d07be0-eb77-48ff-9d13-cedead65588a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:34.801466 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-81d07be0-eb77-48ff-9d13-cedead65588a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.154304 Jul 20 19:39:34.802053 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1007/1638] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:34 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:39:34.806407 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-6fb748a4-02e4-4d56-8b2f-377f3d488f48 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:34.807003 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-6fb748a4-02e4-4d56-8b2f-377f3d488f48 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:34.812728 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6fb748a4-02e4-4d56-8b2f-377f3d488f48 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:34.813172 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6fb748a4-02e4-4d56-8b2f-377f3d488f48 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:34.813986 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6fb748a4-02e4-4d56-8b2f-377f3d488f48 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:34.814425 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6fb748a4-02e4-4d56-8b2f-377f3d488f48 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:34.875890 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6fb748a4-02e4-4d56-8b2f-377f3d488f48 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:34.883614 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-6fb748a4-02e4-4d56-8b2f-377f3d488f48 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080624 Jul 20 19:39:34.884180 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1008/1639] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:34 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:39:35.819233 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-86a07dcb-a283-4006-accb-41e51aae07c0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:35.819945 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-86a07dcb-a283-4006-accb-41e51aae07c0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:35.826374 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-86a07dcb-a283-4006-accb-41e51aae07c0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:35.826821 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-86a07dcb-a283-4006-accb-41e51aae07c0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:35.827584 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-86a07dcb-a283-4006-accb-41e51aae07c0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:35.828011 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-86a07dcb-a283-4006-accb-41e51aae07c0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:35.961137 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-86a07dcb-a283-4006-accb-41e51aae07c0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:35.968742 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-86a07dcb-a283-4006-accb-41e51aae07c0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.154296 Jul 20 19:39:35.969311 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1009/1640] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:35 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:39:35.974030 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a46a8243-bc27-4069-b459-6bc3427721e9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:35.974629 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a46a8243-bc27-4069-b459-6bc3427721e9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:35.980320 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a46a8243-bc27-4069-b459-6bc3427721e9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:35.980768 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a46a8243-bc27-4069-b459-6bc3427721e9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:35.981556 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a46a8243-bc27-4069-b459-6bc3427721e9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:35.982001 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a46a8243-bc27-4069-b459-6bc3427721e9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:36.042864 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a46a8243-bc27-4069-b459-6bc3427721e9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:36.050922 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a46a8243-bc27-4069-b459-6bc3427721e9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.079875 Jul 20 19:39:36.051486 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1010/1641] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:35 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:39:36.986367 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-dba82e72-1a79-446a-b381-fb1c1cf6a952 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:36.987021 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-dba82e72-1a79-446a-b381-fb1c1cf6a952 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:36.994013 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-dba82e72-1a79-446a-b381-fb1c1cf6a952 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:36.994460 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-dba82e72-1a79-446a-b381-fb1c1cf6a952 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:36.995214 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-dba82e72-1a79-446a-b381-fb1c1cf6a952 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:36.995641 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-dba82e72-1a79-446a-b381-fb1c1cf6a952 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:37.011224 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:39:37.124457 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-dba82e72-1a79-446a-b381-fb1c1cf6a952 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:37.132823 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-dba82e72-1a79-446a-b381-fb1c1cf6a952 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.150472 Jul 20 19:39:37.133387 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1011/1642] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:36 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:39:37.137872 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-931e500f-c06b-4271-b1bf-8db4a28707e5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:37.138406 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-931e500f-c06b-4271-b1bf-8db4a28707e5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:37.144760 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-931e500f-c06b-4271-b1bf-8db4a28707e5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:37.145331 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-931e500f-c06b-4271-b1bf-8db4a28707e5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:37.146125 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-931e500f-c06b-4271-b1bf-8db4a28707e5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:37.146553 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-931e500f-c06b-4271-b1bf-8db4a28707e5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:37.210701 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-931e500f-c06b-4271-b1bf-8db4a28707e5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:37.218648 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-931e500f-c06b-4271-b1bf-8db4a28707e5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.084184 Jul 20 19:39:37.219272 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1012/1643] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:37 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:39:38.149566 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-b3ea5ec4-cb54-4bbc-9f2c-9583705f3188 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:38.150249 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-b3ea5ec4-cb54-4bbc-9f2c-9583705f3188 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:38.156658 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b3ea5ec4-cb54-4bbc-9f2c-9583705f3188 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:38.157102 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b3ea5ec4-cb54-4bbc-9f2c-9583705f3188 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:38.157885 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b3ea5ec4-cb54-4bbc-9f2c-9583705f3188 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:38.158316 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b3ea5ec4-cb54-4bbc-9f2c-9583705f3188 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:38.291221 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-b3ea5ec4-cb54-4bbc-9f2c-9583705f3188 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:38.298694 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-b3ea5ec4-cb54-4bbc-9f2c-9583705f3188 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.152960 Jul 20 19:39:38.299253 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1013/1644] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:38 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:39:38.303974 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-0d2908cc-42e8-4137-aad7-76b26ab92ea6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:38.304569 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-0d2908cc-42e8-4137-aad7-76b26ab92ea6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:38.310223 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0d2908cc-42e8-4137-aad7-76b26ab92ea6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:38.310678 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0d2908cc-42e8-4137-aad7-76b26ab92ea6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:38.311409 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0d2908cc-42e8-4137-aad7-76b26ab92ea6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:38.311836 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0d2908cc-42e8-4137-aad7-76b26ab92ea6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:38.374238 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0d2908cc-42e8-4137-aad7-76b26ab92ea6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:38.381898 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-0d2908cc-42e8-4137-aad7-76b26ab92ea6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.081361 Jul 20 19:39:38.382472 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1014/1645] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:38 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:39:39.316397 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-78a4271f-26c9-4874-af10-85e4d3af10ce tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:39.317078 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-78a4271f-26c9-4874-af10-85e4d3af10ce tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:39.324213 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-78a4271f-26c9-4874-af10-85e4d3af10ce tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:39.324213 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-78a4271f-26c9-4874-af10-85e4d3af10ce tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:39.324918 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-78a4271f-26c9-4874-af10-85e4d3af10ce tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:39.325348 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-78a4271f-26c9-4874-af10-85e4d3af10ce tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:39.458034 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-78a4271f-26c9-4874-af10-85e4d3af10ce tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:39.465600 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-78a4271f-26c9-4874-af10-85e4d3af10ce tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.153581 Jul 20 19:39:39.466164 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1015/1646] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:39 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:39:39.470717 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-18ef60f8-6960-4a64-ab88-e20d022b4f22 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:39.471310 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-18ef60f8-6960-4a64-ab88-e20d022b4f22 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:39.477159 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-18ef60f8-6960-4a64-ab88-e20d022b4f22 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:39.477637 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-18ef60f8-6960-4a64-ab88-e20d022b4f22 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:39.478390 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-18ef60f8-6960-4a64-ab88-e20d022b4f22 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:39.478815 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-18ef60f8-6960-4a64-ab88-e20d022b4f22 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:39.539314 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-18ef60f8-6960-4a64-ab88-e20d022b4f22 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:39.546650 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-18ef60f8-6960-4a64-ab88-e20d022b4f22 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.079554 Jul 20 19:39:39.547204 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1016/1647] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:39 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:39:40.483755 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-9e52f8c7-3d01-45e9-8161-5bccac9c2426 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:40.484389 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-9e52f8c7-3d01-45e9-8161-5bccac9c2426 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:40.491081 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9e52f8c7-3d01-45e9-8161-5bccac9c2426 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:40.491534 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9e52f8c7-3d01-45e9-8161-5bccac9c2426 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:40.492296 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9e52f8c7-3d01-45e9-8161-5bccac9c2426 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:40.492729 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9e52f8c7-3d01-45e9-8161-5bccac9c2426 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:40.624519 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-9e52f8c7-3d01-45e9-8161-5bccac9c2426 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:40.632455 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-9e52f8c7-3d01-45e9-8161-5bccac9c2426 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.153002 Jul 20 19:39:40.633019 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1017/1648] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:40 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:39:40.637488 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-1ef3fee3-b869-48e1-85fa-6af226166feb tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:40.638106 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-1ef3fee3-b869-48e1-85fa-6af226166feb tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:40.644532 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1ef3fee3-b869-48e1-85fa-6af226166feb tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:40.645105 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1ef3fee3-b869-48e1-85fa-6af226166feb tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:40.645902 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1ef3fee3-b869-48e1-85fa-6af226166feb tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:40.646339 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1ef3fee3-b869-48e1-85fa-6af226166feb tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:40.710510 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1ef3fee3-b869-48e1-85fa-6af226166feb tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:40.718797 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-1ef3fee3-b869-48e1-85fa-6af226166feb tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.084734 Jul 20 19:39:40.719380 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1018/1649] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:40 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:39:41.650188 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-9bd09ef2-a68a-4864-8481-0f315685c5f0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:41.650918 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-9bd09ef2-a68a-4864-8481-0f315685c5f0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:41.653113 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_api:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:39:41.659386 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9bd09ef2-a68a-4864-8481-0f315685c5f0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:41.660138 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9bd09ef2-a68a-4864-8481-0f315685c5f0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:41.661017 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9bd09ef2-a68a-4864-8481-0f315685c5f0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:41.661570 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9bd09ef2-a68a-4864-8481-0f315685c5f0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:41.802995 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-9bd09ef2-a68a-4864-8481-0f315685c5f0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:41.810497 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-9bd09ef2-a68a-4864-8481-0f315685c5f0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.164233 Jul 20 19:39:41.811051 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1019/1650] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:41 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:39:41.815594 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-5cd6339a-4cba-42dc-b5c8-df2780c63ddc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:41.816305 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-5cd6339a-4cba-42dc-b5c8-df2780c63ddc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:41.822437 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5cd6339a-4cba-42dc-b5c8-df2780c63ddc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:41.822885 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5cd6339a-4cba-42dc-b5c8-df2780c63ddc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:41.823635 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5cd6339a-4cba-42dc-b5c8-df2780c63ddc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:41.824066 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5cd6339a-4cba-42dc-b5c8-df2780c63ddc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:41.886134 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-5cd6339a-4cba-42dc-b5c8-df2780c63ddc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:41.893819 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-5cd6339a-4cba-42dc-b5c8-df2780c63ddc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.081777 Jul 20 19:39:41.894381 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1020/1651] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:41 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:39:42.828382 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-b6e41d40-ba42-4312-9c1b-9b1d77530b35 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:42.829466 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-b6e41d40-ba42-4312-9c1b-9b1d77530b35 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:42.836258 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b6e41d40-ba42-4312-9c1b-9b1d77530b35 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:42.836713 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b6e41d40-ba42-4312-9c1b-9b1d77530b35 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:42.837490 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b6e41d40-ba42-4312-9c1b-9b1d77530b35 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:42.837950 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b6e41d40-ba42-4312-9c1b-9b1d77530b35 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:42.994050 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-b6e41d40-ba42-4312-9c1b-9b1d77530b35 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:43.005925 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-b6e41d40-ba42-4312-9c1b-9b1d77530b35 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.181509 Jul 20 19:39:43.006511 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1021/1652] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:42 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:39:43.010937 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-6cc7ebbf-aad1-43eb-93f8-f0ab10a9fe01 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:43.011540 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-6cc7ebbf-aad1-43eb-93f8-f0ab10a9fe01 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:43.018115 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6cc7ebbf-aad1-43eb-93f8-f0ab10a9fe01 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:43.019173 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6cc7ebbf-aad1-43eb-93f8-f0ab10a9fe01 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:43.020024 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6cc7ebbf-aad1-43eb-93f8-f0ab10a9fe01 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:43.020480 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6cc7ebbf-aad1-43eb-93f8-f0ab10a9fe01 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:43.082304 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6cc7ebbf-aad1-43eb-93f8-f0ab10a9fe01 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:43.089847 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-6cc7ebbf-aad1-43eb-93f8-f0ab10a9fe01 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.082366 Jul 20 19:39:43.090407 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1022/1653] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:43 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:39:44.023538 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-f3660465-535b-415a-8bb1-b08a5a340d1e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:44.024271 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-f3660465-535b-415a-8bb1-b08a5a340d1e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:44.030796 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f3660465-535b-415a-8bb1-b08a5a340d1e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:44.031238 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f3660465-535b-415a-8bb1-b08a5a340d1e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:44.031991 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f3660465-535b-415a-8bb1-b08a5a340d1e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:44.032416 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f3660465-535b-415a-8bb1-b08a5a340d1e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:44.165733 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-f3660465-535b-415a-8bb1-b08a5a340d1e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:44.173107 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-f3660465-535b-415a-8bb1-b08a5a340d1e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.153468 Jul 20 19:39:44.173702 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1023/1654] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:44 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:39:44.178907 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-5fc5e88e-83bb-4433-a61c-91bef84b8f87 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:44.179514 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-5fc5e88e-83bb-4433-a61c-91bef84b8f87 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:44.185112 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5fc5e88e-83bb-4433-a61c-91bef84b8f87 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:44.185590 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5fc5e88e-83bb-4433-a61c-91bef84b8f87 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:44.186351 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5fc5e88e-83bb-4433-a61c-91bef84b8f87 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:44.186783 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5fc5e88e-83bb-4433-a61c-91bef84b8f87 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:44.248188 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-5fc5e88e-83bb-4433-a61c-91bef84b8f87 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:44.257624 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-5fc5e88e-83bb-4433-a61c-91bef84b8f87 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.082685 Jul 20 19:39:44.258116 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1024/1655] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:44 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:39:45.191630 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d1992b6f-648a-4845-b85c-02274ec63cf7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:45.192310 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d1992b6f-648a-4845-b85c-02274ec63cf7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:45.198694 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d1992b6f-648a-4845-b85c-02274ec63cf7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:45.199145 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d1992b6f-648a-4845-b85c-02274ec63cf7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:45.199904 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d1992b6f-648a-4845-b85c-02274ec63cf7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:45.200334 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d1992b6f-648a-4845-b85c-02274ec63cf7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:45.337793 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d1992b6f-648a-4845-b85c-02274ec63cf7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:45.348877 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d1992b6f-648a-4845-b85c-02274ec63cf7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.161664 Jul 20 19:39:45.349447 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1025/1656] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:45 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:39:45.353828 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-cf4f556e-b90c-4147-89c3-8093d3ccc385 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:45.354412 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-cf4f556e-b90c-4147-89c3-8093d3ccc385 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:45.362833 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cf4f556e-b90c-4147-89c3-8093d3ccc385 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:45.363322 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cf4f556e-b90c-4147-89c3-8093d3ccc385 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:45.364128 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cf4f556e-b90c-4147-89c3-8093d3ccc385 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:45.364631 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cf4f556e-b90c-4147-89c3-8093d3ccc385 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:45.425727 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-cf4f556e-b90c-4147-89c3-8093d3ccc385 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:45.433158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-cf4f556e-b90c-4147-89c3-8093d3ccc385 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.082752 Jul 20 19:39:45.433833 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1026/1657] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:45 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:39:46.370286 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e8f94a3d-e6d8-4f02-8ca2-6a26d4394bcf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:46.370969 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e8f94a3d-e6d8-4f02-8ca2-6a26d4394bcf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:46.377698 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e8f94a3d-e6d8-4f02-8ca2-6a26d4394bcf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:46.378303 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e8f94a3d-e6d8-4f02-8ca2-6a26d4394bcf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:46.379043 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e8f94a3d-e6d8-4f02-8ca2-6a26d4394bcf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:46.379480 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e8f94a3d-e6d8-4f02-8ca2-6a26d4394bcf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:46.583462 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e8f94a3d-e6d8-4f02-8ca2-6a26d4394bcf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:46.591503 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e8f94a3d-e6d8-4f02-8ca2-6a26d4394bcf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.225137 Jul 20 19:39:46.592085 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1027/1658] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:46 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:39:46.597697 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-86d27904-b9c0-46e3-a3b5-2bb8486dc5bd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:46.598795 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-86d27904-b9c0-46e3-a3b5-2bb8486dc5bd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:46.604984 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-86d27904-b9c0-46e3-a3b5-2bb8486dc5bd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:46.605444 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-86d27904-b9c0-46e3-a3b5-2bb8486dc5bd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:46.606267 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-86d27904-b9c0-46e3-a3b5-2bb8486dc5bd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:46.606705 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-86d27904-b9c0-46e3-a3b5-2bb8486dc5bd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:46.610919 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:39:46.681684 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-86d27904-b9c0-46e3-a3b5-2bb8486dc5bd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:46.689594 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-86d27904-b9c0-46e3-a3b5-2bb8486dc5bd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.096490 Jul 20 19:39:46.690181 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1028/1659] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:46 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:39:47.609875 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-3f86f7c6-85fa-44f5-9bb8-644d351ffb59 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:47.610576 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-3f86f7c6-85fa-44f5-9bb8-644d351ffb59 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:47.617579 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3f86f7c6-85fa-44f5-9bb8-644d351ffb59 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:47.618043 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3f86f7c6-85fa-44f5-9bb8-644d351ffb59 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:47.618812 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3f86f7c6-85fa-44f5-9bb8-644d351ffb59 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:47.619253 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3f86f7c6-85fa-44f5-9bb8-644d351ffb59 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:47.757084 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3f86f7c6-85fa-44f5-9bb8-644d351ffb59 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:47.764662 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-3f86f7c6-85fa-44f5-9bb8-644d351ffb59 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.158911 Jul 20 19:39:47.765226 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1029/1660] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:47 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:39:47.770374 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-0df2f05a-7611-4c59-a66b-cdfae5d2e185 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:47.770973 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-0df2f05a-7611-4c59-a66b-cdfae5d2e185 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:47.776689 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0df2f05a-7611-4c59-a66b-cdfae5d2e185 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:47.777140 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0df2f05a-7611-4c59-a66b-cdfae5d2e185 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:47.777939 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0df2f05a-7611-4c59-a66b-cdfae5d2e185 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:47.778374 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0df2f05a-7611-4c59-a66b-cdfae5d2e185 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:47.840046 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0df2f05a-7611-4c59-a66b-cdfae5d2e185 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:47.848665 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-0df2f05a-7611-4c59-a66b-cdfae5d2e185 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.082434 Jul 20 19:39:47.849244 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1030/1661] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:47 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:39:48.782723 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-cb8722a2-6f23-42e5-8a99-9e1c96bd6c55 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:48.783421 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-cb8722a2-6f23-42e5-8a99-9e1c96bd6c55 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:48.790611 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cb8722a2-6f23-42e5-8a99-9e1c96bd6c55 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:48.791066 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cb8722a2-6f23-42e5-8a99-9e1c96bd6c55 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:48.791833 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cb8722a2-6f23-42e5-8a99-9e1c96bd6c55 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:48.792273 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cb8722a2-6f23-42e5-8a99-9e1c96bd6c55 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:48.926796 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-cb8722a2-6f23-42e5-8a99-9e1c96bd6c55 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:48.934708 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-cb8722a2-6f23-42e5-8a99-9e1c96bd6c55 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.155809 Jul 20 19:39:48.935279 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1031/1662] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:48 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:39:48.939767 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ac8a7191-15e9-4b33-a13a-579293013bbe tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:48.940407 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ac8a7191-15e9-4b33-a13a-579293013bbe tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:48.948426 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ac8a7191-15e9-4b33-a13a-579293013bbe tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:48.948805 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ac8a7191-15e9-4b33-a13a-579293013bbe tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:48.949663 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ac8a7191-15e9-4b33-a13a-579293013bbe tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:48.950102 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ac8a7191-15e9-4b33-a13a-579293013bbe tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:49.012444 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ac8a7191-15e9-4b33-a13a-579293013bbe tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:49.020435 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ac8a7191-15e9-4b33-a13a-579293013bbe tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.084165 Jul 20 19:39:49.021002 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1032/1663] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:48 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:39:49.954008 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d1957a54-4d69-4fea-a819-3b2887ce203e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:49.954668 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d1957a54-4d69-4fea-a819-3b2887ce203e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:49.961386 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d1957a54-4d69-4fea-a819-3b2887ce203e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:49.961858 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d1957a54-4d69-4fea-a819-3b2887ce203e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:49.962619 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d1957a54-4d69-4fea-a819-3b2887ce203e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:49.963045 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d1957a54-4d69-4fea-a819-3b2887ce203e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:50.097072 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d1957a54-4d69-4fea-a819-3b2887ce203e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:50.104815 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d1957a54-4d69-4fea-a819-3b2887ce203e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.155869 Jul 20 19:39:50.105374 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1033/1664] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:49 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:39:50.109899 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-f3355ed3-20cc-45ee-8276-8d51e7b10823 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:50.110497 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-f3355ed3-20cc-45ee-8276-8d51e7b10823 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:50.116696 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f3355ed3-20cc-45ee-8276-8d51e7b10823 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:50.117141 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f3355ed3-20cc-45ee-8276-8d51e7b10823 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:50.117933 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f3355ed3-20cc-45ee-8276-8d51e7b10823 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:50.118580 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f3355ed3-20cc-45ee-8276-8d51e7b10823 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:50.182538 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-f3355ed3-20cc-45ee-8276-8d51e7b10823 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:50.191077 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-f3355ed3-20cc-45ee-8276-8d51e7b10823 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.084084 Jul 20 19:39:50.191752 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1034/1665] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:50 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:39:51.122045 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ae146cba-60b3-4f17-a358-fdbe559def22 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:51.122764 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ae146cba-60b3-4f17-a358-fdbe559def22 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:51.130352 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ae146cba-60b3-4f17-a358-fdbe559def22 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:51.130851 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ae146cba-60b3-4f17-a358-fdbe559def22 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:51.131706 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ae146cba-60b3-4f17-a358-fdbe559def22 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:51.132182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ae146cba-60b3-4f17-a358-fdbe559def22 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:51.283296 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ae146cba-60b3-4f17-a358-fdbe559def22 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:51.292125 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ae146cba-60b3-4f17-a358-fdbe559def22 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.174173 Jul 20 19:39:51.292715 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1035/1666] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:51 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:39:51.297581 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-7f7c9dcb-1e12-44c3-b9b8-7cff25333ec1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:51.298196 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-7f7c9dcb-1e12-44c3-b9b8-7cff25333ec1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:51.304904 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7f7c9dcb-1e12-44c3-b9b8-7cff25333ec1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:51.305356 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7f7c9dcb-1e12-44c3-b9b8-7cff25333ec1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:51.306166 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7f7c9dcb-1e12-44c3-b9b8-7cff25333ec1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:51.306610 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7f7c9dcb-1e12-44c3-b9b8-7cff25333ec1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:51.375641 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-7f7c9dcb-1e12-44c3-b9b8-7cff25333ec1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:51.383946 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-7f7c9dcb-1e12-44c3-b9b8-7cff25333ec1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.090052 Jul 20 19:39:51.384533 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1036/1667] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:51 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:39:52.308784 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ec68c878-edc1-4f52-8b38-6fb3bacdd5e4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:52.309478 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ec68c878-edc1-4f52-8b38-6fb3bacdd5e4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:52.317333 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ec68c878-edc1-4f52-8b38-6fb3bacdd5e4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:52.321651 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ec68c878-edc1-4f52-8b38-6fb3bacdd5e4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:52.321651 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ec68c878-edc1-4f52-8b38-6fb3bacdd5e4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:52.321651 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ec68c878-edc1-4f52-8b38-6fb3bacdd5e4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:52.458750 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ec68c878-edc1-4f52-8b38-6fb3bacdd5e4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:52.466470 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ec68c878-edc1-4f52-8b38-6fb3bacdd5e4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.161489 Jul 20 19:39:52.467045 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1037/1668] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:52 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:39:52.471742 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-40be777c-f733-4fe3-9c0e-e1a1f0cec04d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:52.472348 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-40be777c-f733-4fe3-9c0e-e1a1f0cec04d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:52.478227 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-40be777c-f733-4fe3-9c0e-e1a1f0cec04d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:52.478676 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-40be777c-f733-4fe3-9c0e-e1a1f0cec04d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:52.479449 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-40be777c-f733-4fe3-9c0e-e1a1f0cec04d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:52.479882 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-40be777c-f733-4fe3-9c0e-e1a1f0cec04d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:52.543584 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-40be777c-f733-4fe3-9c0e-e1a1f0cec04d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:52.552318 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-40be777c-f733-4fe3-9c0e-e1a1f0cec04d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.083785 Jul 20 19:39:52.552956 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1038/1669] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:52 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:39:53.484196 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-21b52be7-f595-42b1-858c-90b74b8f02f7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:53.484839 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-21b52be7-f595-42b1-858c-90b74b8f02f7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:53.491626 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-21b52be7-f595-42b1-858c-90b74b8f02f7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:53.492073 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-21b52be7-f595-42b1-858c-90b74b8f02f7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:53.492995 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-21b52be7-f595-42b1-858c-90b74b8f02f7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:53.493466 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-21b52be7-f595-42b1-858c-90b74b8f02f7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:53.628964 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-21b52be7-f595-42b1-858c-90b74b8f02f7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:53.640091 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-21b52be7-f595-42b1-858c-90b74b8f02f7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.159815 Jul 20 19:39:53.640857 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1039/1670] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:53 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:39:53.647513 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-fb8b0cf1-91a7-4217-899e-123a681435ea tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:53.648518 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-fb8b0cf1-91a7-4217-899e-123a681435ea tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:53.656626 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fb8b0cf1-91a7-4217-899e-123a681435ea tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:53.657376 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fb8b0cf1-91a7-4217-899e-123a681435ea tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:53.658409 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fb8b0cf1-91a7-4217-899e-123a681435ea tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:53.659034 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fb8b0cf1-91a7-4217-899e-123a681435ea tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:53.740154 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-fb8b0cf1-91a7-4217-899e-123a681435ea tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:53.748000 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-fb8b0cf1-91a7-4217-899e-123a681435ea tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.106129 Jul 20 19:39:53.748566 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1040/1671] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:53 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:39:54.658014 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d2f0a4b9-3e44-498a-9242-1451fb245a8e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:54.658684 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d2f0a4b9-3e44-498a-9242-1451fb245a8e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:54.666111 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d2f0a4b9-3e44-498a-9242-1451fb245a8e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:54.666559 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d2f0a4b9-3e44-498a-9242-1451fb245a8e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:54.667312 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d2f0a4b9-3e44-498a-9242-1451fb245a8e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:54.667741 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d2f0a4b9-3e44-498a-9242-1451fb245a8e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:54.804408 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d2f0a4b9-3e44-498a-9242-1451fb245a8e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:54.812035 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d2f0a4b9-3e44-498a-9242-1451fb245a8e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.157843 Jul 20 19:39:54.812600 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1041/1672] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:54 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:39:54.817714 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-b24be21d-70ce-428c-930e-a2a5a8aff09d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:54.818365 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-b24be21d-70ce-428c-930e-a2a5a8aff09d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:54.824517 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b24be21d-70ce-428c-930e-a2a5a8aff09d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:54.824970 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b24be21d-70ce-428c-930e-a2a5a8aff09d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:54.825769 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b24be21d-70ce-428c-930e-a2a5a8aff09d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:54.826206 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b24be21d-70ce-428c-930e-a2a5a8aff09d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:54.889327 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-b24be21d-70ce-428c-930e-a2a5a8aff09d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:54.898511 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-b24be21d-70ce-428c-930e-a2a5a8aff09d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.084625 Jul 20 19:39:54.898777 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1042/1673] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:54 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:39:55.829750 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-809b883a-9124-4d24-b8e1-52742f123216 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:55.830446 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-809b883a-9124-4d24-b8e1-52742f123216 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:55.837058 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-809b883a-9124-4d24-b8e1-52742f123216 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:55.837499 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-809b883a-9124-4d24-b8e1-52742f123216 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:55.838283 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-809b883a-9124-4d24-b8e1-52742f123216 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:55.838712 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-809b883a-9124-4d24-b8e1-52742f123216 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:56.238394 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-809b883a-9124-4d24-b8e1-52742f123216 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:56.246059 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-809b883a-9124-4d24-b8e1-52742f123216 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.420136 Jul 20 19:39:56.246631 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1043/1674] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:55 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:39:56.251320 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-6e7359b2-d600-4152-93bf-10c793491593 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:56.251937 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-6e7359b2-d600-4152-93bf-10c793491593 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:56.258276 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6e7359b2-d600-4152-93bf-10c793491593 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:56.258720 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6e7359b2-d600-4152-93bf-10c793491593 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:56.259478 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6e7359b2-d600-4152-93bf-10c793491593 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:56.259903 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6e7359b2-d600-4152-93bf-10c793491593 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:56.325162 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6e7359b2-d600-4152-93bf-10c793491593 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:56.327516 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:39:56.335010 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-6e7359b2-d600-4152-93bf-10c793491593 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.087352 Jul 20 19:39:56.335609 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1044/1675] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:56 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:39:57.263655 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a9b93c76-3022-4719-a851-26919932cf76 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:57.264354 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a9b93c76-3022-4719-a851-26919932cf76 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:57.271392 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a9b93c76-3022-4719-a851-26919932cf76 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:57.271833 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a9b93c76-3022-4719-a851-26919932cf76 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:57.272712 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a9b93c76-3022-4719-a851-26919932cf76 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:57.273128 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a9b93c76-3022-4719-a851-26919932cf76 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:57.415701 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a9b93c76-3022-4719-a851-26919932cf76 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:57.423632 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a9b93c76-3022-4719-a851-26919932cf76 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.163784 Jul 20 19:39:57.424239 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1045/1676] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:57 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:39:57.429843 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ad34e672-1747-43a5-8cc9-2aef75e997be tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:57.430452 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ad34e672-1747-43a5-8cc9-2aef75e997be tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:57.437098 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ad34e672-1747-43a5-8cc9-2aef75e997be tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:57.437569 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ad34e672-1747-43a5-8cc9-2aef75e997be tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:57.438343 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ad34e672-1747-43a5-8cc9-2aef75e997be tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:57.438780 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ad34e672-1747-43a5-8cc9-2aef75e997be tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:57.505750 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ad34e672-1747-43a5-8cc9-2aef75e997be tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:57.514739 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ad34e672-1747-43a5-8cc9-2aef75e997be tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.088619 Jul 20 19:39:57.515434 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1046/1677] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:57 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:39:58.443002 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-115d31d9-6b61-481d-830b-48b92e4bb8bf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:58.443676 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-115d31d9-6b61-481d-830b-48b92e4bb8bf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:58.450212 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-115d31d9-6b61-481d-830b-48b92e4bb8bf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:58.450844 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-115d31d9-6b61-481d-830b-48b92e4bb8bf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:58.451433 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-115d31d9-6b61-481d-830b-48b92e4bb8bf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:58.451900 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-115d31d9-6b61-481d-830b-48b92e4bb8bf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:58.581267 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-115d31d9-6b61-481d-830b-48b92e4bb8bf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:58.588849 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-115d31d9-6b61-481d-830b-48b92e4bb8bf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.150468 Jul 20 19:39:58.589415 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1047/1678] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:58 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:39:58.593797 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ed32ce27-cabe-4299-87e8-c11f746f1466 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:58.594394 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ed32ce27-cabe-4299-87e8-c11f746f1466 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:58.600901 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ed32ce27-cabe-4299-87e8-c11f746f1466 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:58.601349 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ed32ce27-cabe-4299-87e8-c11f746f1466 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:58.602137 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ed32ce27-cabe-4299-87e8-c11f746f1466 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:58.602574 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ed32ce27-cabe-4299-87e8-c11f746f1466 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:58.662663 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ed32ce27-cabe-4299-87e8-c11f746f1466 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:58.670412 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ed32ce27-cabe-4299-87e8-c11f746f1466 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.079974 Jul 20 19:39:58.670997 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1048/1679] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:58 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:39:59.608793 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-74e67cd4-0eb2-4353-8ff5-2c6fc330a319 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:59.609416 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-74e67cd4-0eb2-4353-8ff5-2c6fc330a319 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:59.616262 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-74e67cd4-0eb2-4353-8ff5-2c6fc330a319 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:59.616702 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-74e67cd4-0eb2-4353-8ff5-2c6fc330a319 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:59.617456 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-74e67cd4-0eb2-4353-8ff5-2c6fc330a319 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:59.617906 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-74e67cd4-0eb2-4353-8ff5-2c6fc330a319 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:59.768211 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-74e67cd4-0eb2-4353-8ff5-2c6fc330a319 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:59.776175 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-74e67cd4-0eb2-4353-8ff5-2c6fc330a319 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.171317 Jul 20 19:39:59.776780 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1049/1680] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:59 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:39:59.781165 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4b88c96b-adda-4ff0-bbbc-005c5d39f99b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:59.781793 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-4b88c96b-adda-4ff0-bbbc-005c5d39f99b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:59.787949 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4b88c96b-adda-4ff0-bbbc-005c5d39f99b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:59.788389 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4b88c96b-adda-4ff0-bbbc-005c5d39f99b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:59.789153 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4b88c96b-adda-4ff0-bbbc-005c5d39f99b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:59.789618 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4b88c96b-adda-4ff0-bbbc-005c5d39f99b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:59.851871 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-4b88c96b-adda-4ff0-bbbc-005c5d39f99b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:59.859581 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-4b88c96b-adda-4ff0-bbbc-005c5d39f99b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.081754 Jul 20 19:39:59.860082 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1050/1681] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:59 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:00.793774 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e15e08fe-7004-4ba2-8694-05488ac816bb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:00.794463 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e15e08fe-7004-4ba2-8694-05488ac816bb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:00.801273 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e15e08fe-7004-4ba2-8694-05488ac816bb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:00.801755 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e15e08fe-7004-4ba2-8694-05488ac816bb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:00.802530 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e15e08fe-7004-4ba2-8694-05488ac816bb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:00.802965 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e15e08fe-7004-4ba2-8694-05488ac816bb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:00.935763 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e15e08fe-7004-4ba2-8694-05488ac816bb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:00.944123 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e15e08fe-7004-4ba2-8694-05488ac816bb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.154208 Jul 20 19:40:00.944683 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1051/1682] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:00 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:40:00.949028 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-db2f8739-ebbb-4ee6-8860-cefbe6262158 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:00.949660 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-db2f8739-ebbb-4ee6-8860-cefbe6262158 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:00.955477 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-db2f8739-ebbb-4ee6-8860-cefbe6262158 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:00.956717 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-db2f8739-ebbb-4ee6-8860-cefbe6262158 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:00.957501 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-db2f8739-ebbb-4ee6-8860-cefbe6262158 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:00.957953 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-db2f8739-ebbb-4ee6-8860-cefbe6262158 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:01.022562 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-db2f8739-ebbb-4ee6-8860-cefbe6262158 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:01.030140 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-db2f8739-ebbb-4ee6-8860-cefbe6262158 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.084500 Jul 20 19:40:01.030722 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1052/1683] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:00 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:01.962065 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-3efe7f3e-dca6-403d-85bc-36fbe7ca638d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:01.962744 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-3efe7f3e-dca6-403d-85bc-36fbe7ca638d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:01.969250 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3efe7f3e-dca6-403d-85bc-36fbe7ca638d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:01.969722 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3efe7f3e-dca6-403d-85bc-36fbe7ca638d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:01.970743 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3efe7f3e-dca6-403d-85bc-36fbe7ca638d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:01.971916 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3efe7f3e-dca6-403d-85bc-36fbe7ca638d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:02.105585 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3efe7f3e-dca6-403d-85bc-36fbe7ca638d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:02.112788 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-3efe7f3e-dca6-403d-85bc-36fbe7ca638d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.154488 Jul 20 19:40:02.113347 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1053/1684] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:01 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:40:02.117861 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-5e5b8e23-b62d-47df-b35c-03b1d280d3ec tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:02.118459 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-5e5b8e23-b62d-47df-b35c-03b1d280d3ec tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:02.125293 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5e5b8e23-b62d-47df-b35c-03b1d280d3ec tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:02.125820 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5e5b8e23-b62d-47df-b35c-03b1d280d3ec tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:02.128519 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5e5b8e23-b62d-47df-b35c-03b1d280d3ec tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:02.128519 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5e5b8e23-b62d-47df-b35c-03b1d280d3ec tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:02.189576 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-5e5b8e23-b62d-47df-b35c-03b1d280d3ec tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:02.197412 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-5e5b8e23-b62d-47df-b35c-03b1d280d3ec tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.083085 Jul 20 19:40:02.198084 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1054/1685] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:02 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:03.130781 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-72705bdd-9d82-40bb-b358-5284aa5c8acf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:03.132593 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-72705bdd-9d82-40bb-b358-5284aa5c8acf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:03.137967 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-72705bdd-9d82-40bb-b358-5284aa5c8acf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:03.138416 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-72705bdd-9d82-40bb-b358-5284aa5c8acf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:03.139177 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-72705bdd-9d82-40bb-b358-5284aa5c8acf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:03.139605 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-72705bdd-9d82-40bb-b358-5284aa5c8acf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:03.278314 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-72705bdd-9d82-40bb-b358-5284aa5c8acf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:03.285986 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-72705bdd-9d82-40bb-b358-5284aa5c8acf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.159691 Jul 20 19:40:03.286560 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1055/1686] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:03 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:40:03.290982 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-f24e6e9f-5bdf-4fee-b789-6328d33806b4 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:03.291585 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-f24e6e9f-5bdf-4fee-b789-6328d33806b4 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:03.297674 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f24e6e9f-5bdf-4fee-b789-6328d33806b4 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:03.298096 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f24e6e9f-5bdf-4fee-b789-6328d33806b4 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:03.298884 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f24e6e9f-5bdf-4fee-b789-6328d33806b4 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:03.299342 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f24e6e9f-5bdf-4fee-b789-6328d33806b4 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:03.362280 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-f24e6e9f-5bdf-4fee-b789-6328d33806b4 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:03.369932 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-f24e6e9f-5bdf-4fee-b789-6328d33806b4 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.082363 Jul 20 19:40:03.370510 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1056/1687] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:03 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:04.303978 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-1c05904c-9236-4f09-8f2a-e259baf8cc9e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:04.304779 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-1c05904c-9236-4f09-8f2a-e259baf8cc9e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:04.313015 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1c05904c-9236-4f09-8f2a-e259baf8cc9e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:04.313470 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1c05904c-9236-4f09-8f2a-e259baf8cc9e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:04.314273 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1c05904c-9236-4f09-8f2a-e259baf8cc9e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:04.314707 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1c05904c-9236-4f09-8f2a-e259baf8cc9e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:04.461284 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1c05904c-9236-4f09-8f2a-e259baf8cc9e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:04.469247 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-1c05904c-9236-4f09-8f2a-e259baf8cc9e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.169497 Jul 20 19:40:04.469857 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1057/1688] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:04 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:40:04.475530 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a6974f0c-2e82-49b1-834f-bbfd33704f05 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:04.476134 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a6974f0c-2e82-49b1-834f-bbfd33704f05 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:04.482408 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a6974f0c-2e82-49b1-834f-bbfd33704f05 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:04.482850 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a6974f0c-2e82-49b1-834f-bbfd33704f05 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:04.483612 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a6974f0c-2e82-49b1-834f-bbfd33704f05 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:04.484046 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a6974f0c-2e82-49b1-834f-bbfd33704f05 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:04.554577 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a6974f0c-2e82-49b1-834f-bbfd33704f05 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:04.562385 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a6974f0c-2e82-49b1-834f-bbfd33704f05 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.091251 Jul 20 19:40:04.562973 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1058/1689] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:04 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:05.489085 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-490b42cd-1b25-4153-85a9-2b3f3993031c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:05.489805 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-490b42cd-1b25-4153-85a9-2b3f3993031c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:05.496238 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-490b42cd-1b25-4153-85a9-2b3f3993031c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:05.496683 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-490b42cd-1b25-4153-85a9-2b3f3993031c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:05.497435 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-490b42cd-1b25-4153-85a9-2b3f3993031c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:05.497896 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-490b42cd-1b25-4153-85a9-2b3f3993031c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:05.626316 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-490b42cd-1b25-4153-85a9-2b3f3993031c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:05.634036 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-490b42cd-1b25-4153-85a9-2b3f3993031c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.149388 Jul 20 19:40:05.634608 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1059/1690] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:05 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:40:05.639008 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c5e0962c-8abf-4e0c-9ed7-d177ea48c8dc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:05.639608 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c5e0962c-8abf-4e0c-9ed7-d177ea48c8dc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:05.645270 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c5e0962c-8abf-4e0c-9ed7-d177ea48c8dc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:05.645906 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c5e0962c-8abf-4e0c-9ed7-d177ea48c8dc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:05.646543 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c5e0962c-8abf-4e0c-9ed7-d177ea48c8dc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:05.646973 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c5e0962c-8abf-4e0c-9ed7-d177ea48c8dc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:05.723116 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c5e0962c-8abf-4e0c-9ed7-d177ea48c8dc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:05.730575 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c5e0962c-8abf-4e0c-9ed7-d177ea48c8dc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.095000 Jul 20 19:40:05.731159 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1060/1691] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:05 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:06.556541 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-65904b46-add3-4b7d-92c3-27120b4564d4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:06.557160 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-65904b46-add3-4b7d-92c3-27120b4564d4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:06.563716 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-65904b46-add3-4b7d-92c3-27120b4564d4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:06.564242 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-65904b46-add3-4b7d-92c3-27120b4564d4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:06.565729 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-65904b46-add3-4b7d-92c3-27120b4564d4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:06.566369 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-65904b46-add3-4b7d-92c3-27120b4564d4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:06.582432 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:40:06.594488 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-65904b46-add3-4b7d-92c3-27120b4564d4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Going to try to terminate instance {{(pid=117761) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 19:40:06.675658 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-65904b46-add3-4b7d-92c3-27120b4564d4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "DELETE /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 204 len: 0 microversion: 2.1 time: 0.122904 Jul 20 19:40:06.676285 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1061/1692] 10.222.0.69 () {58 vars in 1238 bytes} [Wed Jul 20 19:40:06 2022] DELETE /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 19:40:06.811271 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [req-59faabb7-1f6b-4bc9-8593-72b59b55b182 req-bdf30849-f8b4-4a70-887a-dba0bc55885b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "239cb0b6-54d7-4cc2-945a-1f026a015992", "tag": "761fbace-90da-4e61-bc51-77b19745762a"}]} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:40:06.819789 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-59faabb7-1f6b-4bc9-8593-72b59b55b182 req-bdf30849-f8b4-4a70-887a-dba0bc55885b service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:06.820233 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-59faabb7-1f6b-4bc9-8593-72b59b55b182 req-bdf30849-f8b4-4a70-887a-dba0bc55885b service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:06.831363 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.compute.server_external_events [req-59faabb7-1f6b-4bc9-8593-72b59b55b182 req-bdf30849-f8b4-4a70-887a-dba0bc55885b service nova] Creating event network-changed:761fbace-90da-4e61-bc51-77b19745762a for instance 239cb0b6-54d7-4cc2-945a-1f026a015992 on hv-cinder-83538 Jul 20 19:40:06.836376 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [req-59faabb7-1f6b-4bc9-8593-72b59b55b182 req-bdf30849-f8b4-4a70-887a-dba0bc55885b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158456 Jul 20 19:40:06.837040 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1062/1693] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 19:40:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:40:06.844233 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-207918ac-5497-4c23-be39-4b95e8776ffe tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:06.845245 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-207918ac-5497-4c23-be39-4b95e8776ffe tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:06.852520 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-207918ac-5497-4c23-be39-4b95e8776ffe tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:06.852971 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-207918ac-5497-4c23-be39-4b95e8776ffe tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:06.854529 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-207918ac-5497-4c23-be39-4b95e8776ffe tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:06.855985 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-207918ac-5497-4c23-be39-4b95e8776ffe tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:07.070057 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-207918ac-5497-4c23-be39-4b95e8776ffe tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:07.083309 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-207918ac-5497-4c23-be39-4b95e8776ffe tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1567 microversion: 2.1 time: 0.243770 Jul 20 19:40:07.084085 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1063/1694] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:06 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1567 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:07.088985 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-1ffa609d-9b1b-4c5f-81aa-a96ea0a2e7d7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:07.089906 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-1ffa609d-9b1b-4c5f-81aa-a96ea0a2e7d7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:07.099222 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1ffa609d-9b1b-4c5f-81aa-a96ea0a2e7d7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:07.099682 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1ffa609d-9b1b-4c5f-81aa-a96ea0a2e7d7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:07.100761 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1ffa609d-9b1b-4c5f-81aa-a96ea0a2e7d7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:07.102215 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1ffa609d-9b1b-4c5f-81aa-a96ea0a2e7d7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:07.177099 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1ffa609d-9b1b-4c5f-81aa-a96ea0a2e7d7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:07.187860 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-1ffa609d-9b1b-4c5f-81aa-a96ea0a2e7d7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.102448 Jul 20 19:40:07.194991 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1064/1695] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:07 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:08.102184 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-5ed69259-c716-400b-ab41-3c290520c9b2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:08.102834 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-5ed69259-c716-400b-ab41-3c290520c9b2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:08.109331 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5ed69259-c716-400b-ab41-3c290520c9b2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:08.109813 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5ed69259-c716-400b-ab41-3c290520c9b2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:08.110574 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5ed69259-c716-400b-ab41-3c290520c9b2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:08.111012 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5ed69259-c716-400b-ab41-3c290520c9b2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:08.242931 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-5ed69259-c716-400b-ab41-3c290520c9b2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:08.250485 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-5ed69259-c716-400b-ab41-3c290520c9b2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.152159 Jul 20 19:40:08.251052 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1065/1696] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:08 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:40:08.255624 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-87f1c39d-0698-4df1-aba6-0d4ea16ac9ae tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:08.256307 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-87f1c39d-0698-4df1-aba6-0d4ea16ac9ae tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:08.258078 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:40:08.263162 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-87f1c39d-0698-4df1-aba6-0d4ea16ac9ae tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:08.263619 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-87f1c39d-0698-4df1-aba6-0d4ea16ac9ae tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:08.264382 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-87f1c39d-0698-4df1-aba6-0d4ea16ac9ae tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:08.264818 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-87f1c39d-0698-4df1-aba6-0d4ea16ac9ae tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:08.331793 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-87f1c39d-0698-4df1-aba6-0d4ea16ac9ae tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:08.339323 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-87f1c39d-0698-4df1-aba6-0d4ea16ac9ae tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.087332 Jul 20 19:40:08.339891 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1066/1697] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:08 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:09.267683 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a70a0ffe-8b7e-47d5-aa1e-2d574c5d47d9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:09.269221 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a70a0ffe-8b7e-47d5-aa1e-2d574c5d47d9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:09.275649 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a70a0ffe-8b7e-47d5-aa1e-2d574c5d47d9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:09.276095 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a70a0ffe-8b7e-47d5-aa1e-2d574c5d47d9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:09.276838 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a70a0ffe-8b7e-47d5-aa1e-2d574c5d47d9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:09.277266 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a70a0ffe-8b7e-47d5-aa1e-2d574c5d47d9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:09.408682 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a70a0ffe-8b7e-47d5-aa1e-2d574c5d47d9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:09.416194 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a70a0ffe-8b7e-47d5-aa1e-2d574c5d47d9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.152356 Jul 20 19:40:09.416762 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1067/1698] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:09 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:40:09.421187 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-5d6b21d9-e3c6-405d-b3d3-8180121f14ae tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:09.421812 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-5d6b21d9-e3c6-405d-b3d3-8180121f14ae tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:09.428021 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5d6b21d9-e3c6-405d-b3d3-8180121f14ae tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:09.428467 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5d6b21d9-e3c6-405d-b3d3-8180121f14ae tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:09.429221 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5d6b21d9-e3c6-405d-b3d3-8180121f14ae tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:09.429689 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5d6b21d9-e3c6-405d-b3d3-8180121f14ae tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:09.490463 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-5d6b21d9-e3c6-405d-b3d3-8180121f14ae tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:09.497861 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-5d6b21d9-e3c6-405d-b3d3-8180121f14ae tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080105 Jul 20 19:40:09.498421 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1068/1699] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:09 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:10.433727 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d897572d-132f-4b6e-9835-25e6376aa0db tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:10.434339 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d897572d-132f-4b6e-9835-25e6376aa0db tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:10.441646 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d897572d-132f-4b6e-9835-25e6376aa0db tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:10.442101 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d897572d-132f-4b6e-9835-25e6376aa0db tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:10.442871 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d897572d-132f-4b6e-9835-25e6376aa0db tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:10.443328 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d897572d-132f-4b6e-9835-25e6376aa0db tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:10.579145 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d897572d-132f-4b6e-9835-25e6376aa0db tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:10.586961 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d897572d-132f-4b6e-9835-25e6376aa0db tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.157115 Jul 20 19:40:10.587521 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1069/1700] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:10 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:40:10.591864 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-b36268c9-f79e-4cde-9971-bee1233956e8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:10.592437 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-b36268c9-f79e-4cde-9971-bee1233956e8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:10.599323 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b36268c9-f79e-4cde-9971-bee1233956e8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:10.599769 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b36268c9-f79e-4cde-9971-bee1233956e8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:10.600585 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b36268c9-f79e-4cde-9971-bee1233956e8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:10.601018 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b36268c9-f79e-4cde-9971-bee1233956e8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:10.661572 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-b36268c9-f79e-4cde-9971-bee1233956e8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:10.668945 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-b36268c9-f79e-4cde-9971-bee1233956e8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080499 Jul 20 19:40:10.669528 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1070/1701] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:10 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:11.604114 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a522a21f-9722-468a-9f6c-98bbd7fe5ddb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:11.604736 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a522a21f-9722-468a-9f6c-98bbd7fe5ddb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:11.611075 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a522a21f-9722-468a-9f6c-98bbd7fe5ddb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:11.611509 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a522a21f-9722-468a-9f6c-98bbd7fe5ddb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:11.612889 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a522a21f-9722-468a-9f6c-98bbd7fe5ddb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:11.613331 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a522a21f-9722-468a-9f6c-98bbd7fe5ddb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:11.743218 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a522a21f-9722-468a-9f6c-98bbd7fe5ddb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:11.750708 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a522a21f-9722-468a-9f6c-98bbd7fe5ddb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.150557 Jul 20 19:40:11.751304 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1071/1702] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:11 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:40:11.755877 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-58953e2a-af4d-4065-ab6b-b5be34fc60f9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:11.756463 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-58953e2a-af4d-4065-ab6b-b5be34fc60f9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:11.762436 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-58953e2a-af4d-4065-ab6b-b5be34fc60f9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:11.762890 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-58953e2a-af4d-4065-ab6b-b5be34fc60f9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:11.763642 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-58953e2a-af4d-4065-ab6b-b5be34fc60f9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:11.764075 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-58953e2a-af4d-4065-ab6b-b5be34fc60f9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:11.829764 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-58953e2a-af4d-4065-ab6b-b5be34fc60f9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:11.837911 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-58953e2a-af4d-4065-ab6b-b5be34fc60f9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.085638 Jul 20 19:40:11.838483 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1072/1703] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:11 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:12.767710 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e8ff7197-3ba9-4767-b620-993d8fd38f77 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:12.768385 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e8ff7197-3ba9-4767-b620-993d8fd38f77 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:12.774982 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e8ff7197-3ba9-4767-b620-993d8fd38f77 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:12.775420 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e8ff7197-3ba9-4767-b620-993d8fd38f77 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:12.776165 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e8ff7197-3ba9-4767-b620-993d8fd38f77 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:12.776590 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e8ff7197-3ba9-4767-b620-993d8fd38f77 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:12.904681 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e8ff7197-3ba9-4767-b620-993d8fd38f77 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:12.912805 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e8ff7197-3ba9-4767-b620-993d8fd38f77 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.148995 Jul 20 19:40:12.913374 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1073/1704] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:12 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:40:12.917743 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-882bed59-83ab-4baa-8a55-9e75ea723afe tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:12.918332 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-882bed59-83ab-4baa-8a55-9e75ea723afe tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:12.923908 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-882bed59-83ab-4baa-8a55-9e75ea723afe tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:12.924354 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-882bed59-83ab-4baa-8a55-9e75ea723afe tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:12.926043 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-882bed59-83ab-4baa-8a55-9e75ea723afe tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:12.926489 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-882bed59-83ab-4baa-8a55-9e75ea723afe tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:12.988356 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-882bed59-83ab-4baa-8a55-9e75ea723afe tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:12.995852 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-882bed59-83ab-4baa-8a55-9e75ea723afe tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.081521 Jul 20 19:40:12.996411 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1074/1705] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:12 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:13.929961 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-7f249d49-5d21-4bc8-bf18-32388978aec6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:13.930662 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-7f249d49-5d21-4bc8-bf18-32388978aec6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:13.937132 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7f249d49-5d21-4bc8-bf18-32388978aec6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:13.937614 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7f249d49-5d21-4bc8-bf18-32388978aec6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:13.938381 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7f249d49-5d21-4bc8-bf18-32388978aec6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:13.938814 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7f249d49-5d21-4bc8-bf18-32388978aec6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:14.071643 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-7f249d49-5d21-4bc8-bf18-32388978aec6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:14.079048 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-7f249d49-5d21-4bc8-bf18-32388978aec6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.152929 Jul 20 19:40:14.079619 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1075/1706] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:13 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:40:14.084523 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-14ea6a78-52f4-4973-80f6-32a8dbc9cc03 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:14.085124 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-14ea6a78-52f4-4973-80f6-32a8dbc9cc03 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:14.090757 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-14ea6a78-52f4-4973-80f6-32a8dbc9cc03 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:14.091212 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-14ea6a78-52f4-4973-80f6-32a8dbc9cc03 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:14.091970 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-14ea6a78-52f4-4973-80f6-32a8dbc9cc03 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:14.092408 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-14ea6a78-52f4-4973-80f6-32a8dbc9cc03 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:14.153904 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-14ea6a78-52f4-4973-80f6-32a8dbc9cc03 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:14.161847 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-14ea6a78-52f4-4973-80f6-32a8dbc9cc03 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.081243 Jul 20 19:40:14.162415 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1076/1707] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:14 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:15.097468 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a02ddf66-690b-45c9-be77-b97f59c4378d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:15.098175 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a02ddf66-690b-45c9-be77-b97f59c4378d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:15.104698 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a02ddf66-690b-45c9-be77-b97f59c4378d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:15.105147 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a02ddf66-690b-45c9-be77-b97f59c4378d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:15.105940 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a02ddf66-690b-45c9-be77-b97f59c4378d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:15.106371 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a02ddf66-690b-45c9-be77-b97f59c4378d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:15.108909 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:40:15.238735 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a02ddf66-690b-45c9-be77-b97f59c4378d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:15.246213 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a02ddf66-690b-45c9-be77-b97f59c4378d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.153663 Jul 20 19:40:15.246775 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1077/1708] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:15 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:40:15.251168 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-fcb87260-aadd-427a-9f2a-f8503b61956e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:15.251773 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-fcb87260-aadd-427a-9f2a-f8503b61956e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:15.258472 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fcb87260-aadd-427a-9f2a-f8503b61956e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:15.258919 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fcb87260-aadd-427a-9f2a-f8503b61956e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:15.259686 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fcb87260-aadd-427a-9f2a-f8503b61956e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:15.260123 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fcb87260-aadd-427a-9f2a-f8503b61956e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:15.324304 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-fcb87260-aadd-427a-9f2a-f8503b61956e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:15.332026 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-fcb87260-aadd-427a-9f2a-f8503b61956e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.084244 Jul 20 19:40:15.332619 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1078/1709] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:15 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:16.263420 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-33b67796-2a10-48fe-8050-8e0040cbd594 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:16.264118 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-33b67796-2a10-48fe-8050-8e0040cbd594 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:16.270749 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-33b67796-2a10-48fe-8050-8e0040cbd594 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:16.271198 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-33b67796-2a10-48fe-8050-8e0040cbd594 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:16.271961 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-33b67796-2a10-48fe-8050-8e0040cbd594 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:16.272397 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-33b67796-2a10-48fe-8050-8e0040cbd594 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:16.403200 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-33b67796-2a10-48fe-8050-8e0040cbd594 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:16.410859 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-33b67796-2a10-48fe-8050-8e0040cbd594 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.151305 Jul 20 19:40:16.411428 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1079/1710] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:16 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:40:16.415785 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-6e07c1ec-9869-48cd-b4d0-fe8dde336822 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:16.416391 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-6e07c1ec-9869-48cd-b4d0-fe8dde336822 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:16.422029 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6e07c1ec-9869-48cd-b4d0-fe8dde336822 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:16.422479 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6e07c1ec-9869-48cd-b4d0-fe8dde336822 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:16.423238 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6e07c1ec-9869-48cd-b4d0-fe8dde336822 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:16.423672 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6e07c1ec-9869-48cd-b4d0-fe8dde336822 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:16.486418 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6e07c1ec-9869-48cd-b4d0-fe8dde336822 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:16.494475 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-6e07c1ec-9869-48cd-b4d0-fe8dde336822 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.082114 Jul 20 19:40:16.495049 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1080/1711] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:16 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:17.428022 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-7c31aebb-b6df-4c24-ace5-35170e5e7137 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:17.428686 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-7c31aebb-b6df-4c24-ace5-35170e5e7137 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:17.435147 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7c31aebb-b6df-4c24-ace5-35170e5e7137 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:17.435594 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7c31aebb-b6df-4c24-ace5-35170e5e7137 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:17.436344 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7c31aebb-b6df-4c24-ace5-35170e5e7137 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:17.436772 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7c31aebb-b6df-4c24-ace5-35170e5e7137 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:17.570644 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-7c31aebb-b6df-4c24-ace5-35170e5e7137 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:17.578028 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-7c31aebb-b6df-4c24-ace5-35170e5e7137 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.154059 Jul 20 19:40:17.578563 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1081/1712] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:17 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:40:17.583435 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-3b70d855-c83e-4486-864f-b325be4541e2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:17.584028 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-3b70d855-c83e-4486-864f-b325be4541e2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:17.589880 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3b70d855-c83e-4486-864f-b325be4541e2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:17.590323 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3b70d855-c83e-4486-864f-b325be4541e2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:17.591105 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3b70d855-c83e-4486-864f-b325be4541e2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:17.591535 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3b70d855-c83e-4486-864f-b325be4541e2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:17.652313 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3b70d855-c83e-4486-864f-b325be4541e2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:17.660154 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-3b70d855-c83e-4486-864f-b325be4541e2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080616 Jul 20 19:40:17.660734 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1082/1713] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:17 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:18.596382 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-2b2dd19c-dfc1-43ea-9ca5-3e682b436027 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:18.597599 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-2b2dd19c-dfc1-43ea-9ca5-3e682b436027 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:18.604471 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2b2dd19c-dfc1-43ea-9ca5-3e682b436027 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:18.604909 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2b2dd19c-dfc1-43ea-9ca5-3e682b436027 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:18.605694 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2b2dd19c-dfc1-43ea-9ca5-3e682b436027 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:18.606123 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2b2dd19c-dfc1-43ea-9ca5-3e682b436027 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:18.737970 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-2b2dd19c-dfc1-43ea-9ca5-3e682b436027 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:18.745485 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-2b2dd19c-dfc1-43ea-9ca5-3e682b436027 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.153412 Jul 20 19:40:18.746067 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1083/1714] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:18 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:40:18.750412 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-db3fbb95-e644-41dd-b3bf-a0eb772a2cb5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:18.751009 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-db3fbb95-e644-41dd-b3bf-a0eb772a2cb5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:18.757792 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-db3fbb95-e644-41dd-b3bf-a0eb772a2cb5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:18.758317 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-db3fbb95-e644-41dd-b3bf-a0eb772a2cb5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:18.759457 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-db3fbb95-e644-41dd-b3bf-a0eb772a2cb5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:18.759892 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-db3fbb95-e644-41dd-b3bf-a0eb772a2cb5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:18.824069 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-db3fbb95-e644-41dd-b3bf-a0eb772a2cb5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:18.831542 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-db3fbb95-e644-41dd-b3bf-a0eb772a2cb5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.084485 Jul 20 19:40:18.832589 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1084/1715] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:18 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:19.763236 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-54da3616-94f4-4414-bf36-2cde21d8a89c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:19.763920 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-54da3616-94f4-4414-bf36-2cde21d8a89c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:19.771225 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-54da3616-94f4-4414-bf36-2cde21d8a89c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:19.771675 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-54da3616-94f4-4414-bf36-2cde21d8a89c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:19.772426 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-54da3616-94f4-4414-bf36-2cde21d8a89c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:19.772856 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-54da3616-94f4-4414-bf36-2cde21d8a89c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:19.903685 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-54da3616-94f4-4414-bf36-2cde21d8a89c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:19.911529 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-54da3616-94f4-4414-bf36-2cde21d8a89c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.152182 Jul 20 19:40:19.912362 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1085/1716] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:19 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:40:19.916792 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ecc48fb6-954f-456f-8b76-78c68b69d798 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:19.917392 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ecc48fb6-954f-456f-8b76-78c68b69d798 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:19.923403 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ecc48fb6-954f-456f-8b76-78c68b69d798 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:19.923848 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ecc48fb6-954f-456f-8b76-78c68b69d798 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:19.925120 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ecc48fb6-954f-456f-8b76-78c68b69d798 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:19.925574 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ecc48fb6-954f-456f-8b76-78c68b69d798 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:19.988046 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ecc48fb6-954f-456f-8b76-78c68b69d798 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:19.996356 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ecc48fb6-954f-456f-8b76-78c68b69d798 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.083048 Jul 20 19:40:19.996928 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1086/1717] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:19 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:20.929684 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-1ba6f7bb-0087-41ec-8450-b388d77a9dac tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:20.930523 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-1ba6f7bb-0087-41ec-8450-b388d77a9dac tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:20.936718 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1ba6f7bb-0087-41ec-8450-b388d77a9dac tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:20.937164 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1ba6f7bb-0087-41ec-8450-b388d77a9dac tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:20.937954 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1ba6f7bb-0087-41ec-8450-b388d77a9dac tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:20.938388 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1ba6f7bb-0087-41ec-8450-b388d77a9dac tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:21.073667 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1ba6f7bb-0087-41ec-8450-b388d77a9dac tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:21.081364 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-1ba6f7bb-0087-41ec-8450-b388d77a9dac tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.156437 Jul 20 19:40:21.081960 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1087/1718] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:20 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:40:21.086413 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-f1d8456c-a0c2-4265-b5e2-af0a0d024793 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:21.087025 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-f1d8456c-a0c2-4265-b5e2-af0a0d024793 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:21.093038 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f1d8456c-a0c2-4265-b5e2-af0a0d024793 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:21.093483 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f1d8456c-a0c2-4265-b5e2-af0a0d024793 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:21.094263 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f1d8456c-a0c2-4265-b5e2-af0a0d024793 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:21.094691 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f1d8456c-a0c2-4265-b5e2-af0a0d024793 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:21.160579 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-f1d8456c-a0c2-4265-b5e2-af0a0d024793 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:21.171548 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-f1d8456c-a0c2-4265-b5e2-af0a0d024793 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.088562 Jul 20 19:40:21.172118 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1088/1719] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:21 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:22.099220 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-51cb219c-2e4e-4e23-a8b4-13e513599548 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:22.099917 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-51cb219c-2e4e-4e23-a8b4-13e513599548 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:22.106412 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-51cb219c-2e4e-4e23-a8b4-13e513599548 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:22.106904 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-51cb219c-2e4e-4e23-a8b4-13e513599548 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:22.107635 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-51cb219c-2e4e-4e23-a8b4-13e513599548 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:22.108063 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-51cb219c-2e4e-4e23-a8b4-13e513599548 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:22.244287 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-51cb219c-2e4e-4e23-a8b4-13e513599548 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:22.251806 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-51cb219c-2e4e-4e23-a8b4-13e513599548 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.156690 Jul 20 19:40:22.252367 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1089/1720] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:22 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:40:22.257369 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-268dd144-a83e-446b-8641-f3dda2e005c6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:22.258002 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-268dd144-a83e-446b-8641-f3dda2e005c6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:22.264095 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-268dd144-a83e-446b-8641-f3dda2e005c6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:22.264548 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-268dd144-a83e-446b-8641-f3dda2e005c6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:22.265294 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-268dd144-a83e-446b-8641-f3dda2e005c6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:22.265757 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-268dd144-a83e-446b-8641-f3dda2e005c6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:22.337215 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-268dd144-a83e-446b-8641-f3dda2e005c6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:22.344984 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-268dd144-a83e-446b-8641-f3dda2e005c6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.091013 Jul 20 19:40:22.345838 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1090/1721] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:22 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:23.269919 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-3e3af2d3-b8cf-441f-af5a-19e875d4f345 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:23.270600 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-3e3af2d3-b8cf-441f-af5a-19e875d4f345 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:23.277426 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3e3af2d3-b8cf-441f-af5a-19e875d4f345 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:23.277902 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3e3af2d3-b8cf-441f-af5a-19e875d4f345 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:23.278684 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3e3af2d3-b8cf-441f-af5a-19e875d4f345 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:23.279112 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3e3af2d3-b8cf-441f-af5a-19e875d4f345 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:23.413318 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3e3af2d3-b8cf-441f-af5a-19e875d4f345 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:23.420904 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-3e3af2d3-b8cf-441f-af5a-19e875d4f345 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.155337 Jul 20 19:40:23.421475 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1091/1722] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:23 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:40:23.425879 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-442fc70b-cfb6-4983-b6f9-dd5ca15a9eb1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:23.426485 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-442fc70b-cfb6-4983-b6f9-dd5ca15a9eb1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:23.432259 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-442fc70b-cfb6-4983-b6f9-dd5ca15a9eb1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:23.432709 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-442fc70b-cfb6-4983-b6f9-dd5ca15a9eb1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:23.433635 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-442fc70b-cfb6-4983-b6f9-dd5ca15a9eb1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:23.434073 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-442fc70b-cfb6-4983-b6f9-dd5ca15a9eb1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:23.497336 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-442fc70b-cfb6-4983-b6f9-dd5ca15a9eb1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:23.507073 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-442fc70b-cfb6-4983-b6f9-dd5ca15a9eb1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.084583 Jul 20 19:40:23.507655 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1092/1723] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:23 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:24.438480 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-268d1ea2-19cc-4b62-9adf-05601c828ac2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:24.439165 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-268d1ea2-19cc-4b62-9adf-05601c828ac2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:24.446240 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-268d1ea2-19cc-4b62-9adf-05601c828ac2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:24.446693 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-268d1ea2-19cc-4b62-9adf-05601c828ac2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:24.447461 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-268d1ea2-19cc-4b62-9adf-05601c828ac2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:24.447891 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-268d1ea2-19cc-4b62-9adf-05601c828ac2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:24.579395 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-268d1ea2-19cc-4b62-9adf-05601c828ac2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:24.581845 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:40:24.588649 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-268d1ea2-19cc-4b62-9adf-05601c828ac2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.154056 Jul 20 19:40:24.589222 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1093/1724] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:24 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:40:24.593666 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e76eed63-9f38-4839-845a-bbcd0d6144c1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:24.594274 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e76eed63-9f38-4839-845a-bbcd0d6144c1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:24.600345 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e76eed63-9f38-4839-845a-bbcd0d6144c1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:24.600794 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e76eed63-9f38-4839-845a-bbcd0d6144c1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:24.601575 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e76eed63-9f38-4839-845a-bbcd0d6144c1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:24.602019 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e76eed63-9f38-4839-845a-bbcd0d6144c1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:24.661903 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e76eed63-9f38-4839-845a-bbcd0d6144c1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:24.669301 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e76eed63-9f38-4839-845a-bbcd0d6144c1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.079120 Jul 20 19:40:24.669903 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1094/1725] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:24 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:25.606672 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a853e7e1-ae2c-47dc-b7cb-4f48cc45e171 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:25.607326 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a853e7e1-ae2c-47dc-b7cb-4f48cc45e171 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:25.613815 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a853e7e1-ae2c-47dc-b7cb-4f48cc45e171 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:25.614265 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a853e7e1-ae2c-47dc-b7cb-4f48cc45e171 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:25.615031 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a853e7e1-ae2c-47dc-b7cb-4f48cc45e171 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:25.615462 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a853e7e1-ae2c-47dc-b7cb-4f48cc45e171 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:25.762675 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a853e7e1-ae2c-47dc-b7cb-4f48cc45e171 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:25.771320 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a853e7e1-ae2c-47dc-b7cb-4f48cc45e171 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.168563 Jul 20 19:40:25.771908 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1095/1726] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:25 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:40:25.777252 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-9ad00fb0-84ae-469c-9c00-618c62ded5e9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:25.777884 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-9ad00fb0-84ae-469c-9c00-618c62ded5e9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:25.784462 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9ad00fb0-84ae-469c-9c00-618c62ded5e9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:25.784916 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9ad00fb0-84ae-469c-9c00-618c62ded5e9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:25.785742 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9ad00fb0-84ae-469c-9c00-618c62ded5e9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:25.786183 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9ad00fb0-84ae-469c-9c00-618c62ded5e9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:25.853636 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-9ad00fb0-84ae-469c-9c00-618c62ded5e9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:25.863844 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-9ad00fb0-84ae-469c-9c00-618c62ded5e9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.090804 Jul 20 19:40:25.864350 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1096/1727] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:25 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:26.789262 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d0e0a7b8-55e8-4cc5-b9b2-b929e0df6557 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:26.789913 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d0e0a7b8-55e8-4cc5-b9b2-b929e0df6557 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:26.796501 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d0e0a7b8-55e8-4cc5-b9b2-b929e0df6557 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:26.796954 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d0e0a7b8-55e8-4cc5-b9b2-b929e0df6557 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:26.797763 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d0e0a7b8-55e8-4cc5-b9b2-b929e0df6557 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:26.798200 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d0e0a7b8-55e8-4cc5-b9b2-b929e0df6557 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:26.928311 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d0e0a7b8-55e8-4cc5-b9b2-b929e0df6557 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:26.935770 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d0e0a7b8-55e8-4cc5-b9b2-b929e0df6557 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.150712 Jul 20 19:40:26.936330 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1097/1728] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:26 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:40:26.940712 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-23745843-4329-4a58-bce6-f4f7781bade2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:26.941299 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-23745843-4329-4a58-bce6-f4f7781bade2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:26.946861 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-23745843-4329-4a58-bce6-f4f7781bade2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:26.947304 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-23745843-4329-4a58-bce6-f4f7781bade2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:26.948044 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-23745843-4329-4a58-bce6-f4f7781bade2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:26.948469 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-23745843-4329-4a58-bce6-f4f7781bade2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:27.010019 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-23745843-4329-4a58-bce6-f4f7781bade2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:27.017395 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-23745843-4329-4a58-bce6-f4f7781bade2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080144 Jul 20 19:40:27.017981 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1098/1729] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:26 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:27.952195 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-7f249e72-282c-4b5f-afac-c0a5f2e29a39 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:27.952873 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-7f249e72-282c-4b5f-afac-c0a5f2e29a39 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:27.959439 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7f249e72-282c-4b5f-afac-c0a5f2e29a39 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:27.959891 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7f249e72-282c-4b5f-afac-c0a5f2e29a39 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:27.960649 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7f249e72-282c-4b5f-afac-c0a5f2e29a39 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:27.961084 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7f249e72-282c-4b5f-afac-c0a5f2e29a39 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:28.095429 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-7f249e72-282c-4b5f-afac-c0a5f2e29a39 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:28.103736 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-7f249e72-282c-4b5f-afac-c0a5f2e29a39 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.155428 Jul 20 19:40:28.104297 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1099/1730] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:27 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:40:28.108680 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-218979a9-b6e0-41f8-b142-9e0e82aa31e2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:28.109283 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-218979a9-b6e0-41f8-b142-9e0e82aa31e2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:28.115742 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-218979a9-b6e0-41f8-b142-9e0e82aa31e2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:28.116198 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-218979a9-b6e0-41f8-b142-9e0e82aa31e2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:28.116958 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-218979a9-b6e0-41f8-b142-9e0e82aa31e2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:28.117398 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-218979a9-b6e0-41f8-b142-9e0e82aa31e2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:28.177285 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-218979a9-b6e0-41f8-b142-9e0e82aa31e2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:28.184804 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-218979a9-b6e0-41f8-b142-9e0e82aa31e2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.079569 Jul 20 19:40:28.185375 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1100/1731] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:28 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:29.121395 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a3ad8d5c-1fb7-46b6-baa6-0f1db1277c1d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:29.122090 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a3ad8d5c-1fb7-46b6-baa6-0f1db1277c1d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:29.128561 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a3ad8d5c-1fb7-46b6-baa6-0f1db1277c1d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:29.129013 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a3ad8d5c-1fb7-46b6-baa6-0f1db1277c1d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:29.129810 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a3ad8d5c-1fb7-46b6-baa6-0f1db1277c1d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:29.130250 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a3ad8d5c-1fb7-46b6-baa6-0f1db1277c1d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:29.259766 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a3ad8d5c-1fb7-46b6-baa6-0f1db1277c1d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:29.267203 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a3ad8d5c-1fb7-46b6-baa6-0f1db1277c1d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.149726 Jul 20 19:40:29.267768 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1101/1732] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:29 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:40:29.272489 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e68e3860-b73c-42af-b97d-fe9c32c4a579 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:29.273100 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e68e3860-b73c-42af-b97d-fe9c32c4a579 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:29.278767 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e68e3860-b73c-42af-b97d-fe9c32c4a579 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:29.279215 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e68e3860-b73c-42af-b97d-fe9c32c4a579 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:29.279973 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e68e3860-b73c-42af-b97d-fe9c32c4a579 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:29.280407 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e68e3860-b73c-42af-b97d-fe9c32c4a579 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:29.347298 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e68e3860-b73c-42af-b97d-fe9c32c4a579 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:29.354799 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e68e3860-b73c-42af-b97d-fe9c32c4a579 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.086000 Jul 20 19:40:29.355366 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1102/1733] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:29 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:30.284081 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ed55f538-b649-4b67-9266-2cadbb0d696d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:30.284860 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ed55f538-b649-4b67-9266-2cadbb0d696d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:30.291653 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ed55f538-b649-4b67-9266-2cadbb0d696d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:30.292073 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ed55f538-b649-4b67-9266-2cadbb0d696d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:30.292830 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ed55f538-b649-4b67-9266-2cadbb0d696d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:30.293254 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ed55f538-b649-4b67-9266-2cadbb0d696d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:30.432942 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ed55f538-b649-4b67-9266-2cadbb0d696d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:30.440540 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ed55f538-b649-4b67-9266-2cadbb0d696d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.160341 Jul 20 19:40:30.441107 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1103/1734] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:30 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:40:30.445492 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-6bd9a555-297a-464f-8c05-730a291dd55b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:30.446114 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-6bd9a555-297a-464f-8c05-730a291dd55b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:30.451709 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6bd9a555-297a-464f-8c05-730a291dd55b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:30.452159 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6bd9a555-297a-464f-8c05-730a291dd55b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:30.452920 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6bd9a555-297a-464f-8c05-730a291dd55b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:30.453357 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6bd9a555-297a-464f-8c05-730a291dd55b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:30.513663 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6bd9a555-297a-464f-8c05-730a291dd55b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:30.521564 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-6bd9a555-297a-464f-8c05-730a291dd55b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.079463 Jul 20 19:40:30.522128 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1104/1735] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:30 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:31.457116 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-fb863931-3e17-4263-a2b3-cd3fb63ccea7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:31.457892 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-fb863931-3e17-4263-a2b3-cd3fb63ccea7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:31.464403 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fb863931-3e17-4263-a2b3-cd3fb63ccea7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:31.464849 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fb863931-3e17-4263-a2b3-cd3fb63ccea7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:31.465628 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fb863931-3e17-4263-a2b3-cd3fb63ccea7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:31.466060 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fb863931-3e17-4263-a2b3-cd3fb63ccea7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:31.599349 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-fb863931-3e17-4263-a2b3-cd3fb63ccea7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:31.607158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-fb863931-3e17-4263-a2b3-cd3fb63ccea7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.154477 Jul 20 19:40:31.607732 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1105/1736] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:31 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:40:31.612643 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-6a421e12-010c-4bbd-9225-82318c79ded1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:31.613274 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-6a421e12-010c-4bbd-9225-82318c79ded1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:31.618940 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6a421e12-010c-4bbd-9225-82318c79ded1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:31.619394 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6a421e12-010c-4bbd-9225-82318c79ded1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:31.620155 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6a421e12-010c-4bbd-9225-82318c79ded1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:31.620594 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6a421e12-010c-4bbd-9225-82318c79ded1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:31.685276 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6a421e12-010c-4bbd-9225-82318c79ded1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:31.692953 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-6a421e12-010c-4bbd-9225-82318c79ded1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.084283 Jul 20 19:40:31.693530 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1106/1737] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:31 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:32.624336 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-dc1b6096-2be5-493f-a692-71c836b40908 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:32.624963 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-dc1b6096-2be5-493f-a692-71c836b40908 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:32.631563 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-dc1b6096-2be5-493f-a692-71c836b40908 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:32.632010 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-dc1b6096-2be5-493f-a692-71c836b40908 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:32.632764 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-dc1b6096-2be5-493f-a692-71c836b40908 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:32.633196 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-dc1b6096-2be5-493f-a692-71c836b40908 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:32.766906 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-dc1b6096-2be5-493f-a692-71c836b40908 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:32.775307 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-dc1b6096-2be5-493f-a692-71c836b40908 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.154860 Jul 20 19:40:32.775878 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1107/1738] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:32 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:40:32.780308 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-7a24d6dc-47b1-44ca-baff-b6be3f70fd3a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:32.780908 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-7a24d6dc-47b1-44ca-baff-b6be3f70fd3a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:32.786553 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7a24d6dc-47b1-44ca-baff-b6be3f70fd3a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:32.787003 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7a24d6dc-47b1-44ca-baff-b6be3f70fd3a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:32.787755 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7a24d6dc-47b1-44ca-baff-b6be3f70fd3a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:32.788191 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7a24d6dc-47b1-44ca-baff-b6be3f70fd3a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:32.852579 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-7a24d6dc-47b1-44ca-baff-b6be3f70fd3a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:32.860040 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-7a24d6dc-47b1-44ca-baff-b6be3f70fd3a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.083231 Jul 20 19:40:32.860633 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1108/1739] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:32 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:33.792779 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-bcdf18a3-c13d-4b77-b4ed-87885f1318dc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:33.793486 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-bcdf18a3-c13d-4b77-b4ed-87885f1318dc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:33.800337 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bcdf18a3-c13d-4b77-b4ed-87885f1318dc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:33.800806 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bcdf18a3-c13d-4b77-b4ed-87885f1318dc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:33.801571 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bcdf18a3-c13d-4b77-b4ed-87885f1318dc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:33.802003 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bcdf18a3-c13d-4b77-b4ed-87885f1318dc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:33.932699 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-bcdf18a3-c13d-4b77-b4ed-87885f1318dc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:33.940404 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-bcdf18a3-c13d-4b77-b4ed-87885f1318dc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.151504 Jul 20 19:40:33.941085 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1109/1740] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:33 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:40:33.945450 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ff66f489-cc59-4b1c-89a9-4a0923e28184 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:33.946081 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ff66f489-cc59-4b1c-89a9-4a0923e28184 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:33.951942 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ff66f489-cc59-4b1c-89a9-4a0923e28184 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:33.952394 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ff66f489-cc59-4b1c-89a9-4a0923e28184 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:33.953149 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ff66f489-cc59-4b1c-89a9-4a0923e28184 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:33.953612 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ff66f489-cc59-4b1c-89a9-4a0923e28184 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:33.969118 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:40:34.016573 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ff66f489-cc59-4b1c-89a9-4a0923e28184 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:34.024585 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ff66f489-cc59-4b1c-89a9-4a0923e28184 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.082497 Jul 20 19:40:34.025148 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1110/1741] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:33 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:34.957498 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-3ce96ddb-a6fd-40c7-9aa4-63cc75b2b15c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:34.958201 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-3ce96ddb-a6fd-40c7-9aa4-63cc75b2b15c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:34.964674 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3ce96ddb-a6fd-40c7-9aa4-63cc75b2b15c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:34.965120 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3ce96ddb-a6fd-40c7-9aa4-63cc75b2b15c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:34.965906 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3ce96ddb-a6fd-40c7-9aa4-63cc75b2b15c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:34.966338 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3ce96ddb-a6fd-40c7-9aa4-63cc75b2b15c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:35.099546 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3ce96ddb-a6fd-40c7-9aa4-63cc75b2b15c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:35.107142 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-3ce96ddb-a6fd-40c7-9aa4-63cc75b2b15c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.153586 Jul 20 19:40:35.107723 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1111/1742] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:34 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:40:35.112770 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-7f09ab91-013e-4d6e-b24b-21363d4d49ae tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:35.113430 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-7f09ab91-013e-4d6e-b24b-21363d4d49ae tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:35.119251 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7f09ab91-013e-4d6e-b24b-21363d4d49ae tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:35.119698 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7f09ab91-013e-4d6e-b24b-21363d4d49ae tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:35.120453 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7f09ab91-013e-4d6e-b24b-21363d4d49ae tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:35.120885 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7f09ab91-013e-4d6e-b24b-21363d4d49ae tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:35.182374 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-7f09ab91-013e-4d6e-b24b-21363d4d49ae tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:35.189924 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-7f09ab91-013e-4d6e-b24b-21363d4d49ae tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.081228 Jul 20 19:40:35.190482 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1112/1743] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:35 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:36.124856 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-0f727665-dd43-47ab-b551-4592b97f6c89 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:36.125502 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-0f727665-dd43-47ab-b551-4592b97f6c89 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:36.132422 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0f727665-dd43-47ab-b551-4592b97f6c89 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:36.132865 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0f727665-dd43-47ab-b551-4592b97f6c89 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:36.133646 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0f727665-dd43-47ab-b551-4592b97f6c89 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:36.134078 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0f727665-dd43-47ab-b551-4592b97f6c89 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:36.263931 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0f727665-dd43-47ab-b551-4592b97f6c89 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:36.272301 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-0f727665-dd43-47ab-b551-4592b97f6c89 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.151275 Jul 20 19:40:36.272867 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1113/1744] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:36 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:40:36.277169 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ad6c444c-818f-462b-9586-179f6dae6c7d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:36.277782 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ad6c444c-818f-462b-9586-179f6dae6c7d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:36.284112 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ad6c444c-818f-462b-9586-179f6dae6c7d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:36.284636 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ad6c444c-818f-462b-9586-179f6dae6c7d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:36.285735 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ad6c444c-818f-462b-9586-179f6dae6c7d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:36.286178 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ad6c444c-818f-462b-9586-179f6dae6c7d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:36.352826 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ad6c444c-818f-462b-9586-179f6dae6c7d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:36.360368 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ad6c444c-818f-462b-9586-179f6dae6c7d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.086551 Jul 20 19:40:36.360928 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1114/1745] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:36 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:37.290078 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-7b24fa0c-3889-43f7-a7c4-c969ba6d8900 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:37.290751 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-7b24fa0c-3889-43f7-a7c4-c969ba6d8900 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:37.297351 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7b24fa0c-3889-43f7-a7c4-c969ba6d8900 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:37.297828 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7b24fa0c-3889-43f7-a7c4-c969ba6d8900 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:37.298598 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7b24fa0c-3889-43f7-a7c4-c969ba6d8900 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:37.299050 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7b24fa0c-3889-43f7-a7c4-c969ba6d8900 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:37.431129 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-7b24fa0c-3889-43f7-a7c4-c969ba6d8900 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:37.438650 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-7b24fa0c-3889-43f7-a7c4-c969ba6d8900 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.153008 Jul 20 19:40:37.439220 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1115/1746] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:37 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:37.444125 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-02b340a0-a5c1-496f-b6dc-88bcc9639995 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:37.444717 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-02b340a0-a5c1-496f-b6dc-88bcc9639995 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:37.446640 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_api:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:40:37.453046 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-02b340a0-a5c1-496f-b6dc-88bcc9639995 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:37.453494 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-02b340a0-a5c1-496f-b6dc-88bcc9639995 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:37.454290 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-02b340a0-a5c1-496f-b6dc-88bcc9639995 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:37.454722 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-02b340a0-a5c1-496f-b6dc-88bcc9639995 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:37.516648 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-02b340a0-a5c1-496f-b6dc-88bcc9639995 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:37.525466 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-02b340a0-a5c1-496f-b6dc-88bcc9639995 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.084652 Jul 20 19:40:37.526100 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1116/1747] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:37 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:38.458981 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4b935173-c8ce-450d-ac14-24cf3aafd5fd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:38.459912 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-4b935173-c8ce-450d-ac14-24cf3aafd5fd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:38.469753 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4b935173-c8ce-450d-ac14-24cf3aafd5fd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:38.470803 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4b935173-c8ce-450d-ac14-24cf3aafd5fd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:38.472278 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4b935173-c8ce-450d-ac14-24cf3aafd5fd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:38.472974 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4b935173-c8ce-450d-ac14-24cf3aafd5fd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:38.608308 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-4b935173-c8ce-450d-ac14-24cf3aafd5fd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:38.617036 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-4b935173-c8ce-450d-ac14-24cf3aafd5fd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.164160 Jul 20 19:40:38.617634 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1117/1748] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:38 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:38.622141 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-2d93125d-84a5-447f-b7fb-e42e759f3cf0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:38.622735 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-2d93125d-84a5-447f-b7fb-e42e759f3cf0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:38.629285 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2d93125d-84a5-447f-b7fb-e42e759f3cf0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:38.629775 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2d93125d-84a5-447f-b7fb-e42e759f3cf0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:38.630532 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2d93125d-84a5-447f-b7fb-e42e759f3cf0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:38.630969 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2d93125d-84a5-447f-b7fb-e42e759f3cf0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:38.691852 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-2d93125d-84a5-447f-b7fb-e42e759f3cf0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:38.699513 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-2d93125d-84a5-447f-b7fb-e42e759f3cf0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080920 Jul 20 19:40:38.700079 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1118/1749] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:38 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:39.634605 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-9f94ac3d-5536-43fb-b78e-ead12377b050 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:39.635249 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-9f94ac3d-5536-43fb-b78e-ead12377b050 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:39.641500 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9f94ac3d-5536-43fb-b78e-ead12377b050 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:39.641969 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9f94ac3d-5536-43fb-b78e-ead12377b050 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:39.642717 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9f94ac3d-5536-43fb-b78e-ead12377b050 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:39.643830 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9f94ac3d-5536-43fb-b78e-ead12377b050 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:39.774096 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-9f94ac3d-5536-43fb-b78e-ead12377b050 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:39.781693 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-9f94ac3d-5536-43fb-b78e-ead12377b050 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.151260 Jul 20 19:40:39.782261 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1119/1750] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:39 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:40:39.787696 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-0bfa8535-341d-4de7-84ae-bad572bde635 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:39.788297 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-0bfa8535-341d-4de7-84ae-bad572bde635 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:39.794358 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0bfa8535-341d-4de7-84ae-bad572bde635 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:39.794804 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0bfa8535-341d-4de7-84ae-bad572bde635 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:39.795583 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0bfa8535-341d-4de7-84ae-bad572bde635 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:39.796017 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0bfa8535-341d-4de7-84ae-bad572bde635 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:39.859369 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0bfa8535-341d-4de7-84ae-bad572bde635 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:39.867609 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-0bfa8535-341d-4de7-84ae-bad572bde635 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.084383 Jul 20 19:40:39.868178 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1120/1751] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:39 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:40.798680 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-6ba82b14-7645-4d49-8ba5-0b7c314571c4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:40.799876 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-6ba82b14-7645-4d49-8ba5-0b7c314571c4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:40.806365 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6ba82b14-7645-4d49-8ba5-0b7c314571c4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:40.806814 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6ba82b14-7645-4d49-8ba5-0b7c314571c4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:40.807577 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6ba82b14-7645-4d49-8ba5-0b7c314571c4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:40.808011 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6ba82b14-7645-4d49-8ba5-0b7c314571c4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:40.946568 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6ba82b14-7645-4d49-8ba5-0b7c314571c4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:40.954147 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-6ba82b14-7645-4d49-8ba5-0b7c314571c4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.159313 Jul 20 19:40:40.954714 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1121/1752] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:40 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:40:40.959429 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-62999e42-8110-4f9d-bd80-b1e67cf6c142 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:40.960032 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-62999e42-8110-4f9d-bd80-b1e67cf6c142 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:40.965632 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-62999e42-8110-4f9d-bd80-b1e67cf6c142 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:40.966114 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-62999e42-8110-4f9d-bd80-b1e67cf6c142 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:40.966874 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-62999e42-8110-4f9d-bd80-b1e67cf6c142 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:40.967311 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-62999e42-8110-4f9d-bd80-b1e67cf6c142 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:41.028705 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-62999e42-8110-4f9d-bd80-b1e67cf6c142 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:41.036831 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-62999e42-8110-4f9d-bd80-b1e67cf6c142 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.081053 Jul 20 19:40:41.037401 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1122/1753] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:40 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:41.971357 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-30eff263-d492-4b4d-848f-a9610780f876 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:41.972049 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-30eff263-d492-4b4d-848f-a9610780f876 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:41.978666 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-30eff263-d492-4b4d-848f-a9610780f876 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:41.979120 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-30eff263-d492-4b4d-848f-a9610780f876 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:41.979890 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-30eff263-d492-4b4d-848f-a9610780f876 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:41.980326 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-30eff263-d492-4b4d-848f-a9610780f876 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:42.120801 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-30eff263-d492-4b4d-848f-a9610780f876 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:42.129262 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-30eff263-d492-4b4d-848f-a9610780f876 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.161970 Jul 20 19:40:42.129872 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1123/1754] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:41 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:40:42.134257 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-36585d4f-1e02-4de2-bdfd-2d0512fc35f6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:42.134878 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-36585d4f-1e02-4de2-bdfd-2d0512fc35f6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:42.140751 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-36585d4f-1e02-4de2-bdfd-2d0512fc35f6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:42.141195 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-36585d4f-1e02-4de2-bdfd-2d0512fc35f6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:42.141972 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-36585d4f-1e02-4de2-bdfd-2d0512fc35f6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:42.142406 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-36585d4f-1e02-4de2-bdfd-2d0512fc35f6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:42.203910 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-36585d4f-1e02-4de2-bdfd-2d0512fc35f6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:42.211872 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-36585d4f-1e02-4de2-bdfd-2d0512fc35f6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.081058 Jul 20 19:40:42.212433 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1124/1755] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:42 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:43.146357 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-36f36faa-cccd-4b22-9c2c-226df17bb368 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:43.147042 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-36f36faa-cccd-4b22-9c2c-226df17bb368 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:43.153872 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-36f36faa-cccd-4b22-9c2c-226df17bb368 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:43.154334 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-36f36faa-cccd-4b22-9c2c-226df17bb368 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:43.155102 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-36f36faa-cccd-4b22-9c2c-226df17bb368 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:43.155567 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-36f36faa-cccd-4b22-9c2c-226df17bb368 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:43.288539 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-36f36faa-cccd-4b22-9c2c-226df17bb368 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:43.296086 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-36f36faa-cccd-4b22-9c2c-226df17bb368 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.153971 Jul 20 19:40:43.296655 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1125/1756] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:43 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:40:43.301162 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-9f183d9b-f156-4793-92ac-00f3b03e3e45 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:43.301969 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-9f183d9b-f156-4793-92ac-00f3b03e3e45 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:43.307877 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9f183d9b-f156-4793-92ac-00f3b03e3e45 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:43.308318 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9f183d9b-f156-4793-92ac-00f3b03e3e45 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:43.309074 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9f183d9b-f156-4793-92ac-00f3b03e3e45 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:43.309503 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9f183d9b-f156-4793-92ac-00f3b03e3e45 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:43.378678 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-9f183d9b-f156-4793-92ac-00f3b03e3e45 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:43.386455 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-9f183d9b-f156-4793-92ac-00f3b03e3e45 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.088844 Jul 20 19:40:43.387010 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1126/1757] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:43 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:44.313751 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-114ae9a5-a0df-4ad5-a69a-157886ba5377 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:44.314504 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-114ae9a5-a0df-4ad5-a69a-157886ba5377 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:44.321328 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-114ae9a5-a0df-4ad5-a69a-157886ba5377 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:44.321805 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-114ae9a5-a0df-4ad5-a69a-157886ba5377 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:44.322568 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-114ae9a5-a0df-4ad5-a69a-157886ba5377 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:44.323006 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-114ae9a5-a0df-4ad5-a69a-157886ba5377 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:44.325735 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:40:44.699330 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-114ae9a5-a0df-4ad5-a69a-157886ba5377 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:44.707451 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-114ae9a5-a0df-4ad5-a69a-157886ba5377 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.397602 Jul 20 19:40:44.708020 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1127/1758] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:44 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:40:44.712574 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e36b48ee-72a0-4745-8f2b-f51a5322d023 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:44.713170 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e36b48ee-72a0-4745-8f2b-f51a5322d023 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:44.718997 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e36b48ee-72a0-4745-8f2b-f51a5322d023 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:44.719442 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e36b48ee-72a0-4745-8f2b-f51a5322d023 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:44.720189 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e36b48ee-72a0-4745-8f2b-f51a5322d023 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:44.720954 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e36b48ee-72a0-4745-8f2b-f51a5322d023 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:44.782433 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e36b48ee-72a0-4745-8f2b-f51a5322d023 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:44.789929 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e36b48ee-72a0-4745-8f2b-f51a5322d023 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080941 Jul 20 19:40:44.790495 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1128/1759] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:44 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:45.725763 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e794e960-0149-4fb3-b3ff-3271f870934c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:45.726413 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e794e960-0149-4fb3-b3ff-3271f870934c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:45.732935 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e794e960-0149-4fb3-b3ff-3271f870934c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:45.733386 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e794e960-0149-4fb3-b3ff-3271f870934c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:45.734183 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e794e960-0149-4fb3-b3ff-3271f870934c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:45.734621 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e794e960-0149-4fb3-b3ff-3271f870934c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:45.869732 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e794e960-0149-4fb3-b3ff-3271f870934c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:45.877672 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e794e960-0149-4fb3-b3ff-3271f870934c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.155723 Jul 20 19:40:45.878363 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1129/1760] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:45 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:40:45.882827 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-f098a9c6-b81c-4102-a0ac-1bbddcb02ab5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:45.883417 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-f098a9c6-b81c-4102-a0ac-1bbddcb02ab5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:45.891016 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f098a9c6-b81c-4102-a0ac-1bbddcb02ab5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:45.891460 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f098a9c6-b81c-4102-a0ac-1bbddcb02ab5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:45.892219 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f098a9c6-b81c-4102-a0ac-1bbddcb02ab5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:45.893242 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f098a9c6-b81c-4102-a0ac-1bbddcb02ab5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:45.955509 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-f098a9c6-b81c-4102-a0ac-1bbddcb02ab5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:45.963013 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-f098a9c6-b81c-4102-a0ac-1bbddcb02ab5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.083708 Jul 20 19:40:45.963568 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1130/1761] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:45 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:46.894990 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-adaecab8-19ec-4b94-bcb5-98df6206313c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:46.896002 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-adaecab8-19ec-4b94-bcb5-98df6206313c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:46.902596 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-adaecab8-19ec-4b94-bcb5-98df6206313c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:46.903040 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-adaecab8-19ec-4b94-bcb5-98df6206313c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:46.903816 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-adaecab8-19ec-4b94-bcb5-98df6206313c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:46.904249 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-adaecab8-19ec-4b94-bcb5-98df6206313c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:47.041106 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-adaecab8-19ec-4b94-bcb5-98df6206313c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:47.048672 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-adaecab8-19ec-4b94-bcb5-98df6206313c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.157778 Jul 20 19:40:47.049871 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1131/1762] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:46 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:40:47.054413 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-bf34d33c-6efe-40b6-9cc3-17fea45bdb51 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:47.055012 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-bf34d33c-6efe-40b6-9cc3-17fea45bdb51 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:47.060872 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bf34d33c-6efe-40b6-9cc3-17fea45bdb51 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:47.061306 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bf34d33c-6efe-40b6-9cc3-17fea45bdb51 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:47.062093 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bf34d33c-6efe-40b6-9cc3-17fea45bdb51 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:47.062514 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bf34d33c-6efe-40b6-9cc3-17fea45bdb51 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:47.127641 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-bf34d33c-6efe-40b6-9cc3-17fea45bdb51 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:47.135303 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-bf34d33c-6efe-40b6-9cc3-17fea45bdb51 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.084440 Jul 20 19:40:47.135875 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1132/1763] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:47 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:48.066926 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-8e0b134e-de95-4286-85e6-e97a19beff73 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:48.067641 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-8e0b134e-de95-4286-85e6-e97a19beff73 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:48.074305 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8e0b134e-de95-4286-85e6-e97a19beff73 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:48.074743 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8e0b134e-de95-4286-85e6-e97a19beff73 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:48.075503 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8e0b134e-de95-4286-85e6-e97a19beff73 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:48.075929 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8e0b134e-de95-4286-85e6-e97a19beff73 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:48.270156 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8e0b134e-de95-4286-85e6-e97a19beff73 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:48.277890 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-8e0b134e-de95-4286-85e6-e97a19beff73 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.215401 Jul 20 19:40:48.278468 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1133/1764] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:48 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:40:48.283087 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-3b7d30d0-d783-4b0f-9c29-f4ef6b24ebab tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:48.284335 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-3b7d30d0-d783-4b0f-9c29-f4ef6b24ebab tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:48.290259 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3b7d30d0-d783-4b0f-9c29-f4ef6b24ebab tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:48.290707 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3b7d30d0-d783-4b0f-9c29-f4ef6b24ebab tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:48.291472 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3b7d30d0-d783-4b0f-9c29-f4ef6b24ebab tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:48.291904 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3b7d30d0-d783-4b0f-9c29-f4ef6b24ebab tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:48.384413 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3b7d30d0-d783-4b0f-9c29-f4ef6b24ebab tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:48.392390 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-3b7d30d0-d783-4b0f-9c29-f4ef6b24ebab tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.112853 Jul 20 19:40:48.393670 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1134/1765] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:48 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:49.295265 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-00e00d18-768a-4e70-a42d-332ded5a5643 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:49.296102 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-00e00d18-768a-4e70-a42d-332ded5a5643 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:49.303672 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-00e00d18-768a-4e70-a42d-332ded5a5643 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:49.304111 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-00e00d18-768a-4e70-a42d-332ded5a5643 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:49.304990 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-00e00d18-768a-4e70-a42d-332ded5a5643 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:49.305340 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-00e00d18-768a-4e70-a42d-332ded5a5643 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:49.447964 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-00e00d18-768a-4e70-a42d-332ded5a5643 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:49.456428 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-00e00d18-768a-4e70-a42d-332ded5a5643 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.165193 Jul 20 19:40:49.457003 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1135/1766] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:49 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:40:49.461798 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-226f3da1-0790-4862-b887-9f5628fa5d8f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:49.462474 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-226f3da1-0790-4862-b887-9f5628fa5d8f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:49.468459 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-226f3da1-0790-4862-b887-9f5628fa5d8f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:49.468908 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-226f3da1-0790-4862-b887-9f5628fa5d8f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:49.469692 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-226f3da1-0790-4862-b887-9f5628fa5d8f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:49.470124 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-226f3da1-0790-4862-b887-9f5628fa5d8f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:49.533477 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-226f3da1-0790-4862-b887-9f5628fa5d8f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:49.541420 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-226f3da1-0790-4862-b887-9f5628fa5d8f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.083451 Jul 20 19:40:49.542084 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1136/1767] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:49 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:50.478031 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a307ac17-5952-4aab-b100-93cf84d17ead tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:50.478699 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a307ac17-5952-4aab-b100-93cf84d17ead tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:50.485088 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a307ac17-5952-4aab-b100-93cf84d17ead tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:50.485551 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a307ac17-5952-4aab-b100-93cf84d17ead tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:50.486402 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a307ac17-5952-4aab-b100-93cf84d17ead tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:50.487165 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a307ac17-5952-4aab-b100-93cf84d17ead tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:50.622809 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a307ac17-5952-4aab-b100-93cf84d17ead tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:50.630566 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a307ac17-5952-4aab-b100-93cf84d17ead tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.156369 Jul 20 19:40:50.631513 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1137/1768] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:50 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:40:50.635831 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d5144aee-c7ff-481e-8c0a-e160fd3a6bb0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:50.636462 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d5144aee-c7ff-481e-8c0a-e160fd3a6bb0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:50.642902 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d5144aee-c7ff-481e-8c0a-e160fd3a6bb0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:50.643551 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d5144aee-c7ff-481e-8c0a-e160fd3a6bb0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:50.644325 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d5144aee-c7ff-481e-8c0a-e160fd3a6bb0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:50.644752 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d5144aee-c7ff-481e-8c0a-e160fd3a6bb0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:50.710921 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d5144aee-c7ff-481e-8c0a-e160fd3a6bb0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:50.718500 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d5144aee-c7ff-481e-8c0a-e160fd3a6bb0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.086182 Jul 20 19:40:50.719070 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1138/1769] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:50 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:51.649336 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-87dc88d0-645b-4d76-8a9a-1c105b02f2e2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:51.650205 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-87dc88d0-645b-4d76-8a9a-1c105b02f2e2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:51.657861 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-87dc88d0-645b-4d76-8a9a-1c105b02f2e2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:51.658305 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-87dc88d0-645b-4d76-8a9a-1c105b02f2e2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:51.659071 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-87dc88d0-645b-4d76-8a9a-1c105b02f2e2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:51.659501 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-87dc88d0-645b-4d76-8a9a-1c105b02f2e2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:51.797383 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-87dc88d0-645b-4d76-8a9a-1c105b02f2e2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:51.808659 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-87dc88d0-645b-4d76-8a9a-1c105b02f2e2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.163163 Jul 20 19:40:51.809228 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1139/1770] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:51 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:40:51.813911 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-6def65ef-d964-4df0-bb1f-36663ec8319b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:51.815250 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-6def65ef-d964-4df0-bb1f-36663ec8319b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:51.821476 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6def65ef-d964-4df0-bb1f-36663ec8319b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:51.821951 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6def65ef-d964-4df0-bb1f-36663ec8319b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:51.822711 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6def65ef-d964-4df0-bb1f-36663ec8319b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:51.823141 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6def65ef-d964-4df0-bb1f-36663ec8319b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:51.892018 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6def65ef-d964-4df0-bb1f-36663ec8319b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:51.900054 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-6def65ef-d964-4df0-bb1f-36663ec8319b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.089783 Jul 20 19:40:51.900614 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1140/1771] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:51 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:52.828459 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-dc09bcde-be75-43d4-98dc-473a3dc64296 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:52.829172 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-dc09bcde-be75-43d4-98dc-473a3dc64296 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:52.837217 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-dc09bcde-be75-43d4-98dc-473a3dc64296 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:52.837686 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-dc09bcde-be75-43d4-98dc-473a3dc64296 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:52.838459 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-dc09bcde-be75-43d4-98dc-473a3dc64296 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:52.838886 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-dc09bcde-be75-43d4-98dc-473a3dc64296 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:52.986491 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-dc09bcde-be75-43d4-98dc-473a3dc64296 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:52.994726 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-dc09bcde-be75-43d4-98dc-473a3dc64296 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.171340 Jul 20 19:40:52.995457 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1141/1772] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:52 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:40:53.000728 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-47aa88a6-3e73-4153-beb4-75fd508343e3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:53.001337 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-47aa88a6-3e73-4153-beb4-75fd508343e3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:53.008605 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-47aa88a6-3e73-4153-beb4-75fd508343e3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:53.009077 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-47aa88a6-3e73-4153-beb4-75fd508343e3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:53.009893 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-47aa88a6-3e73-4153-beb4-75fd508343e3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:53.010333 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-47aa88a6-3e73-4153-beb4-75fd508343e3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:53.076207 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-47aa88a6-3e73-4153-beb4-75fd508343e3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:53.084406 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-47aa88a6-3e73-4153-beb4-75fd508343e3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.087888 Jul 20 19:40:53.084981 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1142/1773] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:52 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:54.014594 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-943fec89-68d8-4723-ab6e-781e2fb0acef tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:54.015242 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-943fec89-68d8-4723-ab6e-781e2fb0acef tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:54.022570 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-943fec89-68d8-4723-ab6e-781e2fb0acef tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:54.023029 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-943fec89-68d8-4723-ab6e-781e2fb0acef tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:54.023791 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-943fec89-68d8-4723-ab6e-781e2fb0acef tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:54.024217 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-943fec89-68d8-4723-ab6e-781e2fb0acef tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:54.157587 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-943fec89-68d8-4723-ab6e-781e2fb0acef tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:54.160898 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:40:54.167514 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-943fec89-68d8-4723-ab6e-781e2fb0acef tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.157103 Jul 20 19:40:54.168087 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1143/1774] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:54 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:54.172418 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d890275f-fc37-425d-bff6-0dd2ca8bbec0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:54.173012 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d890275f-fc37-425d-bff6-0dd2ca8bbec0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:54.178878 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d890275f-fc37-425d-bff6-0dd2ca8bbec0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:54.179325 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d890275f-fc37-425d-bff6-0dd2ca8bbec0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:54.180079 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d890275f-fc37-425d-bff6-0dd2ca8bbec0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:54.180540 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d890275f-fc37-425d-bff6-0dd2ca8bbec0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:54.244689 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d890275f-fc37-425d-bff6-0dd2ca8bbec0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:54.252247 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d890275f-fc37-425d-bff6-0dd2ca8bbec0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.083162 Jul 20 19:40:54.252812 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1144/1775] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:54 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:55.184552 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-eca00c45-e632-462a-94c2-647a3c42fe6f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:55.185234 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-eca00c45-e632-462a-94c2-647a3c42fe6f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:55.192102 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-eca00c45-e632-462a-94c2-647a3c42fe6f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:55.192539 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-eca00c45-e632-462a-94c2-647a3c42fe6f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:55.193284 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-eca00c45-e632-462a-94c2-647a3c42fe6f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:55.193744 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-eca00c45-e632-462a-94c2-647a3c42fe6f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:55.327496 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-eca00c45-e632-462a-94c2-647a3c42fe6f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:55.336294 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-eca00c45-e632-462a-94c2-647a3c42fe6f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.155550 Jul 20 19:40:55.336907 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1145/1776] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:55 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:40:55.341437 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-7ed64a72-591f-4ad8-9c1b-381b26db7f8a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:55.342069 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-7ed64a72-591f-4ad8-9c1b-381b26db7f8a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:55.348659 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7ed64a72-591f-4ad8-9c1b-381b26db7f8a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:55.349112 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7ed64a72-591f-4ad8-9c1b-381b26db7f8a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:55.349942 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7ed64a72-591f-4ad8-9c1b-381b26db7f8a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:55.350381 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7ed64a72-591f-4ad8-9c1b-381b26db7f8a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:55.422739 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-7ed64a72-591f-4ad8-9c1b-381b26db7f8a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:55.431131 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-7ed64a72-591f-4ad8-9c1b-381b26db7f8a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.093192 Jul 20 19:40:55.431711 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1146/1777] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:55 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:56.354227 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d0d38d86-47ad-43d0-903a-f10caac8c600 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:56.354877 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d0d38d86-47ad-43d0-903a-f10caac8c600 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:56.361961 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d0d38d86-47ad-43d0-903a-f10caac8c600 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:56.362415 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d0d38d86-47ad-43d0-903a-f10caac8c600 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:56.363188 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d0d38d86-47ad-43d0-903a-f10caac8c600 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:56.363622 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d0d38d86-47ad-43d0-903a-f10caac8c600 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:56.498610 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d0d38d86-47ad-43d0-903a-f10caac8c600 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:56.506661 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d0d38d86-47ad-43d0-903a-f10caac8c600 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.156288 Jul 20 19:40:56.507227 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1147/1778] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:56 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:40:56.511579 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-bf6f57f5-4d23-4ace-b96f-ca646724acc9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:56.512174 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-bf6f57f5-4d23-4ace-b96f-ca646724acc9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:56.517959 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bf6f57f5-4d23-4ace-b96f-ca646724acc9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:56.518398 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bf6f57f5-4d23-4ace-b96f-ca646724acc9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:56.519154 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bf6f57f5-4d23-4ace-b96f-ca646724acc9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:56.519583 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bf6f57f5-4d23-4ace-b96f-ca646724acc9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:56.583662 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-bf6f57f5-4d23-4ace-b96f-ca646724acc9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:56.596861 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-bf6f57f5-4d23-4ace-b96f-ca646724acc9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.088076 Jul 20 19:40:56.597661 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1148/1779] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:56 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:57.524630 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-746e146f-6819-4b92-bad4-38ac5b6093b2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:57.525334 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-746e146f-6819-4b92-bad4-38ac5b6093b2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:57.532060 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-746e146f-6819-4b92-bad4-38ac5b6093b2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:57.532506 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-746e146f-6819-4b92-bad4-38ac5b6093b2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:57.533306 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-746e146f-6819-4b92-bad4-38ac5b6093b2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:57.533880 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-746e146f-6819-4b92-bad4-38ac5b6093b2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:57.666221 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-746e146f-6819-4b92-bad4-38ac5b6093b2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:57.673645 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-746e146f-6819-4b92-bad4-38ac5b6093b2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.152942 Jul 20 19:40:57.674326 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1149/1780] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:57 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:40:57.678994 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-45e90e38-0537-46e8-a8c6-1c192496dce2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:57.679670 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-45e90e38-0537-46e8-a8c6-1c192496dce2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:57.686317 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-45e90e38-0537-46e8-a8c6-1c192496dce2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:57.686767 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-45e90e38-0537-46e8-a8c6-1c192496dce2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:57.687534 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-45e90e38-0537-46e8-a8c6-1c192496dce2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:57.687966 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-45e90e38-0537-46e8-a8c6-1c192496dce2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:57.755344 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-45e90e38-0537-46e8-a8c6-1c192496dce2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:57.763186 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-45e90e38-0537-46e8-a8c6-1c192496dce2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.087626 Jul 20 19:40:57.763759 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1150/1781] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:57 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:58.691492 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-02abd5ce-942a-4a91-ba06-e08967e7ddba tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:58.692183 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-02abd5ce-942a-4a91-ba06-e08967e7ddba tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:58.706656 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-02abd5ce-942a-4a91-ba06-e08967e7ddba tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:58.707488 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-02abd5ce-942a-4a91-ba06-e08967e7ddba tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:58.708311 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-02abd5ce-942a-4a91-ba06-e08967e7ddba tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:58.708763 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-02abd5ce-942a-4a91-ba06-e08967e7ddba tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:58.852957 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-02abd5ce-942a-4a91-ba06-e08967e7ddba tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:58.860679 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-02abd5ce-942a-4a91-ba06-e08967e7ddba tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.173859 Jul 20 19:40:58.861268 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1151/1782] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:58 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:40:58.865910 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-923090bc-4bec-4c6d-aa99-cb91b96febdf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:58.866517 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-923090bc-4bec-4c6d-aa99-cb91b96febdf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:58.872380 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-923090bc-4bec-4c6d-aa99-cb91b96febdf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:58.872834 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-923090bc-4bec-4c6d-aa99-cb91b96febdf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:58.873622 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-923090bc-4bec-4c6d-aa99-cb91b96febdf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:58.874066 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-923090bc-4bec-4c6d-aa99-cb91b96febdf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:58.936613 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-923090bc-4bec-4c6d-aa99-cb91b96febdf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:58.944810 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-923090bc-4bec-4c6d-aa99-cb91b96febdf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.082390 Jul 20 19:40:58.945374 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1152/1783] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:58 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:59.880771 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a3bfd827-2c24-4ae3-9afe-5434981137d3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:59.881459 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a3bfd827-2c24-4ae3-9afe-5434981137d3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:59.887941 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a3bfd827-2c24-4ae3-9afe-5434981137d3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:59.888381 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a3bfd827-2c24-4ae3-9afe-5434981137d3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:59.889128 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a3bfd827-2c24-4ae3-9afe-5434981137d3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:59.889580 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a3bfd827-2c24-4ae3-9afe-5434981137d3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:00.031982 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a3bfd827-2c24-4ae3-9afe-5434981137d3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:00.040354 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a3bfd827-2c24-4ae3-9afe-5434981137d3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.164149 Jul 20 19:41:00.040923 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1153/1784] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:59 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:41:00.045693 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d9434552-d8c1-4c90-a069-26d68c46a299 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:00.046300 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d9434552-d8c1-4c90-a069-26d68c46a299 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:00.052641 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d9434552-d8c1-4c90-a069-26d68c46a299 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:00.053088 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d9434552-d8c1-4c90-a069-26d68c46a299 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:00.053892 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d9434552-d8c1-4c90-a069-26d68c46a299 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:00.054323 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d9434552-d8c1-4c90-a069-26d68c46a299 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:00.116640 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d9434552-d8c1-4c90-a069-26d68c46a299 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:00.124190 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d9434552-d8c1-4c90-a069-26d68c46a299 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.082319 Jul 20 19:41:00.124759 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1154/1785] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:00 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:41:01.056490 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-fb1999f8-8189-4888-a008-bd18d860552c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:01.057189 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-fb1999f8-8189-4888-a008-bd18d860552c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:01.063782 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fb1999f8-8189-4888-a008-bd18d860552c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:01.064221 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fb1999f8-8189-4888-a008-bd18d860552c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:01.065033 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fb1999f8-8189-4888-a008-bd18d860552c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:01.065462 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fb1999f8-8189-4888-a008-bd18d860552c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:01.210898 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-fb1999f8-8189-4888-a008-bd18d860552c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:01.218325 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-fb1999f8-8189-4888-a008-bd18d860552c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.165773 Jul 20 19:41:01.218899 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1155/1786] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:01 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:41:01.224533 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-6018c7f9-d6f9-4ff0-b884-6598cc37c478 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:01.225232 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-6018c7f9-d6f9-4ff0-b884-6598cc37c478 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:01.231392 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6018c7f9-d6f9-4ff0-b884-6598cc37c478 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:01.231841 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6018c7f9-d6f9-4ff0-b884-6598cc37c478 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:01.232606 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6018c7f9-d6f9-4ff0-b884-6598cc37c478 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:01.233088 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6018c7f9-d6f9-4ff0-b884-6598cc37c478 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:01.299612 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6018c7f9-d6f9-4ff0-b884-6598cc37c478 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:01.308363 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-6018c7f9-d6f9-4ff0-b884-6598cc37c478 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.088430 Jul 20 19:41:01.308865 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1156/1787] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:01 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:41:02.236201 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-15cb67b1-0961-4424-807d-8b3cbf0eca44 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:02.236924 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-15cb67b1-0961-4424-807d-8b3cbf0eca44 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:02.243671 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-15cb67b1-0961-4424-807d-8b3cbf0eca44 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:02.244172 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-15cb67b1-0961-4424-807d-8b3cbf0eca44 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:02.244945 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-15cb67b1-0961-4424-807d-8b3cbf0eca44 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:02.245378 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-15cb67b1-0961-4424-807d-8b3cbf0eca44 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:02.389355 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-15cb67b1-0961-4424-807d-8b3cbf0eca44 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:02.397765 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-15cb67b1-0961-4424-807d-8b3cbf0eca44 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.165339 Jul 20 19:41:02.398341 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1157/1788] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:02 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:41:02.402772 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-39c7125b-9fff-4047-b985-10a29fa102e9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:02.403375 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-39c7125b-9fff-4047-b985-10a29fa102e9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:02.415190 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-39c7125b-9fff-4047-b985-10a29fa102e9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:02.416122 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-39c7125b-9fff-4047-b985-10a29fa102e9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:02.418114 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-39c7125b-9fff-4047-b985-10a29fa102e9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:02.419290 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-39c7125b-9fff-4047-b985-10a29fa102e9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:02.487900 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-39c7125b-9fff-4047-b985-10a29fa102e9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:02.496397 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-39c7125b-9fff-4047-b985-10a29fa102e9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.097029 Jul 20 19:41:02.497162 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1158/1789] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:02 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:41:03.416053 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d9e61d88-9beb-4965-a5c0-4869d543863f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:03.416731 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d9e61d88-9beb-4965-a5c0-4869d543863f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:03.422761 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d9e61d88-9beb-4965-a5c0-4869d543863f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:03.423212 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d9e61d88-9beb-4965-a5c0-4869d543863f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:03.423980 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d9e61d88-9beb-4965-a5c0-4869d543863f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:03.424423 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d9e61d88-9beb-4965-a5c0-4869d543863f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:03.561550 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d9e61d88-9beb-4965-a5c0-4869d543863f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:03.569907 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d9e61d88-9beb-4965-a5c0-4869d543863f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.157870 Jul 20 19:41:03.570492 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1159/1790] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:03 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:41:03.574957 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-21fb6a23-b0f3-4b60-b0e8-cb35f851f684 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:03.575493 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-21fb6a23-b0f3-4b60-b0e8-cb35f851f684 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:03.582129 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-21fb6a23-b0f3-4b60-b0e8-cb35f851f684 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:03.582576 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-21fb6a23-b0f3-4b60-b0e8-cb35f851f684 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:03.583343 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-21fb6a23-b0f3-4b60-b0e8-cb35f851f684 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:03.583796 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-21fb6a23-b0f3-4b60-b0e8-cb35f851f684 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:03.599440 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:41:03.647241 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-21fb6a23-b0f3-4b60-b0e8-cb35f851f684 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:03.654889 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-21fb6a23-b0f3-4b60-b0e8-cb35f851f684 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.083418 Jul 20 19:41:03.655460 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1160/1791] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:03 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:41:04.587976 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-38882085-32f0-4dcc-929c-2c273d89d520 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:04.588686 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-38882085-32f0-4dcc-929c-2c273d89d520 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:04.594908 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-38882085-32f0-4dcc-929c-2c273d89d520 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:04.595349 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-38882085-32f0-4dcc-929c-2c273d89d520 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:04.596943 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-38882085-32f0-4dcc-929c-2c273d89d520 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:04.597371 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-38882085-32f0-4dcc-929c-2c273d89d520 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:04.728887 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-38882085-32f0-4dcc-929c-2c273d89d520 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:04.736358 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-38882085-32f0-4dcc-929c-2c273d89d520 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.152609 Jul 20 19:41:04.736964 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1161/1792] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:04 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:41:04.741464 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-b43fb425-e07c-42e1-9b93-e02a1d687de5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:04.742090 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-b43fb425-e07c-42e1-9b93-e02a1d687de5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:04.753238 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b43fb425-e07c-42e1-9b93-e02a1d687de5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:04.753719 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b43fb425-e07c-42e1-9b93-e02a1d687de5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:04.754491 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b43fb425-e07c-42e1-9b93-e02a1d687de5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:04.754951 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b43fb425-e07c-42e1-9b93-e02a1d687de5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:04.819900 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-b43fb425-e07c-42e1-9b93-e02a1d687de5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:04.827306 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-b43fb425-e07c-42e1-9b93-e02a1d687de5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.089398 Jul 20 19:41:04.827865 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1162/1793] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:04 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:41:05.754392 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-f5798e94-7ac0-4cc8-aded-c67cb34e0966 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:05.755072 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-f5798e94-7ac0-4cc8-aded-c67cb34e0966 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:05.761462 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f5798e94-7ac0-4cc8-aded-c67cb34e0966 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:05.761932 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f5798e94-7ac0-4cc8-aded-c67cb34e0966 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:05.762701 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f5798e94-7ac0-4cc8-aded-c67cb34e0966 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:05.763171 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f5798e94-7ac0-4cc8-aded-c67cb34e0966 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:05.895936 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-f5798e94-7ac0-4cc8-aded-c67cb34e0966 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:05.903378 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-f5798e94-7ac0-4cc8-aded-c67cb34e0966 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.153577 Jul 20 19:41:05.903940 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1163/1794] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:05 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:41:05.908237 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-0df0dc3c-efac-4adf-acf2-79a46755b858 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:05.908980 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-0df0dc3c-efac-4adf-acf2-79a46755b858 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:05.914746 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0df0dc3c-efac-4adf-acf2-79a46755b858 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:05.915199 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0df0dc3c-efac-4adf-acf2-79a46755b858 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:05.915991 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0df0dc3c-efac-4adf-acf2-79a46755b858 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:05.916420 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0df0dc3c-efac-4adf-acf2-79a46755b858 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:05.982202 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0df0dc3c-efac-4adf-acf2-79a46755b858 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:05.990625 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-0df0dc3c-efac-4adf-acf2-79a46755b858 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.085750 Jul 20 19:41:05.991196 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1164/1795] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:05 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:41:06.920395 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-170362d5-9d9c-416b-97b1-24b73c8a4252 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:06.921081 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-170362d5-9d9c-416b-97b1-24b73c8a4252 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:06.927865 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-170362d5-9d9c-416b-97b1-24b73c8a4252 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:06.928311 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-170362d5-9d9c-416b-97b1-24b73c8a4252 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:06.929061 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-170362d5-9d9c-416b-97b1-24b73c8a4252 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:06.929495 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-170362d5-9d9c-416b-97b1-24b73c8a4252 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:07.061623 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-170362d5-9d9c-416b-97b1-24b73c8a4252 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:07.069129 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-170362d5-9d9c-416b-97b1-24b73c8a4252 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.152559 Jul 20 19:41:07.069762 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1165/1796] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:06 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:41:07.074154 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-6684b99b-2b48-488c-b233-97c5d5111446 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:07.074754 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-6684b99b-2b48-488c-b233-97c5d5111446 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:07.076411 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_api:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:41:07.082327 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6684b99b-2b48-488c-b233-97c5d5111446 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:07.082774 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6684b99b-2b48-488c-b233-97c5d5111446 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:07.083540 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6684b99b-2b48-488c-b233-97c5d5111446 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:07.083974 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6684b99b-2b48-488c-b233-97c5d5111446 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:07.144314 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6684b99b-2b48-488c-b233-97c5d5111446 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:07.151740 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-6684b99b-2b48-488c-b233-97c5d5111446 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.081039 Jul 20 19:41:07.152311 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1166/1797] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:07 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:41:08.086266 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-b9bfdea9-1fe8-406a-acbd-6640298f5c7a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:08.086954 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-b9bfdea9-1fe8-406a-acbd-6640298f5c7a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:08.093346 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b9bfdea9-1fe8-406a-acbd-6640298f5c7a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:08.093829 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b9bfdea9-1fe8-406a-acbd-6640298f5c7a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:08.094596 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b9bfdea9-1fe8-406a-acbd-6640298f5c7a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:08.095034 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b9bfdea9-1fe8-406a-acbd-6640298f5c7a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:08.226012 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-b9bfdea9-1fe8-406a-acbd-6640298f5c7a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:08.233420 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-b9bfdea9-1fe8-406a-acbd-6640298f5c7a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.151018 Jul 20 19:41:08.234015 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1167/1798] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:08 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:41:08.239324 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-cb3ee79f-795d-49b6-bebd-5acc978b4d06 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:08.239937 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-cb3ee79f-795d-49b6-bebd-5acc978b4d06 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:08.246463 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cb3ee79f-795d-49b6-bebd-5acc978b4d06 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:08.246913 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cb3ee79f-795d-49b6-bebd-5acc978b4d06 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:08.247737 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cb3ee79f-795d-49b6-bebd-5acc978b4d06 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:08.248167 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cb3ee79f-795d-49b6-bebd-5acc978b4d06 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:08.314567 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-cb3ee79f-795d-49b6-bebd-5acc978b4d06 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:08.322410 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-cb3ee79f-795d-49b6-bebd-5acc978b4d06 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.087377 Jul 20 19:41:08.322992 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1168/1799] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:08 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:41:09.255336 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-eac33bad-d786-46a6-9f8c-e5b4e75b5890 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:09.256487 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-eac33bad-d786-46a6-9f8c-e5b4e75b5890 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:09.267466 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-eac33bad-d786-46a6-9f8c-e5b4e75b5890 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:09.268205 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-eac33bad-d786-46a6-9f8c-e5b4e75b5890 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:09.271140 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-eac33bad-d786-46a6-9f8c-e5b4e75b5890 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:09.271822 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-eac33bad-d786-46a6-9f8c-e5b4e75b5890 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:09.411756 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-eac33bad-d786-46a6-9f8c-e5b4e75b5890 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:09.419427 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-eac33bad-d786-46a6-9f8c-e5b4e75b5890 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.171625 Jul 20 19:41:09.419999 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1169/1800] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:09 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:41:09.425560 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-24cbecae-5c50-48ad-b40d-c2ff47663bab tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:09.427090 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-24cbecae-5c50-48ad-b40d-c2ff47663bab tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:09.432518 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-24cbecae-5c50-48ad-b40d-c2ff47663bab tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:09.432972 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-24cbecae-5c50-48ad-b40d-c2ff47663bab tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:09.433781 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-24cbecae-5c50-48ad-b40d-c2ff47663bab tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:09.434222 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-24cbecae-5c50-48ad-b40d-c2ff47663bab tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:09.496450 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-24cbecae-5c50-48ad-b40d-c2ff47663bab tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:09.504126 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-24cbecae-5c50-48ad-b40d-c2ff47663bab tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.083183 Jul 20 19:41:09.504690 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1170/1801] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:09 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:41:10.437701 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-bfa1f586-2d35-4629-9579-805a030ec439 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:10.438190 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-bfa1f586-2d35-4629-9579-805a030ec439 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:10.445229 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bfa1f586-2d35-4629-9579-805a030ec439 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:10.445714 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bfa1f586-2d35-4629-9579-805a030ec439 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:10.446477 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bfa1f586-2d35-4629-9579-805a030ec439 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:10.446914 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bfa1f586-2d35-4629-9579-805a030ec439 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:10.583427 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-bfa1f586-2d35-4629-9579-805a030ec439 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:10.590989 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-bfa1f586-2d35-4629-9579-805a030ec439 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.157295 Jul 20 19:41:10.591555 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1171/1802] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:10 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:41:10.597361 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c330e451-cdf8-428d-b1dc-8ca1f57479dc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:10.597361 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c330e451-cdf8-428d-b1dc-8ca1f57479dc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:10.602782 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c330e451-cdf8-428d-b1dc-8ca1f57479dc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:10.603227 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c330e451-cdf8-428d-b1dc-8ca1f57479dc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:10.603982 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c330e451-cdf8-428d-b1dc-8ca1f57479dc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:10.604475 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c330e451-cdf8-428d-b1dc-8ca1f57479dc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:10.666655 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c330e451-cdf8-428d-b1dc-8ca1f57479dc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:10.674646 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c330e451-cdf8-428d-b1dc-8ca1f57479dc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.081669 Jul 20 19:41:10.675273 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1172/1803] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:10 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:41:11.607979 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-8e30c69c-85d6-4da1-9c59-b76461ec9dcf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:11.608604 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-8e30c69c-85d6-4da1-9c59-b76461ec9dcf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:11.615104 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8e30c69c-85d6-4da1-9c59-b76461ec9dcf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:11.615550 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8e30c69c-85d6-4da1-9c59-b76461ec9dcf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:11.616307 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8e30c69c-85d6-4da1-9c59-b76461ec9dcf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:11.616738 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8e30c69c-85d6-4da1-9c59-b76461ec9dcf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:11.746336 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8e30c69c-85d6-4da1-9c59-b76461ec9dcf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:11.754642 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-8e30c69c-85d6-4da1-9c59-b76461ec9dcf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.150579 Jul 20 19:41:11.755213 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1173/1804] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:11 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:41:11.759658 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-750ec55f-ebd0-4f6b-8224-2877e5cfa27b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:11.760256 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-750ec55f-ebd0-4f6b-8224-2877e5cfa27b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:11.765957 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-750ec55f-ebd0-4f6b-8224-2877e5cfa27b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:11.766409 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-750ec55f-ebd0-4f6b-8224-2877e5cfa27b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:11.767169 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-750ec55f-ebd0-4f6b-8224-2877e5cfa27b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:11.767607 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-750ec55f-ebd0-4f6b-8224-2877e5cfa27b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:11.833552 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-750ec55f-ebd0-4f6b-8224-2877e5cfa27b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:11.841007 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-750ec55f-ebd0-4f6b-8224-2877e5cfa27b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.084861 Jul 20 19:41:11.841584 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1174/1805] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:11 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:41:12.772636 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ffbf880f-95e1-4dc0-87d7-a140862bd2b0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:12.773322 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ffbf880f-95e1-4dc0-87d7-a140862bd2b0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:12.780681 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ffbf880f-95e1-4dc0-87d7-a140862bd2b0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:12.781135 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ffbf880f-95e1-4dc0-87d7-a140862bd2b0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:12.782101 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ffbf880f-95e1-4dc0-87d7-a140862bd2b0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:12.782565 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ffbf880f-95e1-4dc0-87d7-a140862bd2b0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:13.061665 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ffbf880f-95e1-4dc0-87d7-a140862bd2b0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:13.069772 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ffbf880f-95e1-4dc0-87d7-a140862bd2b0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.302126 Jul 20 19:41:13.070332 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1175/1806] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:12 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:41:13.074655 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-27c6f247-0ae3-480c-9835-aefbc8bc5841 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:13.075259 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-27c6f247-0ae3-480c-9835-aefbc8bc5841 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:13.080965 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-27c6f247-0ae3-480c-9835-aefbc8bc5841 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:13.081422 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-27c6f247-0ae3-480c-9835-aefbc8bc5841 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:13.082212 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-27c6f247-0ae3-480c-9835-aefbc8bc5841 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:13.082646 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-27c6f247-0ae3-480c-9835-aefbc8bc5841 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:13.142583 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-27c6f247-0ae3-480c-9835-aefbc8bc5841 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:13.149932 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-27c6f247-0ae3-480c-9835-aefbc8bc5841 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.078635 Jul 20 19:41:13.150477 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1176/1807] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:13 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:41:14.086662 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-29912b24-1556-4307-9645-052c88f5a579 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:14.087356 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-29912b24-1556-4307-9645-052c88f5a579 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:14.093910 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-29912b24-1556-4307-9645-052c88f5a579 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:14.094360 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-29912b24-1556-4307-9645-052c88f5a579 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:14.095119 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-29912b24-1556-4307-9645-052c88f5a579 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:14.095555 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-29912b24-1556-4307-9645-052c88f5a579 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:14.100078 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:41:14.227828 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-29912b24-1556-4307-9645-052c88f5a579 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:14.235186 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-29912b24-1556-4307-9645-052c88f5a579 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.152416 Jul 20 19:41:14.235740 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1177/1808] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:14 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:41:14.241061 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a32db8b4-86b3-4c67-a7a8-b1b08c1d7a25 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:14.241690 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a32db8b4-86b3-4c67-a7a8-b1b08c1d7a25 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:14.247467 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a32db8b4-86b3-4c67-a7a8-b1b08c1d7a25 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:14.247911 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a32db8b4-86b3-4c67-a7a8-b1b08c1d7a25 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:14.248660 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a32db8b4-86b3-4c67-a7a8-b1b08c1d7a25 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:14.249098 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a32db8b4-86b3-4c67-a7a8-b1b08c1d7a25 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:14.309395 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a32db8b4-86b3-4c67-a7a8-b1b08c1d7a25 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:14.317626 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a32db8b4-86b3-4c67-a7a8-b1b08c1d7a25 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080860 Jul 20 19:41:14.318703 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1178/1809] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:14 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:41:15.252397 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-f5605348-46eb-4005-9379-17c9c03ea1bd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:15.253176 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-f5605348-46eb-4005-9379-17c9c03ea1bd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:15.260483 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f5605348-46eb-4005-9379-17c9c03ea1bd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:15.260930 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f5605348-46eb-4005-9379-17c9c03ea1bd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:15.261719 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f5605348-46eb-4005-9379-17c9c03ea1bd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:15.262155 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f5605348-46eb-4005-9379-17c9c03ea1bd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:15.396523 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-f5605348-46eb-4005-9379-17c9c03ea1bd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:15.404229 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-f5605348-46eb-4005-9379-17c9c03ea1bd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.155613 Jul 20 19:41:15.404840 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1179/1810] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:15 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:41:15.409820 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-99263a88-abcb-4551-8749-201275c86f61 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:15.410431 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-99263a88-abcb-4551-8749-201275c86f61 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:15.416887 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-99263a88-abcb-4551-8749-201275c86f61 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:15.417338 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-99263a88-abcb-4551-8749-201275c86f61 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:15.418145 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-99263a88-abcb-4551-8749-201275c86f61 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:15.418583 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-99263a88-abcb-4551-8749-201275c86f61 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:15.495787 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-99263a88-abcb-4551-8749-201275c86f61 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:15.504462 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-99263a88-abcb-4551-8749-201275c86f61 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.098507 Jul 20 19:41:15.505059 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1180/1811] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:15 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:41:16.422554 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-727a0edd-2e93-44fe-960b-355fd243c8dd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:16.423208 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-727a0edd-2e93-44fe-960b-355fd243c8dd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:16.429945 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-727a0edd-2e93-44fe-960b-355fd243c8dd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:16.430419 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-727a0edd-2e93-44fe-960b-355fd243c8dd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:16.431183 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-727a0edd-2e93-44fe-960b-355fd243c8dd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:16.431622 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-727a0edd-2e93-44fe-960b-355fd243c8dd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:16.563298 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-727a0edd-2e93-44fe-960b-355fd243c8dd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:16.571527 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-727a0edd-2e93-44fe-960b-355fd243c8dd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.152813 Jul 20 19:41:16.572084 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1181/1812] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:16 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:41:16.576500 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d81ac2d6-0fa9-4c7c-a7d5-feffd1bcb62a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:16.577028 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d81ac2d6-0fa9-4c7c-a7d5-feffd1bcb62a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:16.582812 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d81ac2d6-0fa9-4c7c-a7d5-feffd1bcb62a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:16.583256 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d81ac2d6-0fa9-4c7c-a7d5-feffd1bcb62a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:16.584008 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d81ac2d6-0fa9-4c7c-a7d5-feffd1bcb62a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:16.584437 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d81ac2d6-0fa9-4c7c-a7d5-feffd1bcb62a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:16.645021 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d81ac2d6-0fa9-4c7c-a7d5-feffd1bcb62a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:16.652476 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d81ac2d6-0fa9-4c7c-a7d5-feffd1bcb62a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.079448 Jul 20 19:41:16.653073 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1182/1813] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:16 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:41:17.588501 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ea19610d-b3c0-4bcc-81c7-85d49630b923 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:17.589140 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ea19610d-b3c0-4bcc-81c7-85d49630b923 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:17.595527 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ea19610d-b3c0-4bcc-81c7-85d49630b923 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:17.596219 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ea19610d-b3c0-4bcc-81c7-85d49630b923 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:17.596963 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ea19610d-b3c0-4bcc-81c7-85d49630b923 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:17.597473 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ea19610d-b3c0-4bcc-81c7-85d49630b923 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:17.729910 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ea19610d-b3c0-4bcc-81c7-85d49630b923 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:17.738065 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ea19610d-b3c0-4bcc-81c7-85d49630b923 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.152749 Jul 20 19:41:17.738627 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1183/1814] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:17 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:41:17.743203 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-f05ccc5b-b155-419b-a428-41ade1d27c82 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:17.743789 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-f05ccc5b-b155-419b-a428-41ade1d27c82 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:17.749325 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f05ccc5b-b155-419b-a428-41ade1d27c82 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:17.749808 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f05ccc5b-b155-419b-a428-41ade1d27c82 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:17.750577 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f05ccc5b-b155-419b-a428-41ade1d27c82 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:17.751004 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f05ccc5b-b155-419b-a428-41ade1d27c82 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:17.811759 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-f05ccc5b-b155-419b-a428-41ade1d27c82 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:17.819319 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-f05ccc5b-b155-419b-a428-41ade1d27c82 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.079769 Jul 20 19:41:17.819869 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1184/1815] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:17 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:41:18.754874 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-23eb1325-3ccd-43eb-a0a2-67fb7766519f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:18.755635 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-23eb1325-3ccd-43eb-a0a2-67fb7766519f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:18.761962 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-23eb1325-3ccd-43eb-a0a2-67fb7766519f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:18.762411 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-23eb1325-3ccd-43eb-a0a2-67fb7766519f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:18.763169 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-23eb1325-3ccd-43eb-a0a2-67fb7766519f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:18.763603 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-23eb1325-3ccd-43eb-a0a2-67fb7766519f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:18.902046 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-23eb1325-3ccd-43eb-a0a2-67fb7766519f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:18.910290 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-23eb1325-3ccd-43eb-a0a2-67fb7766519f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.158501 Jul 20 19:41:18.910855 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1185/1816] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:18 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:41:18.915237 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-84b1171e-551c-4fa0-8e89-15745d76ac33 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:18.915839 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-84b1171e-551c-4fa0-8e89-15745d76ac33 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:18.921809 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-84b1171e-551c-4fa0-8e89-15745d76ac33 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:18.922260 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-84b1171e-551c-4fa0-8e89-15745d76ac33 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:18.923022 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-84b1171e-551c-4fa0-8e89-15745d76ac33 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:18.923462 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-84b1171e-551c-4fa0-8e89-15745d76ac33 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:18.987638 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-84b1171e-551c-4fa0-8e89-15745d76ac33 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:18.995072 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-84b1171e-551c-4fa0-8e89-15745d76ac33 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.083272 Jul 20 19:41:18.995632 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1186/1817] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:18 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:41:19.928078 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d4b9cfc4-3432-438b-93c6-95a8f20beb7a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:19.928751 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d4b9cfc4-3432-438b-93c6-95a8f20beb7a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:19.935294 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d4b9cfc4-3432-438b-93c6-95a8f20beb7a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:19.935737 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d4b9cfc4-3432-438b-93c6-95a8f20beb7a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:19.936481 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d4b9cfc4-3432-438b-93c6-95a8f20beb7a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:19.936919 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d4b9cfc4-3432-438b-93c6-95a8f20beb7a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:20.067083 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d4b9cfc4-3432-438b-93c6-95a8f20beb7a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:20.074507 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d4b9cfc4-3432-438b-93c6-95a8f20beb7a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.150923 Jul 20 19:41:20.075070 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1187/1818] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:19 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:41:20.079509 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-3ab123f2-1ade-41c1-aecb-281cbabd9f0a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:20.080108 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-3ab123f2-1ade-41c1-aecb-281cbabd9f0a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:20.085901 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3ab123f2-1ade-41c1-aecb-281cbabd9f0a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:20.086350 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3ab123f2-1ade-41c1-aecb-281cbabd9f0a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:20.087108 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3ab123f2-1ade-41c1-aecb-281cbabd9f0a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:20.087547 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3ab123f2-1ade-41c1-aecb-281cbabd9f0a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:20.148858 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3ab123f2-1ade-41c1-aecb-281cbabd9f0a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:20.156406 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-3ab123f2-1ade-41c1-aecb-281cbabd9f0a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080403 Jul 20 19:41:20.156965 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1188/1819] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:20 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:41:21.091922 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-1da0a871-2ebb-44e3-85e8-19697f991207 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:21.092600 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-1da0a871-2ebb-44e3-85e8-19697f991207 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:21.099473 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1da0a871-2ebb-44e3-85e8-19697f991207 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:21.099920 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1da0a871-2ebb-44e3-85e8-19697f991207 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:21.100681 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1da0a871-2ebb-44e3-85e8-19697f991207 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:21.101116 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1da0a871-2ebb-44e3-85e8-19697f991207 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:21.233684 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1da0a871-2ebb-44e3-85e8-19697f991207 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:21.241916 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-1da0a871-2ebb-44e3-85e8-19697f991207 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.153781 Jul 20 19:41:21.242484 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1189/1820] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:21 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:41:21.246875 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-41951a1c-15d0-418c-83f4-d632d2bb0df1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:21.247504 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-41951a1c-15d0-418c-83f4-d632d2bb0df1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:21.253830 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-41951a1c-15d0-418c-83f4-d632d2bb0df1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:21.254290 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-41951a1c-15d0-418c-83f4-d632d2bb0df1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:21.255048 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-41951a1c-15d0-418c-83f4-d632d2bb0df1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:21.255484 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-41951a1c-15d0-418c-83f4-d632d2bb0df1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:21.315021 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-41951a1c-15d0-418c-83f4-d632d2bb0df1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:21.323270 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-41951a1c-15d0-418c-83f4-d632d2bb0df1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.079765 Jul 20 19:41:21.324353 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1190/1821] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:21 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:41:22.259350 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4976d6d0-f28b-47c7-8572-f6157d425b06 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:22.260103 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-4976d6d0-f28b-47c7-8572-f6157d425b06 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:22.266477 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4976d6d0-f28b-47c7-8572-f6157d425b06 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:22.266924 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4976d6d0-f28b-47c7-8572-f6157d425b06 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:22.267683 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4976d6d0-f28b-47c7-8572-f6157d425b06 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:22.268117 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4976d6d0-f28b-47c7-8572-f6157d425b06 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:22.398219 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-4976d6d0-f28b-47c7-8572-f6157d425b06 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:22.405639 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-4976d6d0-f28b-47c7-8572-f6157d425b06 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.150141 Jul 20 19:41:22.406196 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1191/1822] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:22 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:41:22.411076 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-60b07836-60bf-4f8c-b721-4ab3774370e5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:22.411677 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-60b07836-60bf-4f8c-b721-4ab3774370e5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:22.417318 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-60b07836-60bf-4f8c-b721-4ab3774370e5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:22.417796 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-60b07836-60bf-4f8c-b721-4ab3774370e5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:22.418556 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-60b07836-60bf-4f8c-b721-4ab3774370e5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:22.418999 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-60b07836-60bf-4f8c-b721-4ab3774370e5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:22.483112 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-60b07836-60bf-4f8c-b721-4ab3774370e5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:22.491206 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-60b07836-60bf-4f8c-b721-4ab3774370e5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.084067 Jul 20 19:41:22.491762 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1192/1823] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:22 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:41:23.423326 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-83dbbe9a-d47e-41f7-954a-ab8a69347c2e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:23.423966 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-83dbbe9a-d47e-41f7-954a-ab8a69347c2e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:23.431284 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-83dbbe9a-d47e-41f7-954a-ab8a69347c2e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:23.431730 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-83dbbe9a-d47e-41f7-954a-ab8a69347c2e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:23.432484 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-83dbbe9a-d47e-41f7-954a-ab8a69347c2e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:23.432920 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-83dbbe9a-d47e-41f7-954a-ab8a69347c2e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:23.563709 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-83dbbe9a-d47e-41f7-954a-ab8a69347c2e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:23.566698 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:41:23.573166 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-83dbbe9a-d47e-41f7-954a-ab8a69347c2e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.153776 Jul 20 19:41:23.573821 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1193/1824] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:23 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:41:23.578284 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-88226150-c776-4159-b0bf-4494f81624fb tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:23.578910 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-88226150-c776-4159-b0bf-4494f81624fb tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:23.584855 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-88226150-c776-4159-b0bf-4494f81624fb tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:23.585297 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-88226150-c776-4159-b0bf-4494f81624fb tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:23.586074 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-88226150-c776-4159-b0bf-4494f81624fb tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:23.586504 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-88226150-c776-4159-b0bf-4494f81624fb tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:23.647607 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-88226150-c776-4159-b0bf-4494f81624fb tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:23.655140 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-88226150-c776-4159-b0bf-4494f81624fb tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080414 Jul 20 19:41:23.655701 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1194/1825] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:23 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:41:24.590300 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-1cd92dda-578c-438a-8537-d5253e71ced8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:24.590968 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-1cd92dda-578c-438a-8537-d5253e71ced8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:24.599416 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1cd92dda-578c-438a-8537-d5253e71ced8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:24.599863 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1cd92dda-578c-438a-8537-d5253e71ced8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:24.600621 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1cd92dda-578c-438a-8537-d5253e71ced8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:24.601047 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1cd92dda-578c-438a-8537-d5253e71ced8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:24.759565 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1cd92dda-578c-438a-8537-d5253e71ced8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:24.767060 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-1cd92dda-578c-438a-8537-d5253e71ced8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.180661 Jul 20 19:41:24.767621 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1195/1826] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:24 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:41:24.772949 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c5034f8e-be2e-4fec-b12d-3497995efa24 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:24.773575 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c5034f8e-be2e-4fec-b12d-3497995efa24 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:24.779989 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c5034f8e-be2e-4fec-b12d-3497995efa24 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:24.780442 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c5034f8e-be2e-4fec-b12d-3497995efa24 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:24.781203 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c5034f8e-be2e-4fec-b12d-3497995efa24 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:24.781671 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c5034f8e-be2e-4fec-b12d-3497995efa24 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:24.849463 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c5034f8e-be2e-4fec-b12d-3497995efa24 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:24.857054 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c5034f8e-be2e-4fec-b12d-3497995efa24 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.088467 Jul 20 19:41:24.857642 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1196/1827] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:24 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:41:25.785885 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4df1d206-3f9a-4d3f-9458-d8fb4cca1959 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:25.786563 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-4df1d206-3f9a-4d3f-9458-d8fb4cca1959 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:25.793004 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4df1d206-3f9a-4d3f-9458-d8fb4cca1959 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:25.793454 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4df1d206-3f9a-4d3f-9458-d8fb4cca1959 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:25.794242 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4df1d206-3f9a-4d3f-9458-d8fb4cca1959 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:25.794683 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4df1d206-3f9a-4d3f-9458-d8fb4cca1959 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:25.930523 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-4df1d206-3f9a-4d3f-9458-d8fb4cca1959 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:25.938417 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-4df1d206-3f9a-4d3f-9458-d8fb4cca1959 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.156970 Jul 20 19:41:25.938980 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1197/1828] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:25 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:41:25.943705 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-8dbc6165-42d3-410b-9b18-d6fdedbdb48e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:25.944307 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-8dbc6165-42d3-410b-9b18-d6fdedbdb48e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:25.950267 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8dbc6165-42d3-410b-9b18-d6fdedbdb48e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:25.950705 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8dbc6165-42d3-410b-9b18-d6fdedbdb48e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:25.951450 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8dbc6165-42d3-410b-9b18-d6fdedbdb48e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:25.951873 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8dbc6165-42d3-410b-9b18-d6fdedbdb48e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:26.017878 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8dbc6165-42d3-410b-9b18-d6fdedbdb48e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:26.025372 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-8dbc6165-42d3-410b-9b18-d6fdedbdb48e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.085473 Jul 20 19:41:26.025951 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1198/1829] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:25 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:41:26.955512 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ab9fa7d4-479d-48ce-916c-6d2c0f51a432 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:26.956463 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ab9fa7d4-479d-48ce-916c-6d2c0f51a432 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:26.963065 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ab9fa7d4-479d-48ce-916c-6d2c0f51a432 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:26.963507 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ab9fa7d4-479d-48ce-916c-6d2c0f51a432 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:26.964261 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ab9fa7d4-479d-48ce-916c-6d2c0f51a432 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:26.964717 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ab9fa7d4-479d-48ce-916c-6d2c0f51a432 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:27.097106 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ab9fa7d4-479d-48ce-916c-6d2c0f51a432 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:27.104662 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ab9fa7d4-479d-48ce-916c-6d2c0f51a432 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.153270 Jul 20 19:41:27.105215 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1199/1830] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:26 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:41:27.110026 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-21863933-0619-4b14-b672-1b1801b5f578 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:27.110662 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-21863933-0619-4b14-b672-1b1801b5f578 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:27.117398 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-21863933-0619-4b14-b672-1b1801b5f578 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:27.117864 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-21863933-0619-4b14-b672-1b1801b5f578 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:27.118624 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-21863933-0619-4b14-b672-1b1801b5f578 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:27.119050 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-21863933-0619-4b14-b672-1b1801b5f578 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:27.181494 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-21863933-0619-4b14-b672-1b1801b5f578 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:27.189735 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-21863933-0619-4b14-b672-1b1801b5f578 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.083339 Jul 20 19:41:27.190479 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1200/1831] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:27 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:41:28.121795 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4350e1dc-206c-42ce-8696-904cb723c31a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:28.122664 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-4350e1dc-206c-42ce-8696-904cb723c31a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:28.129499 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4350e1dc-206c-42ce-8696-904cb723c31a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:28.129959 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4350e1dc-206c-42ce-8696-904cb723c31a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:28.130701 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4350e1dc-206c-42ce-8696-904cb723c31a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:28.131125 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4350e1dc-206c-42ce-8696-904cb723c31a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:28.266366 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-4350e1dc-206c-42ce-8696-904cb723c31a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:28.274789 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-4350e1dc-206c-42ce-8696-904cb723c31a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.156898 Jul 20 19:41:28.275352 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1201/1832] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:28 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:41:28.279702 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-851e2184-4a47-4141-ace9-b7655f652b87 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:28.280298 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-851e2184-4a47-4141-ace9-b7655f652b87 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:28.285891 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-851e2184-4a47-4141-ace9-b7655f652b87 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:28.286340 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-851e2184-4a47-4141-ace9-b7655f652b87 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:28.287095 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-851e2184-4a47-4141-ace9-b7655f652b87 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:28.287522 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-851e2184-4a47-4141-ace9-b7655f652b87 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:28.349009 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-851e2184-4a47-4141-ace9-b7655f652b87 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:28.356669 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-851e2184-4a47-4141-ace9-b7655f652b87 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080338 Jul 20 19:41:28.357239 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1202/1833] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:28 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:41:29.291942 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-aedeb1ce-20b8-4e23-b76a-2b29d2014b68 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:29.292637 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-aedeb1ce-20b8-4e23-b76a-2b29d2014b68 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:29.299058 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aedeb1ce-20b8-4e23-b76a-2b29d2014b68 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:29.299566 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aedeb1ce-20b8-4e23-b76a-2b29d2014b68 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:29.300442 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aedeb1ce-20b8-4e23-b76a-2b29d2014b68 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:29.300877 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aedeb1ce-20b8-4e23-b76a-2b29d2014b68 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:29.430214 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-aedeb1ce-20b8-4e23-b76a-2b29d2014b68 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:29.437467 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-aedeb1ce-20b8-4e23-b76a-2b29d2014b68 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.149431 Jul 20 19:41:29.438048 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1203/1834] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:29 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:41:29.443212 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e792f1c6-c115-4a22-a98f-a49effcf9347 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:29.443806 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e792f1c6-c115-4a22-a98f-a49effcf9347 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:29.450420 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e792f1c6-c115-4a22-a98f-a49effcf9347 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:29.450860 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e792f1c6-c115-4a22-a98f-a49effcf9347 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:29.451734 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e792f1c6-c115-4a22-a98f-a49effcf9347 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:29.452165 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e792f1c6-c115-4a22-a98f-a49effcf9347 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:29.519987 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e792f1c6-c115-4a22-a98f-a49effcf9347 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:29.527481 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e792f1c6-c115-4a22-a98f-a49effcf9347 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.088500 Jul 20 19:41:29.528040 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1204/1835] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:29 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:41:30.455346 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e283fe5a-eb5d-4f16-810f-85098fce2f1e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:30.456754 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e283fe5a-eb5d-4f16-810f-85098fce2f1e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:30.464394 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e283fe5a-eb5d-4f16-810f-85098fce2f1e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:30.464847 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e283fe5a-eb5d-4f16-810f-85098fce2f1e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:30.465632 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e283fe5a-eb5d-4f16-810f-85098fce2f1e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:30.466065 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e283fe5a-eb5d-4f16-810f-85098fce2f1e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:30.597698 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e283fe5a-eb5d-4f16-810f-85098fce2f1e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:30.605104 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e283fe5a-eb5d-4f16-810f-85098fce2f1e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.153579 Jul 20 19:41:30.605689 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1205/1836] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:30 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:41:30.610012 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-3f135e41-5273-4b1d-9cc7-ab1728ea9afc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:30.610616 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-3f135e41-5273-4b1d-9cc7-ab1728ea9afc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:30.616925 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3f135e41-5273-4b1d-9cc7-ab1728ea9afc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:30.617379 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3f135e41-5273-4b1d-9cc7-ab1728ea9afc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:30.618173 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3f135e41-5273-4b1d-9cc7-ab1728ea9afc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:30.618609 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3f135e41-5273-4b1d-9cc7-ab1728ea9afc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:30.681437 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3f135e41-5273-4b1d-9cc7-ab1728ea9afc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:30.688899 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-3f135e41-5273-4b1d-9cc7-ab1728ea9afc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.082264 Jul 20 19:41:30.689491 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1206/1837] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:30 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:41:31.622459 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-b98e12e1-5f35-4731-a93e-c67b855b94c1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:31.623116 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-b98e12e1-5f35-4731-a93e-c67b855b94c1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:31.629643 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b98e12e1-5f35-4731-a93e-c67b855b94c1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:31.630091 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b98e12e1-5f35-4731-a93e-c67b855b94c1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:31.630910 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b98e12e1-5f35-4731-a93e-c67b855b94c1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:31.631298 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b98e12e1-5f35-4731-a93e-c67b855b94c1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:31.764570 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-b98e12e1-5f35-4731-a93e-c67b855b94c1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:31.772994 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-b98e12e1-5f35-4731-a93e-c67b855b94c1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.154468 Jul 20 19:41:31.773573 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1207/1838] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:31 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:41:31.777889 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-651745d2-c7a5-4b3c-88ee-12fd8a7c5a72 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:31.778474 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-651745d2-c7a5-4b3c-88ee-12fd8a7c5a72 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:31.784805 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-651745d2-c7a5-4b3c-88ee-12fd8a7c5a72 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:31.785437 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-651745d2-c7a5-4b3c-88ee-12fd8a7c5a72 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:31.786211 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-651745d2-c7a5-4b3c-88ee-12fd8a7c5a72 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:31.786659 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-651745d2-c7a5-4b3c-88ee-12fd8a7c5a72 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:31.847163 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-651745d2-c7a5-4b3c-88ee-12fd8a7c5a72 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:31.854759 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-651745d2-c7a5-4b3c-88ee-12fd8a7c5a72 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080235 Jul 20 19:41:31.855318 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1208/1839] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:31 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:41:32.790457 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-5d6f456e-c12e-475c-98ca-68f862bab0f4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:32.791188 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-5d6f456e-c12e-475c-98ca-68f862bab0f4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:32.797782 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5d6f456e-c12e-475c-98ca-68f862bab0f4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:32.798237 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5d6f456e-c12e-475c-98ca-68f862bab0f4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:32.799007 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5d6f456e-c12e-475c-98ca-68f862bab0f4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:32.799514 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5d6f456e-c12e-475c-98ca-68f862bab0f4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:32.932248 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-5d6f456e-c12e-475c-98ca-68f862bab0f4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:32.939680 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-5d6f456e-c12e-475c-98ca-68f862bab0f4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.153385 Jul 20 19:41:32.940776 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1209/1840] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:32 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:41:32.945272 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-31f2f2f1-ea3f-41e8-8e66-fe8a38cc5e8d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:32.946033 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-31f2f2f1-ea3f-41e8-8e66-fe8a38cc5e8d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:32.952351 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-31f2f2f1-ea3f-41e8-8e66-fe8a38cc5e8d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:32.952782 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-31f2f2f1-ea3f-41e8-8e66-fe8a38cc5e8d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:32.953571 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-31f2f2f1-ea3f-41e8-8e66-fe8a38cc5e8d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:32.954006 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-31f2f2f1-ea3f-41e8-8e66-fe8a38cc5e8d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:32.970710 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:41:33.022930 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-31f2f2f1-ea3f-41e8-8e66-fe8a38cc5e8d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:33.032432 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-31f2f2f1-ea3f-41e8-8e66-fe8a38cc5e8d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.090664 Jul 20 19:41:33.033009 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1210/1841] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:32 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:41:33.959224 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-0087abda-b594-41e2-a00e-2946ce5ef957 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:33.959938 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-0087abda-b594-41e2-a00e-2946ce5ef957 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:33.965813 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0087abda-b594-41e2-a00e-2946ce5ef957 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:33.966258 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0087abda-b594-41e2-a00e-2946ce5ef957 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:33.967007 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0087abda-b594-41e2-a00e-2946ce5ef957 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:33.967434 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0087abda-b594-41e2-a00e-2946ce5ef957 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:34.102866 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0087abda-b594-41e2-a00e-2946ce5ef957 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:34.110405 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-0087abda-b594-41e2-a00e-2946ce5ef957 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.155939 Jul 20 19:41:34.110968 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1211/1842] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:33 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:41:34.115571 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-8967f4db-22ca-4d18-837e-4f3f6f68f134 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:34.116175 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-8967f4db-22ca-4d18-837e-4f3f6f68f134 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:34.121942 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8967f4db-22ca-4d18-837e-4f3f6f68f134 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:34.122391 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8967f4db-22ca-4d18-837e-4f3f6f68f134 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:34.123150 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8967f4db-22ca-4d18-837e-4f3f6f68f134 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:34.123583 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8967f4db-22ca-4d18-837e-4f3f6f68f134 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:34.184291 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8967f4db-22ca-4d18-837e-4f3f6f68f134 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:34.192617 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-8967f4db-22ca-4d18-837e-4f3f6f68f134 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080684 Jul 20 19:41:34.193178 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1212/1843] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:34 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:41:35.128111 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-da77d498-9b02-46d6-afbc-ef89006b6666 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:35.128883 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-da77d498-9b02-46d6-afbc-ef89006b6666 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:35.135296 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-da77d498-9b02-46d6-afbc-ef89006b6666 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:35.135744 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-da77d498-9b02-46d6-afbc-ef89006b6666 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:35.136508 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-da77d498-9b02-46d6-afbc-ef89006b6666 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:35.136943 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-da77d498-9b02-46d6-afbc-ef89006b6666 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:35.273878 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-da77d498-9b02-46d6-afbc-ef89006b6666 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:35.281383 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-da77d498-9b02-46d6-afbc-ef89006b6666 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.157707 Jul 20 19:41:35.281971 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1213/1844] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:35 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:41:35.286684 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-2dd634b9-0866-42cb-898d-608d95beecdf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:35.287289 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-2dd634b9-0866-42cb-898d-608d95beecdf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:35.293116 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2dd634b9-0866-42cb-898d-608d95beecdf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:35.293600 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2dd634b9-0866-42cb-898d-608d95beecdf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:35.294371 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2dd634b9-0866-42cb-898d-608d95beecdf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:35.294808 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2dd634b9-0866-42cb-898d-608d95beecdf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:35.357121 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-2dd634b9-0866-42cb-898d-608d95beecdf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:35.365301 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-2dd634b9-0866-42cb-898d-608d95beecdf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.082374 Jul 20 19:41:35.365900 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1214/1845] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:35 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:41:36.298750 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-05c31d71-0243-44ac-873a-04de6313b0ba tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:36.299437 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-05c31d71-0243-44ac-873a-04de6313b0ba tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:36.306021 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-05c31d71-0243-44ac-873a-04de6313b0ba tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:36.306464 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-05c31d71-0243-44ac-873a-04de6313b0ba tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:36.307210 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-05c31d71-0243-44ac-873a-04de6313b0ba tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:36.307636 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-05c31d71-0243-44ac-873a-04de6313b0ba tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:36.444763 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-05c31d71-0243-44ac-873a-04de6313b0ba tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:36.452394 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-05c31d71-0243-44ac-873a-04de6313b0ba tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.157478 Jul 20 19:41:36.453036 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1215/1846] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:36 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:41:36.459582 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-9bd38f36-25e0-409d-b71a-21b92d7b693c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:36.459782 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-9bd38f36-25e0-409d-b71a-21b92d7b693c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:36.461456 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_api:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:41:36.467616 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9bd38f36-25e0-409d-b71a-21b92d7b693c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:36.468067 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9bd38f36-25e0-409d-b71a-21b92d7b693c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:36.468845 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9bd38f36-25e0-409d-b71a-21b92d7b693c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:36.469280 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9bd38f36-25e0-409d-b71a-21b92d7b693c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:36.536460 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-9bd38f36-25e0-409d-b71a-21b92d7b693c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:36.545831 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-9bd38f36-25e0-409d-b71a-21b92d7b693c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.091712 Jul 20 19:41:36.546411 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1216/1847] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:36 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:41:37.472036 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d8c7a455-0173-4480-9ee2-ba9848e07b9d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:37.472753 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d8c7a455-0173-4480-9ee2-ba9848e07b9d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:37.479303 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d8c7a455-0173-4480-9ee2-ba9848e07b9d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:37.479756 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d8c7a455-0173-4480-9ee2-ba9848e07b9d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:37.480526 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d8c7a455-0173-4480-9ee2-ba9848e07b9d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:37.480963 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d8c7a455-0173-4480-9ee2-ba9848e07b9d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:37.611176 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d8c7a455-0173-4480-9ee2-ba9848e07b9d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:37.618880 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d8c7a455-0173-4480-9ee2-ba9848e07b9d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.151670 Jul 20 19:41:37.619458 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1217/1848] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:37 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:41:37.623893 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-9144cc00-3f7d-4fe4-b130-3afcf2d33b96 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:37.624489 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-9144cc00-3f7d-4fe4-b130-3afcf2d33b96 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:37.630644 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9144cc00-3f7d-4fe4-b130-3afcf2d33b96 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:37.631096 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9144cc00-3f7d-4fe4-b130-3afcf2d33b96 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:37.631861 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9144cc00-3f7d-4fe4-b130-3afcf2d33b96 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:37.632300 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9144cc00-3f7d-4fe4-b130-3afcf2d33b96 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:37.693721 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-9144cc00-3f7d-4fe4-b130-3afcf2d33b96 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:37.701243 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-9144cc00-3f7d-4fe4-b130-3afcf2d33b96 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080836 Jul 20 19:41:37.701835 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1218/1849] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:37 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:41:38.639464 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-178da220-3f74-4447-952c-6b6c6a7720a3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:38.640338 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-178da220-3f74-4447-952c-6b6c6a7720a3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:38.647247 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-178da220-3f74-4447-952c-6b6c6a7720a3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:38.647695 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-178da220-3f74-4447-952c-6b6c6a7720a3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:38.648447 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-178da220-3f74-4447-952c-6b6c6a7720a3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:38.648878 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-178da220-3f74-4447-952c-6b6c6a7720a3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:38.789932 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-178da220-3f74-4447-952c-6b6c6a7720a3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:38.802966 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-178da220-3f74-4447-952c-6b6c6a7720a3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.170396 Jul 20 19:41:38.803542 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1219/1850] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:38 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:41:38.807992 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-7a2e8973-9e4f-4b9f-882e-45a0ee639477 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:38.808584 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-7a2e8973-9e4f-4b9f-882e-45a0ee639477 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:38.814794 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7a2e8973-9e4f-4b9f-882e-45a0ee639477 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:38.815243 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7a2e8973-9e4f-4b9f-882e-45a0ee639477 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:38.816004 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7a2e8973-9e4f-4b9f-882e-45a0ee639477 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:38.816465 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7a2e8973-9e4f-4b9f-882e-45a0ee639477 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:38.880102 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-7a2e8973-9e4f-4b9f-882e-45a0ee639477 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:38.887535 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-7a2e8973-9e4f-4b9f-882e-45a0ee639477 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.083034 Jul 20 19:41:38.888091 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1220/1851] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:38 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:41:39.821137 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-aecf7f23-128f-4791-adb1-5ed076ec7856 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:39.821842 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-aecf7f23-128f-4791-adb1-5ed076ec7856 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:39.828269 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aecf7f23-128f-4791-adb1-5ed076ec7856 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:39.828711 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aecf7f23-128f-4791-adb1-5ed076ec7856 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:39.829464 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aecf7f23-128f-4791-adb1-5ed076ec7856 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:39.829913 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aecf7f23-128f-4791-adb1-5ed076ec7856 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:39.960804 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-aecf7f23-128f-4791-adb1-5ed076ec7856 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:39.968323 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-aecf7f23-128f-4791-adb1-5ed076ec7856 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.151020 Jul 20 19:41:39.969130 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1221/1852] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:39 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:41:39.973756 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-36feb43a-3ec6-4083-b59f-d0c26930a0d7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:39.974375 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-36feb43a-3ec6-4083-b59f-d0c26930a0d7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:39.980501 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-36feb43a-3ec6-4083-b59f-d0c26930a0d7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:39.980940 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-36feb43a-3ec6-4083-b59f-d0c26930a0d7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:39.981724 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-36feb43a-3ec6-4083-b59f-d0c26930a0d7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:39.982147 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-36feb43a-3ec6-4083-b59f-d0c26930a0d7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:40.048892 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-36feb43a-3ec6-4083-b59f-d0c26930a0d7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:40.056986 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-36feb43a-3ec6-4083-b59f-d0c26930a0d7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.087048 Jul 20 19:41:40.057592 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1222/1853] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:39 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:41:40.987262 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e22724c7-cfbc-4b8e-842c-fc008412d50f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:40.987888 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e22724c7-cfbc-4b8e-842c-fc008412d50f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:40.995038 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e22724c7-cfbc-4b8e-842c-fc008412d50f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:40.995487 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e22724c7-cfbc-4b8e-842c-fc008412d50f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:40.996247 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e22724c7-cfbc-4b8e-842c-fc008412d50f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:40.996747 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e22724c7-cfbc-4b8e-842c-fc008412d50f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:41.135661 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e22724c7-cfbc-4b8e-842c-fc008412d50f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:41.143869 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e22724c7-cfbc-4b8e-842c-fc008412d50f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.160213 Jul 20 19:41:41.144438 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1223/1854] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:40 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:41:41.148907 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-130320ab-6178-4194-91cb-4375390c3de5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:41.149584 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-130320ab-6178-4194-91cb-4375390c3de5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:41.164874 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-130320ab-6178-4194-91cb-4375390c3de5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:41.165356 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-130320ab-6178-4194-91cb-4375390c3de5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:41.166125 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-130320ab-6178-4194-91cb-4375390c3de5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:41.166640 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-130320ab-6178-4194-91cb-4375390c3de5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:41.232107 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-130320ab-6178-4194-91cb-4375390c3de5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:41.241256 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-130320ab-6178-4194-91cb-4375390c3de5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.095774 Jul 20 19:41:41.241964 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1224/1855] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:41 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:41:42.162886 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-5f290976-af5f-45a0-886a-790c458eda4e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:42.163573 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-5f290976-af5f-45a0-886a-790c458eda4e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:42.170354 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5f290976-af5f-45a0-886a-790c458eda4e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:42.171720 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5f290976-af5f-45a0-886a-790c458eda4e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:42.172149 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5f290976-af5f-45a0-886a-790c458eda4e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:42.173220 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5f290976-af5f-45a0-886a-790c458eda4e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:42.314029 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-5f290976-af5f-45a0-886a-790c458eda4e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:42.322492 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-5f290976-af5f-45a0-886a-790c458eda4e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.164656 Jul 20 19:41:42.323074 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1225/1856] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:42 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:41:42.327610 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d4a11a0b-8824-46a2-94e8-b85af59b7dce tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:42.328213 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d4a11a0b-8824-46a2-94e8-b85af59b7dce tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:42.334874 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d4a11a0b-8824-46a2-94e8-b85af59b7dce tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:42.335318 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d4a11a0b-8824-46a2-94e8-b85af59b7dce tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:42.336086 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d4a11a0b-8824-46a2-94e8-b85af59b7dce tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:42.336518 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d4a11a0b-8824-46a2-94e8-b85af59b7dce tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:42.398957 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d4a11a0b-8824-46a2-94e8-b85af59b7dce tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:42.406380 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d4a11a0b-8824-46a2-94e8-b85af59b7dce tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.082357 Jul 20 19:41:42.406920 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1226/1857] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:42 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:41:43.340710 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c909fe28-fb70-4283-aee8-f5fc5974cc8a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:43.341311 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c909fe28-fb70-4283-aee8-f5fc5974cc8a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:43.348192 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c909fe28-fb70-4283-aee8-f5fc5974cc8a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:43.348637 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c909fe28-fb70-4283-aee8-f5fc5974cc8a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:43.349394 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c909fe28-fb70-4283-aee8-f5fc5974cc8a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:43.349860 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c909fe28-fb70-4283-aee8-f5fc5974cc8a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:43.352410 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:41:43.481379 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c909fe28-fb70-4283-aee8-f5fc5974cc8a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:43.489579 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c909fe28-fb70-4283-aee8-f5fc5974cc8a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.152718 Jul 20 19:41:43.490150 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1227/1858] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:43 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:41:43.494714 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-afbcb8c9-3bb9-4dc7-923b-dfdee14fc926 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:43.495320 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-afbcb8c9-3bb9-4dc7-923b-dfdee14fc926 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:43.501167 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-afbcb8c9-3bb9-4dc7-923b-dfdee14fc926 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:43.501654 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-afbcb8c9-3bb9-4dc7-923b-dfdee14fc926 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:43.503351 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-afbcb8c9-3bb9-4dc7-923b-dfdee14fc926 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:43.503786 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-afbcb8c9-3bb9-4dc7-923b-dfdee14fc926 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:43.814042 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-afbcb8c9-3bb9-4dc7-923b-dfdee14fc926 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:43.822991 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-afbcb8c9-3bb9-4dc7-923b-dfdee14fc926 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.331858 Jul 20 19:41:43.823563 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1228/1859] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:43 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:41:44.507781 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-87e15ceb-e2aa-4b45-8963-f784da25553b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:44.508479 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-87e15ceb-e2aa-4b45-8963-f784da25553b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:44.514877 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-87e15ceb-e2aa-4b45-8963-f784da25553b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:44.515321 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-87e15ceb-e2aa-4b45-8963-f784da25553b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:44.516071 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-87e15ceb-e2aa-4b45-8963-f784da25553b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:44.516497 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-87e15ceb-e2aa-4b45-8963-f784da25553b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:44.654233 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-87e15ceb-e2aa-4b45-8963-f784da25553b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:44.662735 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-87e15ceb-e2aa-4b45-8963-f784da25553b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.159157 Jul 20 19:41:44.663697 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1229/1860] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:44 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:41:44.840686 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-1592e989-fd7c-48e9-9b15-4007681a4922 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:44.841303 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-1592e989-fd7c-48e9-9b15-4007681a4922 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:44.848180 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1592e989-fd7c-48e9-9b15-4007681a4922 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:44.848557 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1592e989-fd7c-48e9-9b15-4007681a4922 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:44.849309 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1592e989-fd7c-48e9-9b15-4007681a4922 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:44.849794 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1592e989-fd7c-48e9-9b15-4007681a4922 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:44.910925 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1592e989-fd7c-48e9-9b15-4007681a4922 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:44.918301 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-1592e989-fd7c-48e9-9b15-4007681a4922 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.081553 Jul 20 19:41:44.918863 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1230/1861] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:44 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:41:45.679853 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ea155830-3a0e-4ade-93bc-35497e841bcc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:45.680526 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ea155830-3a0e-4ade-93bc-35497e841bcc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:45.686896 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ea155830-3a0e-4ade-93bc-35497e841bcc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:45.687335 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ea155830-3a0e-4ade-93bc-35497e841bcc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:45.688084 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ea155830-3a0e-4ade-93bc-35497e841bcc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:45.688521 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ea155830-3a0e-4ade-93bc-35497e841bcc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:45.826948 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ea155830-3a0e-4ade-93bc-35497e841bcc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:45.835064 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ea155830-3a0e-4ade-93bc-35497e841bcc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.159037 Jul 20 19:41:45.835632 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1231/1862] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:45 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:41:45.935604 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-84e0e6bc-50ec-4df1-b0c7-e8233b601665 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:45.936102 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-84e0e6bc-50ec-4df1-b0c7-e8233b601665 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:45.943488 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-84e0e6bc-50ec-4df1-b0c7-e8233b601665 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:45.943934 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-84e0e6bc-50ec-4df1-b0c7-e8233b601665 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:45.944693 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-84e0e6bc-50ec-4df1-b0c7-e8233b601665 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:45.945150 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-84e0e6bc-50ec-4df1-b0c7-e8233b601665 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:46.008557 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-84e0e6bc-50ec-4df1-b0c7-e8233b601665 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:46.016413 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-84e0e6bc-50ec-4df1-b0c7-e8233b601665 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.084782 Jul 20 19:41:46.016976 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1232/1863] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:45 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:41:46.852907 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-9fcf49df-8f59-4a0d-9981-a61a7d17ec04 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:46.853587 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-9fcf49df-8f59-4a0d-9981-a61a7d17ec04 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:46.859907 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9fcf49df-8f59-4a0d-9981-a61a7d17ec04 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:46.860344 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9fcf49df-8f59-4a0d-9981-a61a7d17ec04 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:46.861091 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9fcf49df-8f59-4a0d-9981-a61a7d17ec04 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:46.861634 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9fcf49df-8f59-4a0d-9981-a61a7d17ec04 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:46.995185 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-9fcf49df-8f59-4a0d-9981-a61a7d17ec04 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:47.002726 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-9fcf49df-8f59-4a0d-9981-a61a7d17ec04 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.153659 Jul 20 19:41:47.003289 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1233/1864] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:46 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:41:47.034379 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-bf8ec4aa-81c5-4cf9-80a1-b6f3f8112783 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:47.035034 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-bf8ec4aa-81c5-4cf9-80a1-b6f3f8112783 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:47.040977 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bf8ec4aa-81c5-4cf9-80a1-b6f3f8112783 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:47.041425 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bf8ec4aa-81c5-4cf9-80a1-b6f3f8112783 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:47.042206 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bf8ec4aa-81c5-4cf9-80a1-b6f3f8112783 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:47.042647 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bf8ec4aa-81c5-4cf9-80a1-b6f3f8112783 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:47.107151 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-bf8ec4aa-81c5-4cf9-80a1-b6f3f8112783 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:47.115656 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-bf8ec4aa-81c5-4cf9-80a1-b6f3f8112783 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.085733 Jul 20 19:41:47.116225 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1234/1865] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:47 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:41:48.020440 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4e90242b-58ec-4e83-8b4f-6876c1b7f018 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:48.021145 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-4e90242b-58ec-4e83-8b4f-6876c1b7f018 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:48.027704 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4e90242b-58ec-4e83-8b4f-6876c1b7f018 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:48.028152 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4e90242b-58ec-4e83-8b4f-6876c1b7f018 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:48.028929 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4e90242b-58ec-4e83-8b4f-6876c1b7f018 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:48.029363 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4e90242b-58ec-4e83-8b4f-6876c1b7f018 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:48.209175 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-4e90242b-58ec-4e83-8b4f-6876c1b7f018 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:48.217052 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-4e90242b-58ec-4e83-8b4f-6876c1b7f018 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.200922 Jul 20 19:41:48.217769 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1235/1866] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:48 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:41:48.222953 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-3590d0ed-a985-4141-8301-b66fd4d2a42b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:48.223774 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-3590d0ed-a985-4141-8301-b66fd4d2a42b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:48.229946 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3590d0ed-a985-4141-8301-b66fd4d2a42b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:48.230425 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3590d0ed-a985-4141-8301-b66fd4d2a42b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:48.231208 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3590d0ed-a985-4141-8301-b66fd4d2a42b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:48.231649 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3590d0ed-a985-4141-8301-b66fd4d2a42b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:48.319595 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3590d0ed-a985-4141-8301-b66fd4d2a42b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:48.327675 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-3590d0ed-a985-4141-8301-b66fd4d2a42b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.108877 Jul 20 19:41:48.328250 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1236/1867] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:48 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:41:49.234664 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-fefa1aa0-d61c-4a9a-917a-6aa971a94f67 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:49.235352 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-fefa1aa0-d61c-4a9a-917a-6aa971a94f67 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:49.241938 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fefa1aa0-d61c-4a9a-917a-6aa971a94f67 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:49.242382 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fefa1aa0-d61c-4a9a-917a-6aa971a94f67 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:49.243135 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fefa1aa0-d61c-4a9a-917a-6aa971a94f67 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:49.243573 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fefa1aa0-d61c-4a9a-917a-6aa971a94f67 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:49.374970 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-fefa1aa0-d61c-4a9a-917a-6aa971a94f67 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:49.383003 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-fefa1aa0-d61c-4a9a-917a-6aa971a94f67 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.152235 Jul 20 19:41:49.383589 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1237/1868] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:49 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:41:49.388026 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d463066b-1533-4089-ab81-dfa15c1dca17 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:49.388622 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d463066b-1533-4089-ab81-dfa15c1dca17 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:49.395661 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d463066b-1533-4089-ab81-dfa15c1dca17 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:49.396099 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d463066b-1533-4089-ab81-dfa15c1dca17 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:49.396850 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d463066b-1533-4089-ab81-dfa15c1dca17 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:49.397274 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d463066b-1533-4089-ab81-dfa15c1dca17 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:49.457863 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d463066b-1533-4089-ab81-dfa15c1dca17 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:49.465420 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d463066b-1533-4089-ab81-dfa15c1dca17 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080880 Jul 20 19:41:49.466018 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1238/1869] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:49 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:41:50.399950 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d48a0863-0437-4b26-b22c-81e1625e9081 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:50.400628 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d48a0863-0437-4b26-b22c-81e1625e9081 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:50.407042 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d48a0863-0437-4b26-b22c-81e1625e9081 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:50.407492 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d48a0863-0437-4b26-b22c-81e1625e9081 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:50.408258 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d48a0863-0437-4b26-b22c-81e1625e9081 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:50.408691 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d48a0863-0437-4b26-b22c-81e1625e9081 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:50.542910 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d48a0863-0437-4b26-b22c-81e1625e9081 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:50.551194 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d48a0863-0437-4b26-b22c-81e1625e9081 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.155083 Jul 20 19:41:50.551770 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1239/1870] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:50 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:41:50.556118 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d3e15d22-1286-4fb2-87d6-bfc290789f50 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:50.556714 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d3e15d22-1286-4fb2-87d6-bfc290789f50 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:50.562288 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d3e15d22-1286-4fb2-87d6-bfc290789f50 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:50.562713 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d3e15d22-1286-4fb2-87d6-bfc290789f50 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:50.563463 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d3e15d22-1286-4fb2-87d6-bfc290789f50 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:50.563895 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d3e15d22-1286-4fb2-87d6-bfc290789f50 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:50.625191 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d3e15d22-1286-4fb2-87d6-bfc290789f50 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:50.633167 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d3e15d22-1286-4fb2-87d6-bfc290789f50 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080456 Jul 20 19:41:50.633752 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1240/1871] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:50 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:41:51.568941 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-3c6e2ca5-5a8f-4ec1-a311-b146165dd3fb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:51.569569 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-3c6e2ca5-5a8f-4ec1-a311-b146165dd3fb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:51.575865 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3c6e2ca5-5a8f-4ec1-a311-b146165dd3fb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:51.576248 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3c6e2ca5-5a8f-4ec1-a311-b146165dd3fb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:51.576998 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3c6e2ca5-5a8f-4ec1-a311-b146165dd3fb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:51.577441 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3c6e2ca5-5a8f-4ec1-a311-b146165dd3fb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:51.708129 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3c6e2ca5-5a8f-4ec1-a311-b146165dd3fb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:51.715545 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-3c6e2ca5-5a8f-4ec1-a311-b146165dd3fb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.151104 Jul 20 19:41:51.716112 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1241/1872] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:51 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:41:51.720397 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-887d5954-3c95-4305-a1d0-a4dc5429f9ac tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:51.721299 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-887d5954-3c95-4305-a1d0-a4dc5429f9ac tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:51.726919 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-887d5954-3c95-4305-a1d0-a4dc5429f9ac tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:51.727362 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-887d5954-3c95-4305-a1d0-a4dc5429f9ac tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:51.728111 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-887d5954-3c95-4305-a1d0-a4dc5429f9ac tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:51.728539 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-887d5954-3c95-4305-a1d0-a4dc5429f9ac tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:51.792262 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-887d5954-3c95-4305-a1d0-a4dc5429f9ac tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:51.800340 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-887d5954-3c95-4305-a1d0-a4dc5429f9ac tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.083304 Jul 20 19:41:51.800887 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1242/1873] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:51 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:41:52.733193 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-5ced353d-1e8e-4508-afc9-2d87ab3dee87 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:52.733917 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-5ced353d-1e8e-4508-afc9-2d87ab3dee87 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:52.740525 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5ced353d-1e8e-4508-afc9-2d87ab3dee87 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:52.740981 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5ced353d-1e8e-4508-afc9-2d87ab3dee87 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:52.741783 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5ced353d-1e8e-4508-afc9-2d87ab3dee87 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:52.742222 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5ced353d-1e8e-4508-afc9-2d87ab3dee87 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:52.886554 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-5ced353d-1e8e-4508-afc9-2d87ab3dee87 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:52.888745 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:41:52.896032 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-5ced353d-1e8e-4508-afc9-2d87ab3dee87 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.166710 Jul 20 19:41:52.896599 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1243/1874] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:52 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:41:52.901113 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-647a1061-1a0e-4719-81cf-959f2ca27097 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:52.901745 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-647a1061-1a0e-4719-81cf-959f2ca27097 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:52.907287 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-647a1061-1a0e-4719-81cf-959f2ca27097 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:52.907737 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-647a1061-1a0e-4719-81cf-959f2ca27097 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:52.908748 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-647a1061-1a0e-4719-81cf-959f2ca27097 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:52.909187 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-647a1061-1a0e-4719-81cf-959f2ca27097 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:52.970960 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-647a1061-1a0e-4719-81cf-959f2ca27097 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:52.978905 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-647a1061-1a0e-4719-81cf-959f2ca27097 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.081366 Jul 20 19:41:52.979470 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1244/1875] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:52 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:41:53.913277 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-3c23296e-dd07-4697-b634-8126114d7f71 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:53.914063 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-3c23296e-dd07-4697-b634-8126114d7f71 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:53.920306 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3c23296e-dd07-4697-b634-8126114d7f71 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:53.920753 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3c23296e-dd07-4697-b634-8126114d7f71 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:53.921532 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3c23296e-dd07-4697-b634-8126114d7f71 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:53.921982 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3c23296e-dd07-4697-b634-8126114d7f71 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:54.060631 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3c23296e-dd07-4697-b634-8126114d7f71 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:54.068970 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-3c23296e-dd07-4697-b634-8126114d7f71 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.160527 Jul 20 19:41:54.069566 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1245/1876] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:53 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:41:54.074090 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-f7a0fbed-6912-4f04-9e70-9785c2168a27 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:54.074681 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-f7a0fbed-6912-4f04-9e70-9785c2168a27 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:54.080666 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f7a0fbed-6912-4f04-9e70-9785c2168a27 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:54.081259 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f7a0fbed-6912-4f04-9e70-9785c2168a27 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:54.082614 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f7a0fbed-6912-4f04-9e70-9785c2168a27 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:54.083037 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f7a0fbed-6912-4f04-9e70-9785c2168a27 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:54.147743 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-f7a0fbed-6912-4f04-9e70-9785c2168a27 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:54.155672 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-f7a0fbed-6912-4f04-9e70-9785c2168a27 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.085111 Jul 20 19:41:54.156252 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1246/1877] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:54 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:41:55.086289 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-0774bbef-c9fe-494d-bf86-dc9e9738a2d6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:55.086985 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-0774bbef-c9fe-494d-bf86-dc9e9738a2d6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:55.093398 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0774bbef-c9fe-494d-bf86-dc9e9738a2d6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:55.093877 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0774bbef-c9fe-494d-bf86-dc9e9738a2d6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:55.094644 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0774bbef-c9fe-494d-bf86-dc9e9738a2d6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:55.095078 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0774bbef-c9fe-494d-bf86-dc9e9738a2d6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:55.227666 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0774bbef-c9fe-494d-bf86-dc9e9738a2d6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:55.235473 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-0774bbef-c9fe-494d-bf86-dc9e9738a2d6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.153244 Jul 20 19:41:55.236037 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1247/1878] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:55 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:41:55.240613 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-de9906c8-a5a2-4bc6-b569-04688b99aeea tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:55.241213 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-de9906c8-a5a2-4bc6-b569-04688b99aeea tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:55.246880 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-de9906c8-a5a2-4bc6-b569-04688b99aeea tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:55.247331 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-de9906c8-a5a2-4bc6-b569-04688b99aeea tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:55.248088 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-de9906c8-a5a2-4bc6-b569-04688b99aeea tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:55.248525 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-de9906c8-a5a2-4bc6-b569-04688b99aeea tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:55.325395 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-de9906c8-a5a2-4bc6-b569-04688b99aeea tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:55.334307 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-de9906c8-a5a2-4bc6-b569-04688b99aeea tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.097227 Jul 20 19:41:55.335157 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1248/1879] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:55 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:41:56.252175 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c31295b2-1748-453b-a28f-8ae421b8bb61 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:56.252881 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c31295b2-1748-453b-a28f-8ae421b8bb61 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:56.259971 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c31295b2-1748-453b-a28f-8ae421b8bb61 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:56.260424 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c31295b2-1748-453b-a28f-8ae421b8bb61 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:56.261189 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c31295b2-1748-453b-a28f-8ae421b8bb61 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:56.261648 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c31295b2-1748-453b-a28f-8ae421b8bb61 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:56.392406 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c31295b2-1748-453b-a28f-8ae421b8bb61 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:56.399997 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c31295b2-1748-453b-a28f-8ae421b8bb61 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.151694 Jul 20 19:41:56.400561 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1249/1880] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:56 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:41:56.404878 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-774c63f5-5233-4a94-8689-c245a9e6105b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:56.405481 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-774c63f5-5233-4a94-8689-c245a9e6105b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:56.412177 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-774c63f5-5233-4a94-8689-c245a9e6105b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:56.412622 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-774c63f5-5233-4a94-8689-c245a9e6105b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:56.413373 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-774c63f5-5233-4a94-8689-c245a9e6105b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:56.413845 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-774c63f5-5233-4a94-8689-c245a9e6105b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:56.477792 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-774c63f5-5233-4a94-8689-c245a9e6105b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:56.482644 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-774c63f5-5233-4a94-8689-c245a9e6105b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.081135 Jul 20 19:41:56.483277 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1250/1881] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:56 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:41:57.417975 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a0666f34-8647-452e-aff3-49b24b7dce53 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:57.418632 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a0666f34-8647-452e-aff3-49b24b7dce53 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:57.425499 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a0666f34-8647-452e-aff3-49b24b7dce53 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:57.425971 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a0666f34-8647-452e-aff3-49b24b7dce53 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:57.426733 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a0666f34-8647-452e-aff3-49b24b7dce53 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:57.427165 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a0666f34-8647-452e-aff3-49b24b7dce53 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:57.564125 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a0666f34-8647-452e-aff3-49b24b7dce53 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:57.572048 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a0666f34-8647-452e-aff3-49b24b7dce53 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.157969 Jul 20 19:41:57.572611 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1251/1882] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:57 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:41:57.577012 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-62bdaafb-d165-4141-afc6-ff38078fb545 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:57.577569 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-62bdaafb-d165-4141-afc6-ff38078fb545 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:57.583494 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-62bdaafb-d165-4141-afc6-ff38078fb545 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:57.583923 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-62bdaafb-d165-4141-afc6-ff38078fb545 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:57.584678 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-62bdaafb-d165-4141-afc6-ff38078fb545 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:57.585110 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-62bdaafb-d165-4141-afc6-ff38078fb545 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:57.646258 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-62bdaafb-d165-4141-afc6-ff38078fb545 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:57.656229 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-62bdaafb-d165-4141-afc6-ff38078fb545 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.082668 Jul 20 19:41:57.658613 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1252/1883] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:57 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:41:58.588521 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d5c530fc-45e7-44c7-8105-b54b309ccb27 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:58.589174 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d5c530fc-45e7-44c7-8105-b54b309ccb27 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:58.595909 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d5c530fc-45e7-44c7-8105-b54b309ccb27 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:58.596636 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d5c530fc-45e7-44c7-8105-b54b309ccb27 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:58.597396 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d5c530fc-45e7-44c7-8105-b54b309ccb27 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:58.597861 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d5c530fc-45e7-44c7-8105-b54b309ccb27 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:58.729392 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d5c530fc-45e7-44c7-8105-b54b309ccb27 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:58.736855 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d5c530fc-45e7-44c7-8105-b54b309ccb27 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.152517 Jul 20 19:41:58.737395 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1253/1884] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:58 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:41:58.741845 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-95076f8b-a576-4464-ab35-ef6b50e05916 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:58.742453 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-95076f8b-a576-4464-ab35-ef6b50e05916 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:58.748180 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-95076f8b-a576-4464-ab35-ef6b50e05916 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:58.748628 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-95076f8b-a576-4464-ab35-ef6b50e05916 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:58.749382 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-95076f8b-a576-4464-ab35-ef6b50e05916 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:58.749846 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-95076f8b-a576-4464-ab35-ef6b50e05916 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:58.823888 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-95076f8b-a576-4464-ab35-ef6b50e05916 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:58.832077 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-95076f8b-a576-4464-ab35-ef6b50e05916 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.092979 Jul 20 19:41:58.832651 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1254/1885] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:58 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:41:59.755414 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-9a1f646f-4cfb-4669-8723-4658e2f6f484 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:59.756081 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-9a1f646f-4cfb-4669-8723-4658e2f6f484 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:59.762428 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9a1f646f-4cfb-4669-8723-4658e2f6f484 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:59.762867 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9a1f646f-4cfb-4669-8723-4658e2f6f484 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:59.763639 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9a1f646f-4cfb-4669-8723-4658e2f6f484 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:59.764068 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9a1f646f-4cfb-4669-8723-4658e2f6f484 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:59.895907 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-9a1f646f-4cfb-4669-8723-4658e2f6f484 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:59.903470 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-9a1f646f-4cfb-4669-8723-4658e2f6f484 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.152198 Jul 20 19:41:59.904039 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1255/1886] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:59 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:41:59.908351 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e65df864-1609-474f-b8d9-fdd14f2bcd2f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:59.908957 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e65df864-1609-474f-b8d9-fdd14f2bcd2f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:59.914695 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e65df864-1609-474f-b8d9-fdd14f2bcd2f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:59.915431 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e65df864-1609-474f-b8d9-fdd14f2bcd2f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:59.916209 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e65df864-1609-474f-b8d9-fdd14f2bcd2f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:59.916635 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e65df864-1609-474f-b8d9-fdd14f2bcd2f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:59.979422 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e65df864-1609-474f-b8d9-fdd14f2bcd2f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:41:59.986775 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e65df864-1609-474f-b8d9-fdd14f2bcd2f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.081807 Jul 20 19:41:59.987886 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1256/1887] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:59 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:42:00.920372 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-1f276971-f9e9-4ccc-b7c8-6fc43725e1e2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:00.921062 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-1f276971-f9e9-4ccc-b7c8-6fc43725e1e2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:00.928778 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1f276971-f9e9-4ccc-b7c8-6fc43725e1e2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:00.929228 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1f276971-f9e9-4ccc-b7c8-6fc43725e1e2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:00.930029 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1f276971-f9e9-4ccc-b7c8-6fc43725e1e2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:00.930472 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1f276971-f9e9-4ccc-b7c8-6fc43725e1e2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:01.064787 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1f276971-f9e9-4ccc-b7c8-6fc43725e1e2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:01.072364 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-1f276971-f9e9-4ccc-b7c8-6fc43725e1e2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.155923 Jul 20 19:42:01.072929 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1257/1888] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:00 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:42:01.077259 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-b74b6a6c-f4a3-4792-bc29-bf13fedb2fba tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:01.077885 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-b74b6a6c-f4a3-4792-bc29-bf13fedb2fba tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:01.083909 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b74b6a6c-f4a3-4792-bc29-bf13fedb2fba tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:01.084355 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b74b6a6c-f4a3-4792-bc29-bf13fedb2fba tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:01.085113 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b74b6a6c-f4a3-4792-bc29-bf13fedb2fba tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:01.085574 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b74b6a6c-f4a3-4792-bc29-bf13fedb2fba tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:01.146810 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-b74b6a6c-f4a3-4792-bc29-bf13fedb2fba tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:01.154295 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-b74b6a6c-f4a3-4792-bc29-bf13fedb2fba tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080421 Jul 20 19:42:01.154854 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1258/1889] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:01 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:42:02.089860 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-81d6fd14-9907-48a7-9414-72e5f6367f76 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:02.090567 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-81d6fd14-9907-48a7-9414-72e5f6367f76 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:02.097344 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-81d6fd14-9907-48a7-9414-72e5f6367f76 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:02.097879 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-81d6fd14-9907-48a7-9414-72e5f6367f76 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:02.098629 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-81d6fd14-9907-48a7-9414-72e5f6367f76 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:02.099093 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-81d6fd14-9907-48a7-9414-72e5f6367f76 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:02.230793 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-81d6fd14-9907-48a7-9414-72e5f6367f76 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:02.238873 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-81d6fd14-9907-48a7-9414-72e5f6367f76 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.152896 Jul 20 19:42:02.239438 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1259/1890] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:02 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:42:02.243823 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-eb5c2aa2-fe02-4560-ab4d-29216b65c62a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:02.244429 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-eb5c2aa2-fe02-4560-ab4d-29216b65c62a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:02.250336 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-eb5c2aa2-fe02-4560-ab4d-29216b65c62a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:02.250787 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-eb5c2aa2-fe02-4560-ab4d-29216b65c62a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:02.251581 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-eb5c2aa2-fe02-4560-ab4d-29216b65c62a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:02.252024 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-eb5c2aa2-fe02-4560-ab4d-29216b65c62a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:02.267297 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:42:02.318456 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-eb5c2aa2-fe02-4560-ab4d-29216b65c62a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:02.325947 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-eb5c2aa2-fe02-4560-ab4d-29216b65c62a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.085531 Jul 20 19:42:02.326498 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1260/1891] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:02 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:42:03.256678 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-cc5856a8-f6db-496d-9004-103b00f73347 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:03.257374 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-cc5856a8-f6db-496d-9004-103b00f73347 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:03.263930 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cc5856a8-f6db-496d-9004-103b00f73347 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:03.264379 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cc5856a8-f6db-496d-9004-103b00f73347 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:03.265137 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cc5856a8-f6db-496d-9004-103b00f73347 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:03.265622 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cc5856a8-f6db-496d-9004-103b00f73347 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:03.398766 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-cc5856a8-f6db-496d-9004-103b00f73347 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:03.406331 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-cc5856a8-f6db-496d-9004-103b00f73347 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.154180 Jul 20 19:42:03.406894 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1261/1892] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:03 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:42:03.411671 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-7303db4a-8558-4e29-948c-5dfce4d92a02 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:03.412277 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-7303db4a-8558-4e29-948c-5dfce4d92a02 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:03.417994 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7303db4a-8558-4e29-948c-5dfce4d92a02 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:03.418436 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7303db4a-8558-4e29-948c-5dfce4d92a02 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:03.419192 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7303db4a-8558-4e29-948c-5dfce4d92a02 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:03.419618 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7303db4a-8558-4e29-948c-5dfce4d92a02 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:03.481262 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-7303db4a-8558-4e29-948c-5dfce4d92a02 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:03.489503 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-7303db4a-8558-4e29-948c-5dfce4d92a02 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.081668 Jul 20 19:42:03.490097 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1262/1893] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:03 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:42:04.425854 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-9061a40c-cba1-45f6-bb64-9787892b22ea tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:04.426500 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-9061a40c-cba1-45f6-bb64-9787892b22ea tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:04.433660 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9061a40c-cba1-45f6-bb64-9787892b22ea tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:04.434110 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9061a40c-cba1-45f6-bb64-9787892b22ea tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:04.434880 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9061a40c-cba1-45f6-bb64-9787892b22ea tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:04.435316 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9061a40c-cba1-45f6-bb64-9787892b22ea tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:04.572673 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-9061a40c-cba1-45f6-bb64-9787892b22ea tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:04.580179 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-9061a40c-cba1-45f6-bb64-9787892b22ea tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.159784 Jul 20 19:42:04.580672 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1263/1894] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:04 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:42:04.585782 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-46a72636-aa77-4d42-b96c-3cd1729329f6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:04.586378 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-46a72636-aa77-4d42-b96c-3cd1729329f6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:04.591861 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-46a72636-aa77-4d42-b96c-3cd1729329f6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:04.592333 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-46a72636-aa77-4d42-b96c-3cd1729329f6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:04.593085 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-46a72636-aa77-4d42-b96c-3cd1729329f6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:04.593533 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-46a72636-aa77-4d42-b96c-3cd1729329f6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:04.654367 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-46a72636-aa77-4d42-b96c-3cd1729329f6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:04.662271 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-46a72636-aa77-4d42-b96c-3cd1729329f6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.079809 Jul 20 19:42:04.662829 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1264/1895] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:04 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:42:05.074157 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 19:42:05.074445 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Wed Jul 20 19:42:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 19:42:05.598452 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-173d8a0b-746f-4e35-8add-545e650021a5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:05.599075 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-173d8a0b-746f-4e35-8add-545e650021a5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:05.605400 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-173d8a0b-746f-4e35-8add-545e650021a5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:05.605878 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-173d8a0b-746f-4e35-8add-545e650021a5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:05.606628 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-173d8a0b-746f-4e35-8add-545e650021a5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:05.607056 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-173d8a0b-746f-4e35-8add-545e650021a5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:05.740429 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-173d8a0b-746f-4e35-8add-545e650021a5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:05.747875 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-173d8a0b-746f-4e35-8add-545e650021a5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.153877 Jul 20 19:42:05.748435 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1265/1896] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:05 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:42:05.752789 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-57c4c1ef-4859-40fb-88d4-967946439be6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:05.753526 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-57c4c1ef-4859-40fb-88d4-967946439be6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:05.755036 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_api:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:42:05.760619 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-57c4c1ef-4859-40fb-88d4-967946439be6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:05.761094 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-57c4c1ef-4859-40fb-88d4-967946439be6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:05.761897 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-57c4c1ef-4859-40fb-88d4-967946439be6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:05.762323 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-57c4c1ef-4859-40fb-88d4-967946439be6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:05.826493 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-57c4c1ef-4859-40fb-88d4-967946439be6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:05.835139 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-57c4c1ef-4859-40fb-88d4-967946439be6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.085630 Jul 20 19:42:05.835701 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1266/1897] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:05 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:42:06.764923 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a9e75bd6-7d35-43ec-9b74-e0de1c173d66 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:06.765618 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a9e75bd6-7d35-43ec-9b74-e0de1c173d66 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:06.772453 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a9e75bd6-7d35-43ec-9b74-e0de1c173d66 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:06.772903 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a9e75bd6-7d35-43ec-9b74-e0de1c173d66 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:06.773770 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a9e75bd6-7d35-43ec-9b74-e0de1c173d66 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:06.774209 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a9e75bd6-7d35-43ec-9b74-e0de1c173d66 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:06.904568 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a9e75bd6-7d35-43ec-9b74-e0de1c173d66 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:06.912624 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a9e75bd6-7d35-43ec-9b74-e0de1c173d66 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.151562 Jul 20 19:42:06.913190 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1267/1898] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:06 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:42:06.917603 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-9fd58aa5-44fc-4fa1-af30-e9dd4953496d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:06.918213 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-9fd58aa5-44fc-4fa1-af30-e9dd4953496d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:06.923807 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9fd58aa5-44fc-4fa1-af30-e9dd4953496d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:06.924254 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9fd58aa5-44fc-4fa1-af30-e9dd4953496d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:06.925018 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9fd58aa5-44fc-4fa1-af30-e9dd4953496d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:06.926115 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9fd58aa5-44fc-4fa1-af30-e9dd4953496d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:06.986869 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-9fd58aa5-44fc-4fa1-af30-e9dd4953496d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:06.995311 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-9fd58aa5-44fc-4fa1-af30-e9dd4953496d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.081119 Jul 20 19:42:06.995887 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1268/1899] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:06 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:42:07.169014 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 19:42:07.169183 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Wed Jul 20 19:42:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 19:42:07.930301 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-678f701e-9ecb-471d-ad7e-e6ad78697d86 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:07.931007 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-678f701e-9ecb-471d-ad7e-e6ad78697d86 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:07.937448 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-678f701e-9ecb-471d-ad7e-e6ad78697d86 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:07.937925 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-678f701e-9ecb-471d-ad7e-e6ad78697d86 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:07.938703 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-678f701e-9ecb-471d-ad7e-e6ad78697d86 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:07.939117 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-678f701e-9ecb-471d-ad7e-e6ad78697d86 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:08.079497 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-678f701e-9ecb-471d-ad7e-e6ad78697d86 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:08.087165 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-678f701e-9ecb-471d-ad7e-e6ad78697d86 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.160794 Jul 20 19:42:08.087734 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1269/1900] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:07 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:42:08.092201 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-06580088-63d8-44b6-bb8e-64f221ed7906 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:08.092799 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-06580088-63d8-44b6-bb8e-64f221ed7906 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:08.099888 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-06580088-63d8-44b6-bb8e-64f221ed7906 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:08.100333 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-06580088-63d8-44b6-bb8e-64f221ed7906 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:08.101101 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-06580088-63d8-44b6-bb8e-64f221ed7906 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:08.101562 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-06580088-63d8-44b6-bb8e-64f221ed7906 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:08.164119 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-06580088-63d8-44b6-bb8e-64f221ed7906 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:08.171681 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-06580088-63d8-44b6-bb8e-64f221ed7906 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.082979 Jul 20 19:42:08.172246 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1270/1901] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:08 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:42:09.104623 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-1212981f-b5f5-464d-bf7c-aa942eb14f50 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:09.105274 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-1212981f-b5f5-464d-bf7c-aa942eb14f50 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:09.111880 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1212981f-b5f5-464d-bf7c-aa942eb14f50 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:09.112321 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1212981f-b5f5-464d-bf7c-aa942eb14f50 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:09.113265 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1212981f-b5f5-464d-bf7c-aa942eb14f50 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:09.113720 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1212981f-b5f5-464d-bf7c-aa942eb14f50 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:09.243248 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1212981f-b5f5-464d-bf7c-aa942eb14f50 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:09.250826 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-1212981f-b5f5-464d-bf7c-aa942eb14f50 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.150122 Jul 20 19:42:09.251397 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1271/1902] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:09 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:42:09.256607 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-0e3d138d-ce31-4f9b-aa39-bbc06c7f4832 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:09.257206 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-0e3d138d-ce31-4f9b-aa39-bbc06c7f4832 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:09.262918 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0e3d138d-ce31-4f9b-aa39-bbc06c7f4832 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:09.263369 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0e3d138d-ce31-4f9b-aa39-bbc06c7f4832 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:09.264128 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0e3d138d-ce31-4f9b-aa39-bbc06c7f4832 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:09.264563 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0e3d138d-ce31-4f9b-aa39-bbc06c7f4832 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:09.328882 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0e3d138d-ce31-4f9b-aa39-bbc06c7f4832 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:09.337140 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-0e3d138d-ce31-4f9b-aa39-bbc06c7f4832 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.084797 Jul 20 19:42:09.337730 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1272/1903] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:09 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:42:10.269878 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-92980836-a677-441b-9908-599efedb8c61 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:10.270606 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-92980836-a677-441b-9908-599efedb8c61 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:10.277291 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-92980836-a677-441b-9908-599efedb8c61 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:10.277779 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-92980836-a677-441b-9908-599efedb8c61 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:10.278580 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-92980836-a677-441b-9908-599efedb8c61 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:10.279010 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-92980836-a677-441b-9908-599efedb8c61 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:10.425226 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-92980836-a677-441b-9908-599efedb8c61 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:10.436864 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-92980836-a677-441b-9908-599efedb8c61 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.171373 Jul 20 19:42:10.437621 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1273/1904] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:10 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:42:10.442116 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-3eb46477-ce88-46ff-8258-44c797259caf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:10.442719 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-3eb46477-ce88-46ff-8258-44c797259caf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:10.448662 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3eb46477-ce88-46ff-8258-44c797259caf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:10.449107 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3eb46477-ce88-46ff-8258-44c797259caf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:10.449905 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3eb46477-ce88-46ff-8258-44c797259caf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:10.450338 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3eb46477-ce88-46ff-8258-44c797259caf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:10.517389 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3eb46477-ce88-46ff-8258-44c797259caf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:10.526347 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-3eb46477-ce88-46ff-8258-44c797259caf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.087628 Jul 20 19:42:10.526867 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1274/1905] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:10 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:42:11.454573 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-048e22c3-6106-431f-8351-489c3162a9d5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:11.455241 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-048e22c3-6106-431f-8351-489c3162a9d5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:11.462534 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-048e22c3-6106-431f-8351-489c3162a9d5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:11.462986 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-048e22c3-6106-431f-8351-489c3162a9d5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:11.463751 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-048e22c3-6106-431f-8351-489c3162a9d5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:11.464188 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-048e22c3-6106-431f-8351-489c3162a9d5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:11.599807 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-048e22c3-6106-431f-8351-489c3162a9d5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:11.607305 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-048e22c3-6106-431f-8351-489c3162a9d5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.156581 Jul 20 19:42:11.607873 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1275/1906] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:11 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:42:11.612180 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-8ff96720-5c8b-44fb-9a11-9a405bc84288 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:11.612822 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-8ff96720-5c8b-44fb-9a11-9a405bc84288 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:11.618705 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8ff96720-5c8b-44fb-9a11-9a405bc84288 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:11.619158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8ff96720-5c8b-44fb-9a11-9a405bc84288 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:11.619921 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8ff96720-5c8b-44fb-9a11-9a405bc84288 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:11.620353 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8ff96720-5c8b-44fb-9a11-9a405bc84288 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:11.682101 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8ff96720-5c8b-44fb-9a11-9a405bc84288 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:11.689549 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-8ff96720-5c8b-44fb-9a11-9a405bc84288 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080722 Jul 20 19:42:11.690113 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1276/1907] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:11 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:42:12.624455 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-3ec893a1-f56c-43f6-941b-473e842f0e9e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:12.625073 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-3ec893a1-f56c-43f6-941b-473e842f0e9e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:12.632094 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3ec893a1-f56c-43f6-941b-473e842f0e9e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:12.632539 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3ec893a1-f56c-43f6-941b-473e842f0e9e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:12.633292 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3ec893a1-f56c-43f6-941b-473e842f0e9e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:12.633828 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3ec893a1-f56c-43f6-941b-473e842f0e9e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:12.636380 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:42:12.773419 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3ec893a1-f56c-43f6-941b-473e842f0e9e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:12.780943 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-3ec893a1-f56c-43f6-941b-473e842f0e9e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.160453 Jul 20 19:42:12.781722 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1277/1908] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:12 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:42:12.786923 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-bfe671e5-b1d6-41fe-bbdd-d1cd35e2bde3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:12.787525 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-bfe671e5-b1d6-41fe-bbdd-d1cd35e2bde3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:12.793338 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bfe671e5-b1d6-41fe-bbdd-d1cd35e2bde3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:12.793832 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bfe671e5-b1d6-41fe-bbdd-d1cd35e2bde3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:12.794584 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bfe671e5-b1d6-41fe-bbdd-d1cd35e2bde3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:12.795024 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bfe671e5-b1d6-41fe-bbdd-d1cd35e2bde3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:12.860883 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-bfe671e5-b1d6-41fe-bbdd-d1cd35e2bde3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:12.869283 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-bfe671e5-b1d6-41fe-bbdd-d1cd35e2bde3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.086718 Jul 20 19:42:12.869887 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1278/1909] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:12 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:42:13.798911 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-6550ad7e-f76f-4712-a0f5-299d255e9065 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:13.799586 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-6550ad7e-f76f-4712-a0f5-299d255e9065 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:13.806280 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6550ad7e-f76f-4712-a0f5-299d255e9065 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:13.806723 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6550ad7e-f76f-4712-a0f5-299d255e9065 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:13.807471 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6550ad7e-f76f-4712-a0f5-299d255e9065 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:13.807898 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6550ad7e-f76f-4712-a0f5-299d255e9065 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:13.940283 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6550ad7e-f76f-4712-a0f5-299d255e9065 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:13.948783 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-6550ad7e-f76f-4712-a0f5-299d255e9065 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.153793 Jul 20 19:42:13.949341 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1279/1910] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:13 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:42:13.953711 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-cc64ac20-46ff-4e7f-a697-314c6685bca7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:13.954584 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-cc64ac20-46ff-4e7f-a697-314c6685bca7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:13.960174 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cc64ac20-46ff-4e7f-a697-314c6685bca7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:13.960615 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cc64ac20-46ff-4e7f-a697-314c6685bca7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:13.961358 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cc64ac20-46ff-4e7f-a697-314c6685bca7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:13.961829 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cc64ac20-46ff-4e7f-a697-314c6685bca7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:14.022917 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-cc64ac20-46ff-4e7f-a697-314c6685bca7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:14.030389 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-cc64ac20-46ff-4e7f-a697-314c6685bca7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080092 Jul 20 19:42:14.030944 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1280/1911] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:13 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:42:14.965351 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-54a63984-58df-459e-9065-d43e20d9a4c0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:14.965983 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-54a63984-58df-459e-9065-d43e20d9a4c0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:14.973720 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-54a63984-58df-459e-9065-d43e20d9a4c0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:14.974167 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-54a63984-58df-459e-9065-d43e20d9a4c0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:14.974926 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-54a63984-58df-459e-9065-d43e20d9a4c0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:14.975357 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-54a63984-58df-459e-9065-d43e20d9a4c0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:15.113654 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-54a63984-58df-459e-9065-d43e20d9a4c0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:15.121132 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-54a63984-58df-459e-9065-d43e20d9a4c0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.159652 Jul 20 19:42:15.121725 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1281/1912] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:14 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:42:15.126181 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ab902d4f-dc8d-441a-986c-b00f894e35b9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:15.126783 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ab902d4f-dc8d-441a-986c-b00f894e35b9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:15.132934 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ab902d4f-dc8d-441a-986c-b00f894e35b9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:15.133387 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ab902d4f-dc8d-441a-986c-b00f894e35b9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:15.134201 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ab902d4f-dc8d-441a-986c-b00f894e35b9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:15.134637 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ab902d4f-dc8d-441a-986c-b00f894e35b9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:15.197798 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ab902d4f-dc8d-441a-986c-b00f894e35b9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:15.205199 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ab902d4f-dc8d-441a-986c-b00f894e35b9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.082537 Jul 20 19:42:15.205835 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1282/1913] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:15 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:42:16.137992 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-33265455-d2d2-4783-b3ed-d427a1921882 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:16.138648 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-33265455-d2d2-4783-b3ed-d427a1921882 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:16.144979 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-33265455-d2d2-4783-b3ed-d427a1921882 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:16.145417 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-33265455-d2d2-4783-b3ed-d427a1921882 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:16.146197 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-33265455-d2d2-4783-b3ed-d427a1921882 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:16.146623 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-33265455-d2d2-4783-b3ed-d427a1921882 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:16.276633 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-33265455-d2d2-4783-b3ed-d427a1921882 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:16.286608 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-33265455-d2d2-4783-b3ed-d427a1921882 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.152404 Jul 20 19:42:16.287181 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1283/1914] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:16 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:42:16.291749 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-9b6cc8a2-fc20-4533-80ee-582065780247 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:16.292350 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-9b6cc8a2-fc20-4533-80ee-582065780247 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:16.298263 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9b6cc8a2-fc20-4533-80ee-582065780247 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:16.298714 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9b6cc8a2-fc20-4533-80ee-582065780247 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:16.299473 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9b6cc8a2-fc20-4533-80ee-582065780247 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:16.300395 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9b6cc8a2-fc20-4533-80ee-582065780247 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:16.364833 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-9b6cc8a2-fc20-4533-80ee-582065780247 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:16.372363 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-9b6cc8a2-fc20-4533-80ee-582065780247 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.084231 Jul 20 19:42:16.372924 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1284/1915] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:16 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:42:17.303716 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-479b9a4c-1f51-4277-8346-e160f82afac0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:17.304342 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-479b9a4c-1f51-4277-8346-e160f82afac0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:17.310881 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-479b9a4c-1f51-4277-8346-e160f82afac0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:17.311335 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-479b9a4c-1f51-4277-8346-e160f82afac0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:17.312092 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-479b9a4c-1f51-4277-8346-e160f82afac0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:17.312537 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-479b9a4c-1f51-4277-8346-e160f82afac0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:17.443897 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-479b9a4c-1f51-4277-8346-e160f82afac0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:17.451279 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-479b9a4c-1f51-4277-8346-e160f82afac0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.151664 Jul 20 19:42:17.451834 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1285/1916] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:17 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:42:17.456212 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-1269233e-2de6-4f5b-a175-024f5ecd1e3f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:17.457359 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-1269233e-2de6-4f5b-a175-024f5ecd1e3f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:17.462931 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1269233e-2de6-4f5b-a175-024f5ecd1e3f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:17.463378 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1269233e-2de6-4f5b-a175-024f5ecd1e3f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:17.464129 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1269233e-2de6-4f5b-a175-024f5ecd1e3f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:17.464555 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1269233e-2de6-4f5b-a175-024f5ecd1e3f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:17.524881 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1269233e-2de6-4f5b-a175-024f5ecd1e3f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:17.532257 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-1269233e-2de6-4f5b-a175-024f5ecd1e3f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.079498 Jul 20 19:42:17.532815 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1286/1917] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:17 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:42:18.468861 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-5477ece6-e669-4c0f-bc4d-1896272e5a0a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:18.469546 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-5477ece6-e669-4c0f-bc4d-1896272e5a0a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:18.477220 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5477ece6-e669-4c0f-bc4d-1896272e5a0a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:18.477707 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5477ece6-e669-4c0f-bc4d-1896272e5a0a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:18.478464 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5477ece6-e669-4c0f-bc4d-1896272e5a0a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:18.478904 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5477ece6-e669-4c0f-bc4d-1896272e5a0a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:18.612097 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-5477ece6-e669-4c0f-bc4d-1896272e5a0a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:18.619700 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-5477ece6-e669-4c0f-bc4d-1896272e5a0a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.154682 Jul 20 19:42:18.620260 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1287/1918] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:18 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:42:18.624582 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-df131614-05ea-47a8-8e7c-ab3736d3c07f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:18.625177 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-df131614-05ea-47a8-8e7c-ab3736d3c07f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:18.630910 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-df131614-05ea-47a8-8e7c-ab3736d3c07f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:18.631351 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-df131614-05ea-47a8-8e7c-ab3736d3c07f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:18.632102 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-df131614-05ea-47a8-8e7c-ab3736d3c07f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:18.632534 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-df131614-05ea-47a8-8e7c-ab3736d3c07f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:18.693210 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-df131614-05ea-47a8-8e7c-ab3736d3c07f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:18.700698 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-df131614-05ea-47a8-8e7c-ab3736d3c07f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.079504 Jul 20 19:42:18.701255 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1288/1919] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:18 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:42:19.636868 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-f6cf04bc-1a0d-419b-99f1-6f3699f0eb1b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:19.637564 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-f6cf04bc-1a0d-419b-99f1-6f3699f0eb1b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:19.643951 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f6cf04bc-1a0d-419b-99f1-6f3699f0eb1b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:19.644485 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f6cf04bc-1a0d-419b-99f1-6f3699f0eb1b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:19.645241 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f6cf04bc-1a0d-419b-99f1-6f3699f0eb1b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:19.645714 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f6cf04bc-1a0d-419b-99f1-6f3699f0eb1b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:19.777353 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-f6cf04bc-1a0d-419b-99f1-6f3699f0eb1b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:19.785346 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-f6cf04bc-1a0d-419b-99f1-6f3699f0eb1b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.152468 Jul 20 19:42:19.786040 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1289/1920] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:19 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:42:19.790416 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-5cf09f62-b1d2-46dd-828b-7c355a1bcf9f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:19.791014 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-5cf09f62-b1d2-46dd-828b-7c355a1bcf9f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:19.796712 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5cf09f62-b1d2-46dd-828b-7c355a1bcf9f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:19.797154 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5cf09f62-b1d2-46dd-828b-7c355a1bcf9f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:19.797940 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5cf09f62-b1d2-46dd-828b-7c355a1bcf9f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:19.798373 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5cf09f62-b1d2-46dd-828b-7c355a1bcf9f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:19.863479 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-5cf09f62-b1d2-46dd-828b-7c355a1bcf9f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:19.871014 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-5cf09f62-b1d2-46dd-828b-7c355a1bcf9f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.084037 Jul 20 19:42:19.871578 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1290/1921] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:19 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:42:20.802860 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-bfba1bf9-5fe2-4d64-b683-a325361fec47 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:20.803532 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-bfba1bf9-5fe2-4d64-b683-a325361fec47 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:20.809986 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bfba1bf9-5fe2-4d64-b683-a325361fec47 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:20.810436 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bfba1bf9-5fe2-4d64-b683-a325361fec47 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:20.811193 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bfba1bf9-5fe2-4d64-b683-a325361fec47 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:20.811630 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bfba1bf9-5fe2-4d64-b683-a325361fec47 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:20.944468 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-bfba1bf9-5fe2-4d64-b683-a325361fec47 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:20.952468 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-bfba1bf9-5fe2-4d64-b683-a325361fec47 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.153925 Jul 20 19:42:20.953046 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1291/1922] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:20 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:42:20.958238 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-fb4dfe11-0d8b-4cd6-a295-ea66d2cdd26c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:20.958723 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-fb4dfe11-0d8b-4cd6-a295-ea66d2cdd26c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:20.964587 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fb4dfe11-0d8b-4cd6-a295-ea66d2cdd26c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:20.965032 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fb4dfe11-0d8b-4cd6-a295-ea66d2cdd26c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:20.965813 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fb4dfe11-0d8b-4cd6-a295-ea66d2cdd26c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:20.966250 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fb4dfe11-0d8b-4cd6-a295-ea66d2cdd26c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:21.028766 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-fb4dfe11-0d8b-4cd6-a295-ea66d2cdd26c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:21.036332 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-fb4dfe11-0d8b-4cd6-a295-ea66d2cdd26c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.082284 Jul 20 19:42:21.036904 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1292/1923] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:20 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:42:21.970167 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-6a9ec18f-ed56-45af-a493-a35f2e5efae2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:21.970857 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-6a9ec18f-ed56-45af-a493-a35f2e5efae2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:21.978618 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6a9ec18f-ed56-45af-a493-a35f2e5efae2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:21.979065 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6a9ec18f-ed56-45af-a493-a35f2e5efae2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:21.979861 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6a9ec18f-ed56-45af-a493-a35f2e5efae2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:21.980296 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6a9ec18f-ed56-45af-a493-a35f2e5efae2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:22.117147 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6a9ec18f-ed56-45af-a493-a35f2e5efae2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:22.119370 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:42:22.125715 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-6a9ec18f-ed56-45af-a493-a35f2e5efae2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.159368 Jul 20 19:42:22.126268 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1293/1924] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:21 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:42:22.131983 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4dc0177b-3f00-4f8a-b5ee-7a314d3cd249 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:22.132586 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-4dc0177b-3f00-4f8a-b5ee-7a314d3cd249 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:22.138344 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4dc0177b-3f00-4f8a-b5ee-7a314d3cd249 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:22.138785 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4dc0177b-3f00-4f8a-b5ee-7a314d3cd249 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:22.139531 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4dc0177b-3f00-4f8a-b5ee-7a314d3cd249 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:22.139962 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4dc0177b-3f00-4f8a-b5ee-7a314d3cd249 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:22.200307 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-4dc0177b-3f00-4f8a-b5ee-7a314d3cd249 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:22.209766 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-4dc0177b-3f00-4f8a-b5ee-7a314d3cd249 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.082164 Jul 20 19:42:22.210772 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1294/1925] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:22 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:42:23.126937 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 19:42:23.128141 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Wed Jul 20 19:42:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 19:42:23.143264 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-cecd7d4d-f237-4255-862f-89460919f71e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:23.144397 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-cecd7d4d-f237-4255-862f-89460919f71e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:23.151242 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cecd7d4d-f237-4255-862f-89460919f71e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:23.151696 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cecd7d4d-f237-4255-862f-89460919f71e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:23.152463 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cecd7d4d-f237-4255-862f-89460919f71e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:23.152900 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cecd7d4d-f237-4255-862f-89460919f71e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:23.284519 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-cecd7d4d-f237-4255-862f-89460919f71e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:23.291961 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-cecd7d4d-f237-4255-862f-89460919f71e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.152486 Jul 20 19:42:23.292526 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1295/1926] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:23 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:42:23.297008 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-f3645ede-0dc1-4de5-ad27-a2e95740f8a2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:23.297626 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-f3645ede-0dc1-4de5-ad27-a2e95740f8a2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:23.303775 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f3645ede-0dc1-4de5-ad27-a2e95740f8a2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:23.304218 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f3645ede-0dc1-4de5-ad27-a2e95740f8a2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:23.304971 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f3645ede-0dc1-4de5-ad27-a2e95740f8a2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:23.305403 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f3645ede-0dc1-4de5-ad27-a2e95740f8a2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:23.384499 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-f3645ede-0dc1-4de5-ad27-a2e95740f8a2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:23.392083 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-f3645ede-0dc1-4de5-ad27-a2e95740f8a2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.098610 Jul 20 19:42:23.392647 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1296/1927] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:23 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:42:24.309142 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-b6ebfa24-1671-4737-8a9e-6edda45a663b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:24.309932 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-b6ebfa24-1671-4737-8a9e-6edda45a663b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:24.319717 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b6ebfa24-1671-4737-8a9e-6edda45a663b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:24.320200 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b6ebfa24-1671-4737-8a9e-6edda45a663b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:24.320979 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b6ebfa24-1671-4737-8a9e-6edda45a663b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:24.321499 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b6ebfa24-1671-4737-8a9e-6edda45a663b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:24.490331 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-b6ebfa24-1671-4737-8a9e-6edda45a663b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:24.500940 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-b6ebfa24-1671-4737-8a9e-6edda45a663b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.195666 Jul 20 19:42:24.501643 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1297/1928] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:24 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:42:24.507212 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c9d0d5c6-05b1-44b8-80ab-85f988be8d0f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:24.508079 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c9d0d5c6-05b1-44b8-80ab-85f988be8d0f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:24.516863 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c9d0d5c6-05b1-44b8-80ab-85f988be8d0f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:24.517682 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c9d0d5c6-05b1-44b8-80ab-85f988be8d0f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:24.519125 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c9d0d5c6-05b1-44b8-80ab-85f988be8d0f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:24.520281 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c9d0d5c6-05b1-44b8-80ab-85f988be8d0f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:24.585577 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c9d0d5c6-05b1-44b8-80ab-85f988be8d0f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:24.595804 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c9d0d5c6-05b1-44b8-80ab-85f988be8d0f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.092907 Jul 20 19:42:24.597709 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1298/1929] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:24 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:42:25.518258 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-13e646e3-5e33-4451-b50e-eaae2c20a577 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:25.519017 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-13e646e3-5e33-4451-b50e-eaae2c20a577 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:25.525474 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-13e646e3-5e33-4451-b50e-eaae2c20a577 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:25.525950 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-13e646e3-5e33-4451-b50e-eaae2c20a577 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:25.526700 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-13e646e3-5e33-4451-b50e-eaae2c20a577 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:25.527126 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-13e646e3-5e33-4451-b50e-eaae2c20a577 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:25.663029 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-13e646e3-5e33-4451-b50e-eaae2c20a577 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:25.671235 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-13e646e3-5e33-4451-b50e-eaae2c20a577 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.156753 Jul 20 19:42:25.671799 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1299/1930] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:25 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:42:25.678167 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-05f2882a-3521-4ad6-bd69-9e9b6c186243 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:25.678167 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-05f2882a-3521-4ad6-bd69-9e9b6c186243 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:25.684187 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-05f2882a-3521-4ad6-bd69-9e9b6c186243 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:25.684644 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-05f2882a-3521-4ad6-bd69-9e9b6c186243 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:25.685416 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-05f2882a-3521-4ad6-bd69-9e9b6c186243 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:25.685882 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-05f2882a-3521-4ad6-bd69-9e9b6c186243 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:25.748782 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-05f2882a-3521-4ad6-bd69-9e9b6c186243 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:25.756352 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-05f2882a-3521-4ad6-bd69-9e9b6c186243 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.083591 Jul 20 19:42:25.756919 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1300/1931] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:25 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:42:26.689632 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ec3e651f-1916-4482-892c-d46567d51f9d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:26.690338 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ec3e651f-1916-4482-892c-d46567d51f9d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:26.696850 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ec3e651f-1916-4482-892c-d46567d51f9d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:26.697291 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ec3e651f-1916-4482-892c-d46567d51f9d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:26.698082 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ec3e651f-1916-4482-892c-d46567d51f9d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:26.698516 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ec3e651f-1916-4482-892c-d46567d51f9d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:26.834811 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ec3e651f-1916-4482-892c-d46567d51f9d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:26.842277 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ec3e651f-1916-4482-892c-d46567d51f9d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.156504 Jul 20 19:42:26.842841 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1301/1932] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:26 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:42:26.848247 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-b46c8374-a8ab-44a9-80df-d6dc23e8c1f5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:26.848845 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-b46c8374-a8ab-44a9-80df-d6dc23e8c1f5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:26.854811 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b46c8374-a8ab-44a9-80df-d6dc23e8c1f5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:26.855258 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b46c8374-a8ab-44a9-80df-d6dc23e8c1f5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:26.856019 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b46c8374-a8ab-44a9-80df-d6dc23e8c1f5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:26.856450 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b46c8374-a8ab-44a9-80df-d6dc23e8c1f5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:26.920578 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-b46c8374-a8ab-44a9-80df-d6dc23e8c1f5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:26.928289 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-b46c8374-a8ab-44a9-80df-d6dc23e8c1f5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.084467 Jul 20 19:42:26.928851 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1302/1933] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:26 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:42:27.859849 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4819ed0a-c30c-4d05-8eae-e789df523d4b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:27.860539 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-4819ed0a-c30c-4d05-8eae-e789df523d4b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:27.867401 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4819ed0a-c30c-4d05-8eae-e789df523d4b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:27.867842 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4819ed0a-c30c-4d05-8eae-e789df523d4b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:27.868606 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4819ed0a-c30c-4d05-8eae-e789df523d4b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:27.869036 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4819ed0a-c30c-4d05-8eae-e789df523d4b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:28.005702 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-4819ed0a-c30c-4d05-8eae-e789df523d4b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:28.013656 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-4819ed0a-c30c-4d05-8eae-e789df523d4b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.157621 Jul 20 19:42:28.014217 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1303/1934] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:27 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:42:28.019210 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-b3402788-042d-4740-aa99-e3f06dae909a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:28.019849 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-b3402788-042d-4740-aa99-e3f06dae909a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:28.025837 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b3402788-042d-4740-aa99-e3f06dae909a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:28.026285 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b3402788-042d-4740-aa99-e3f06dae909a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:28.027040 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b3402788-042d-4740-aa99-e3f06dae909a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:28.027467 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b3402788-042d-4740-aa99-e3f06dae909a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:28.090569 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-b3402788-042d-4740-aa99-e3f06dae909a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:28.098594 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-b3402788-042d-4740-aa99-e3f06dae909a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.083429 Jul 20 19:42:28.099163 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1304/1935] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:28 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:42:29.031664 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ce2d4a8d-8b01-4b07-b3ab-1886a9b8d3ef tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:29.032310 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ce2d4a8d-8b01-4b07-b3ab-1886a9b8d3ef tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:29.039551 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ce2d4a8d-8b01-4b07-b3ab-1886a9b8d3ef tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:29.039993 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ce2d4a8d-8b01-4b07-b3ab-1886a9b8d3ef tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:29.040745 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ce2d4a8d-8b01-4b07-b3ab-1886a9b8d3ef tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:29.041176 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ce2d4a8d-8b01-4b07-b3ab-1886a9b8d3ef tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:29.177756 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ce2d4a8d-8b01-4b07-b3ab-1886a9b8d3ef tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:29.185391 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ce2d4a8d-8b01-4b07-b3ab-1886a9b8d3ef tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.157717 Jul 20 19:42:29.185997 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1305/1936] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:29 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:42:29.190364 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-219e54a2-b9e0-4709-a6c5-312fba319cde tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:29.191336 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-219e54a2-b9e0-4709-a6c5-312fba319cde tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:29.197105 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-219e54a2-b9e0-4709-a6c5-312fba319cde tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:29.197718 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-219e54a2-b9e0-4709-a6c5-312fba319cde tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:29.198578 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-219e54a2-b9e0-4709-a6c5-312fba319cde tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:29.199082 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-219e54a2-b9e0-4709-a6c5-312fba319cde tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:29.271173 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-219e54a2-b9e0-4709-a6c5-312fba319cde tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:29.278701 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-219e54a2-b9e0-4709-a6c5-312fba319cde tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.091767 Jul 20 19:42:29.279253 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1306/1937] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:29 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:42:30.203170 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a425da7d-e5a5-4956-96c1-f3dbf1cd63d5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:30.204059 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a425da7d-e5a5-4956-96c1-f3dbf1cd63d5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:30.211281 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a425da7d-e5a5-4956-96c1-f3dbf1cd63d5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:30.211719 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a425da7d-e5a5-4956-96c1-f3dbf1cd63d5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:30.212467 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a425da7d-e5a5-4956-96c1-f3dbf1cd63d5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:30.212889 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a425da7d-e5a5-4956-96c1-f3dbf1cd63d5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:30.356151 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a425da7d-e5a5-4956-96c1-f3dbf1cd63d5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:30.364509 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a425da7d-e5a5-4956-96c1-f3dbf1cd63d5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.165166 Jul 20 19:42:30.365079 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1307/1938] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:30 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:42:30.369646 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-8f8bc683-00c6-4e25-bcc3-5dc89560a5e8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:30.370248 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-8f8bc683-00c6-4e25-bcc3-5dc89560a5e8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:30.376290 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8f8bc683-00c6-4e25-bcc3-5dc89560a5e8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:30.376742 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8f8bc683-00c6-4e25-bcc3-5dc89560a5e8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:30.377537 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8f8bc683-00c6-4e25-bcc3-5dc89560a5e8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:30.378904 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8f8bc683-00c6-4e25-bcc3-5dc89560a5e8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:30.444781 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8f8bc683-00c6-4e25-bcc3-5dc89560a5e8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:30.452431 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-8f8bc683-00c6-4e25-bcc3-5dc89560a5e8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.086366 Jul 20 19:42:30.452994 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1308/1939] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:30 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:42:31.382516 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-099c3366-f178-4972-8fa5-728a237e6db0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:31.383191 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-099c3366-f178-4972-8fa5-728a237e6db0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:31.389747 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-099c3366-f178-4972-8fa5-728a237e6db0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:31.390193 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-099c3366-f178-4972-8fa5-728a237e6db0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:31.390962 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-099c3366-f178-4972-8fa5-728a237e6db0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:31.391392 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-099c3366-f178-4972-8fa5-728a237e6db0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:31.527317 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-099c3366-f178-4972-8fa5-728a237e6db0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:31.536335 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-099c3366-f178-4972-8fa5-728a237e6db0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.157693 Jul 20 19:42:31.536928 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1309/1940] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:31 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:42:31.541657 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-eca221c0-6a26-4b2a-8f0b-4a8487730913 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:31.542263 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-eca221c0-6a26-4b2a-8f0b-4a8487730913 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:31.548220 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-eca221c0-6a26-4b2a-8f0b-4a8487730913 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:31.548669 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-eca221c0-6a26-4b2a-8f0b-4a8487730913 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:31.549436 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-eca221c0-6a26-4b2a-8f0b-4a8487730913 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:31.549900 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-eca221c0-6a26-4b2a-8f0b-4a8487730913 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:31.564721 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:42:31.613838 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-eca221c0-6a26-4b2a-8f0b-4a8487730913 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:31.621314 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-eca221c0-6a26-4b2a-8f0b-4a8487730913 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.083439 Jul 20 19:42:31.621910 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1310/1941] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:31 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:42:32.554258 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4a3234cf-2555-4c68-ae6c-e1d82818672b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:32.554937 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-4a3234cf-2555-4c68-ae6c-e1d82818672b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:32.561328 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4a3234cf-2555-4c68-ae6c-e1d82818672b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:32.561800 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4a3234cf-2555-4c68-ae6c-e1d82818672b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:32.562558 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4a3234cf-2555-4c68-ae6c-e1d82818672b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:32.562979 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4a3234cf-2555-4c68-ae6c-e1d82818672b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:32.696815 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-4a3234cf-2555-4c68-ae6c-e1d82818672b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:32.704451 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-4a3234cf-2555-4c68-ae6c-e1d82818672b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.155079 Jul 20 19:42:32.705009 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1311/1942] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:32 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:42:32.710184 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c48f50c2-e066-4175-a77b-7a0191f839e8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:32.710788 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c48f50c2-e066-4175-a77b-7a0191f839e8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:32.716640 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c48f50c2-e066-4175-a77b-7a0191f839e8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:32.717086 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c48f50c2-e066-4175-a77b-7a0191f839e8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:32.717872 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c48f50c2-e066-4175-a77b-7a0191f839e8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:32.718303 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c48f50c2-e066-4175-a77b-7a0191f839e8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:32.781700 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c48f50c2-e066-4175-a77b-7a0191f839e8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:32.790059 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c48f50c2-e066-4175-a77b-7a0191f839e8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.084061 Jul 20 19:42:32.790947 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1312/1943] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:32 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:42:33.723669 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-8136837e-e976-487e-bc6d-b2521eae6245 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:33.724367 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-8136837e-e976-487e-bc6d-b2521eae6245 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:33.730693 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8136837e-e976-487e-bc6d-b2521eae6245 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:33.731214 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8136837e-e976-487e-bc6d-b2521eae6245 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:33.731980 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8136837e-e976-487e-bc6d-b2521eae6245 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:33.732407 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8136837e-e976-487e-bc6d-b2521eae6245 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:33.880127 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8136837e-e976-487e-bc6d-b2521eae6245 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:33.888129 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-8136837e-e976-487e-bc6d-b2521eae6245 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.169834 Jul 20 19:42:33.889496 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1313/1944] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:33 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:42:33.893399 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c517c859-d385-41f3-bf89-0fa45d9d176b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:33.894129 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c517c859-d385-41f3-bf89-0fa45d9d176b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:33.900297 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c517c859-d385-41f3-bf89-0fa45d9d176b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:33.900912 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c517c859-d385-41f3-bf89-0fa45d9d176b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:33.901731 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c517c859-d385-41f3-bf89-0fa45d9d176b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:33.902145 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c517c859-d385-41f3-bf89-0fa45d9d176b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:33.971165 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c517c859-d385-41f3-bf89-0fa45d9d176b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:33.980075 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c517c859-d385-41f3-bf89-0fa45d9d176b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.090172 Jul 20 19:42:33.980595 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1314/1945] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:33 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:42:34.908588 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-dba2d457-0ec1-4ef4-8b29-77839e1c11e8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:34.909274 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-dba2d457-0ec1-4ef4-8b29-77839e1c11e8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:34.915844 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-dba2d457-0ec1-4ef4-8b29-77839e1c11e8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:34.916297 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-dba2d457-0ec1-4ef4-8b29-77839e1c11e8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:34.917069 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-dba2d457-0ec1-4ef4-8b29-77839e1c11e8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:34.917503 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-dba2d457-0ec1-4ef4-8b29-77839e1c11e8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:35.049180 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-dba2d457-0ec1-4ef4-8b29-77839e1c11e8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:35.057768 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-dba2d457-0ec1-4ef4-8b29-77839e1c11e8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.152985 Jul 20 19:42:35.058343 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1315/1946] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:34 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:42:35.063522 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-5a5e2f05-0f40-446e-8911-537c95e920c7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:35.063692 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-5a5e2f05-0f40-446e-8911-537c95e920c7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:35.065257 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_api:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:42:35.071375 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5a5e2f05-0f40-446e-8911-537c95e920c7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:35.071819 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5a5e2f05-0f40-446e-8911-537c95e920c7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:35.072587 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5a5e2f05-0f40-446e-8911-537c95e920c7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:35.073018 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5a5e2f05-0f40-446e-8911-537c95e920c7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:35.135237 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-5a5e2f05-0f40-446e-8911-537c95e920c7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:35.142795 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-5a5e2f05-0f40-446e-8911-537c95e920c7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.083508 Jul 20 19:42:35.143358 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1316/1947] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:35 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:42:36.075824 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e8ea6347-8dbc-4927-bc06-0f61bd95ee7e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:36.076511 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e8ea6347-8dbc-4927-bc06-0f61bd95ee7e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:36.083536 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e8ea6347-8dbc-4927-bc06-0f61bd95ee7e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:36.083984 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e8ea6347-8dbc-4927-bc06-0f61bd95ee7e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:36.084743 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e8ea6347-8dbc-4927-bc06-0f61bd95ee7e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:36.085176 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e8ea6347-8dbc-4927-bc06-0f61bd95ee7e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:36.224717 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e8ea6347-8dbc-4927-bc06-0f61bd95ee7e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:36.232535 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e8ea6347-8dbc-4927-bc06-0f61bd95ee7e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.160564 Jul 20 19:42:36.233095 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1317/1948] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:36 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:42:36.237924 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-37d8f692-7d62-4724-8723-2b86d1b4bcc2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:36.238707 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-37d8f692-7d62-4724-8723-2b86d1b4bcc2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:36.244375 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-37d8f692-7d62-4724-8723-2b86d1b4bcc2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:36.244816 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-37d8f692-7d62-4724-8723-2b86d1b4bcc2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:36.245591 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-37d8f692-7d62-4724-8723-2b86d1b4bcc2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:36.246028 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-37d8f692-7d62-4724-8723-2b86d1b4bcc2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:36.308839 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-37d8f692-7d62-4724-8723-2b86d1b4bcc2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:36.317227 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-37d8f692-7d62-4724-8723-2b86d1b4bcc2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.083076 Jul 20 19:42:36.317853 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1318/1949] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:36 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:42:37.250014 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-54cd6820-3c0b-40ce-8913-61a33a33fd4f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:37.250735 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-54cd6820-3c0b-40ce-8913-61a33a33fd4f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:37.258228 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-54cd6820-3c0b-40ce-8913-61a33a33fd4f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:37.258670 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-54cd6820-3c0b-40ce-8913-61a33a33fd4f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:37.259472 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-54cd6820-3c0b-40ce-8913-61a33a33fd4f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:37.260015 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-54cd6820-3c0b-40ce-8913-61a33a33fd4f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:37.398427 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-54cd6820-3c0b-40ce-8913-61a33a33fd4f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:37.406047 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-54cd6820-3c0b-40ce-8913-61a33a33fd4f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.159854 Jul 20 19:42:37.406614 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1319/1950] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:37 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:42:37.411703 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-8b35f660-d0e8-4ad9-a9fb-95e399a366c2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:37.412374 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-8b35f660-d0e8-4ad9-a9fb-95e399a366c2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:37.418708 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8b35f660-d0e8-4ad9-a9fb-95e399a366c2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:37.419257 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8b35f660-d0e8-4ad9-a9fb-95e399a366c2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:37.420023 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8b35f660-d0e8-4ad9-a9fb-95e399a366c2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:37.420447 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8b35f660-d0e8-4ad9-a9fb-95e399a366c2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:37.500779 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8b35f660-d0e8-4ad9-a9fb-95e399a366c2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:37.509092 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-8b35f660-d0e8-4ad9-a9fb-95e399a366c2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.101482 Jul 20 19:42:37.509713 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1320/1951] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:37 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:42:38.423748 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-9453601e-5f19-4f09-b4d1-761b9a819446 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:38.424447 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-9453601e-5f19-4f09-b4d1-761b9a819446 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:38.431852 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9453601e-5f19-4f09-b4d1-761b9a819446 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:38.432293 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9453601e-5f19-4f09-b4d1-761b9a819446 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:38.433040 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9453601e-5f19-4f09-b4d1-761b9a819446 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:38.433467 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9453601e-5f19-4f09-b4d1-761b9a819446 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:38.568802 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-9453601e-5f19-4f09-b4d1-761b9a819446 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:38.576277 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-9453601e-5f19-4f09-b4d1-761b9a819446 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.156330 Jul 20 19:42:38.576780 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1321/1952] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:38 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:42:38.581141 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-b795c4d6-106e-4cb2-a724-fd65ddec158c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:38.582417 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-b795c4d6-106e-4cb2-a724-fd65ddec158c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:38.588013 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b795c4d6-106e-4cb2-a724-fd65ddec158c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:38.588460 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b795c4d6-106e-4cb2-a724-fd65ddec158c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:38.589217 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b795c4d6-106e-4cb2-a724-fd65ddec158c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:38.589698 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b795c4d6-106e-4cb2-a724-fd65ddec158c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:38.651123 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-b795c4d6-106e-4cb2-a724-fd65ddec158c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:38.658776 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-b795c4d6-106e-4cb2-a724-fd65ddec158c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.081058 Jul 20 19:42:38.659343 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1322/1953] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:38 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:42:39.594126 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-db08d638-262d-456f-b528-e691fd598af6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:39.594765 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-db08d638-262d-456f-b528-e691fd598af6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:39.602318 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-db08d638-262d-456f-b528-e691fd598af6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:39.602745 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-db08d638-262d-456f-b528-e691fd598af6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:39.603510 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-db08d638-262d-456f-b528-e691fd598af6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:39.603944 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-db08d638-262d-456f-b528-e691fd598af6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:39.739274 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-db08d638-262d-456f-b528-e691fd598af6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:39.746764 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-db08d638-262d-456f-b528-e691fd598af6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.156579 Jul 20 19:42:39.747332 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1323/1954] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:39 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:42:39.751750 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-941cad25-5fcb-44de-a56c-ddf28198f55e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:39.752350 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-941cad25-5fcb-44de-a56c-ddf28198f55e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:39.758645 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-941cad25-5fcb-44de-a56c-ddf28198f55e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:39.759091 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-941cad25-5fcb-44de-a56c-ddf28198f55e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:39.759854 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-941cad25-5fcb-44de-a56c-ddf28198f55e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:39.760288 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-941cad25-5fcb-44de-a56c-ddf28198f55e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:39.821254 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-941cad25-5fcb-44de-a56c-ddf28198f55e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:39.828680 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-941cad25-5fcb-44de-a56c-ddf28198f55e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080416 Jul 20 19:42:39.829231 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1324/1955] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:39 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:42:40.764654 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-f67cc60b-ccd5-4688-8e9e-013b80121a8f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:40.765340 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-f67cc60b-ccd5-4688-8e9e-013b80121a8f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:40.772345 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f67cc60b-ccd5-4688-8e9e-013b80121a8f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:40.772781 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f67cc60b-ccd5-4688-8e9e-013b80121a8f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:40.773548 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f67cc60b-ccd5-4688-8e9e-013b80121a8f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:40.773983 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f67cc60b-ccd5-4688-8e9e-013b80121a8f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:40.912325 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-f67cc60b-ccd5-4688-8e9e-013b80121a8f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:40.919861 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-f67cc60b-ccd5-4688-8e9e-013b80121a8f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.159140 Jul 20 19:42:40.920422 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1325/1956] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:40 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:42:40.924861 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-275e3f52-f798-487d-97b9-fe1e6d0bacb7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:40.925494 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-275e3f52-f798-487d-97b9-fe1e6d0bacb7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:40.931540 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-275e3f52-f798-487d-97b9-fe1e6d0bacb7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:40.931993 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-275e3f52-f798-487d-97b9-fe1e6d0bacb7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:40.932753 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-275e3f52-f798-487d-97b9-fe1e6d0bacb7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:40.933187 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-275e3f52-f798-487d-97b9-fe1e6d0bacb7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:40.998520 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-275e3f52-f798-487d-97b9-fe1e6d0bacb7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:41.006135 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-275e3f52-f798-487d-97b9-fe1e6d0bacb7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.084767 Jul 20 19:42:41.006699 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1326/1957] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:40 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:42:41.939089 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-92315de9-bbf2-4556-97a2-015bb7eeb159 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:41.939928 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-92315de9-bbf2-4556-97a2-015bb7eeb159 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:41.948494 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-92315de9-bbf2-4556-97a2-015bb7eeb159 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:41.949051 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-92315de9-bbf2-4556-97a2-015bb7eeb159 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:41.950119 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-92315de9-bbf2-4556-97a2-015bb7eeb159 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:41.950706 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-92315de9-bbf2-4556-97a2-015bb7eeb159 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:41.955979 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:42:42.091200 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-92315de9-bbf2-4556-97a2-015bb7eeb159 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:42.099874 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-92315de9-bbf2-4556-97a2-015bb7eeb159 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.165994 Jul 20 19:42:42.100451 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1327/1958] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:41 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:42:42.104918 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d2edb71c-9892-4a70-bd7b-0cd63fb98e78 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:42.105561 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d2edb71c-9892-4a70-bd7b-0cd63fb98e78 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:42.111763 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d2edb71c-9892-4a70-bd7b-0cd63fb98e78 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:42.112215 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d2edb71c-9892-4a70-bd7b-0cd63fb98e78 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:42.113876 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d2edb71c-9892-4a70-bd7b-0cd63fb98e78 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:42.114311 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d2edb71c-9892-4a70-bd7b-0cd63fb98e78 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:42.177743 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d2edb71c-9892-4a70-bd7b-0cd63fb98e78 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:42.185276 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d2edb71c-9892-4a70-bd7b-0cd63fb98e78 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.083851 Jul 20 19:42:42.185883 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1328/1959] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:42 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:42:43.119661 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4d253b27-6805-428a-acaf-b3a76160df96 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:43.120334 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-4d253b27-6805-428a-acaf-b3a76160df96 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:43.128110 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4d253b27-6805-428a-acaf-b3a76160df96 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:43.128654 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4d253b27-6805-428a-acaf-b3a76160df96 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:43.129481 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4d253b27-6805-428a-acaf-b3a76160df96 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:43.130057 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4d253b27-6805-428a-acaf-b3a76160df96 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:43.267259 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-4d253b27-6805-428a-acaf-b3a76160df96 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:43.275194 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-4d253b27-6805-428a-acaf-b3a76160df96 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.159410 Jul 20 19:42:43.275754 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1329/1960] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:43 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:42:43.280075 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-5d143226-91f4-48a5-bcd9-5a282c111db2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:43.280658 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-5d143226-91f4-48a5-bcd9-5a282c111db2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:43.286948 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5d143226-91f4-48a5-bcd9-5a282c111db2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:43.287383 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5d143226-91f4-48a5-bcd9-5a282c111db2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:43.288125 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5d143226-91f4-48a5-bcd9-5a282c111db2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:43.288549 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5d143226-91f4-48a5-bcd9-5a282c111db2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:43.351258 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-5d143226-91f4-48a5-bcd9-5a282c111db2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:43.358738 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-5d143226-91f4-48a5-bcd9-5a282c111db2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.082043 Jul 20 19:42:43.359296 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1330/1961] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:43 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:42:44.293289 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-27211a42-152f-4fb0-b2af-3356e3a703f5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:44.294017 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-27211a42-152f-4fb0-b2af-3356e3a703f5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:44.301279 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-27211a42-152f-4fb0-b2af-3356e3a703f5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:44.301762 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-27211a42-152f-4fb0-b2af-3356e3a703f5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:44.302576 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-27211a42-152f-4fb0-b2af-3356e3a703f5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:44.303008 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-27211a42-152f-4fb0-b2af-3356e3a703f5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:44.443934 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-27211a42-152f-4fb0-b2af-3356e3a703f5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:44.453383 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-27211a42-152f-4fb0-b2af-3356e3a703f5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.164028 Jul 20 19:42:44.453984 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1331/1962] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:44 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:42:44.458574 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-aa8dca7a-65a1-4e73-b591-233fd814222b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:44.459177 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-aa8dca7a-65a1-4e73-b591-233fd814222b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:44.465099 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aa8dca7a-65a1-4e73-b591-233fd814222b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:44.465573 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aa8dca7a-65a1-4e73-b591-233fd814222b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:44.466331 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aa8dca7a-65a1-4e73-b591-233fd814222b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:44.466759 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aa8dca7a-65a1-4e73-b591-233fd814222b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:44.534244 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-aa8dca7a-65a1-4e73-b591-233fd814222b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:44.541883 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-aa8dca7a-65a1-4e73-b591-233fd814222b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.086924 Jul 20 19:42:44.542450 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1332/1963] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:44 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:42:45.471009 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-890a9341-e4ac-4681-ab6c-764f7505a015 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:45.471945 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-890a9341-e4ac-4681-ab6c-764f7505a015 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:45.481865 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-890a9341-e4ac-4681-ab6c-764f7505a015 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:45.482316 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-890a9341-e4ac-4681-ab6c-764f7505a015 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:45.483077 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-890a9341-e4ac-4681-ab6c-764f7505a015 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:45.483508 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-890a9341-e4ac-4681-ab6c-764f7505a015 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:45.614603 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-890a9341-e4ac-4681-ab6c-764f7505a015 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:45.622072 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-890a9341-e4ac-4681-ab6c-764f7505a015 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.155219 Jul 20 19:42:45.622631 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1333/1964] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:45 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:42:45.626998 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-bbce1fde-ff17-4e1f-965c-2b7b325f1ca6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:45.627600 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-bbce1fde-ff17-4e1f-965c-2b7b325f1ca6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:45.634087 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bbce1fde-ff17-4e1f-965c-2b7b325f1ca6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:45.634528 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bbce1fde-ff17-4e1f-965c-2b7b325f1ca6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:45.635297 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bbce1fde-ff17-4e1f-965c-2b7b325f1ca6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:45.635731 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bbce1fde-ff17-4e1f-965c-2b7b325f1ca6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:45.696720 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-bbce1fde-ff17-4e1f-965c-2b7b325f1ca6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:45.704374 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-bbce1fde-ff17-4e1f-965c-2b7b325f1ca6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080801 Jul 20 19:42:45.704931 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1334/1965] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:45 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:42:46.640132 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-6df51d91-b2c1-44c4-9cc8-27394e85c162 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:46.640825 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-6df51d91-b2c1-44c4-9cc8-27394e85c162 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:46.647366 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6df51d91-b2c1-44c4-9cc8-27394e85c162 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:46.647814 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6df51d91-b2c1-44c4-9cc8-27394e85c162 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:46.648565 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6df51d91-b2c1-44c4-9cc8-27394e85c162 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:46.648993 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6df51d91-b2c1-44c4-9cc8-27394e85c162 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:46.795030 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6df51d91-b2c1-44c4-9cc8-27394e85c162 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:46.804179 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-6df51d91-b2c1-44c4-9cc8-27394e85c162 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.167926 Jul 20 19:42:46.804888 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1335/1966] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:46 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:42:46.809444 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-06f10e79-5150-438e-b9b4-ba950b12f1c3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:46.810064 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-06f10e79-5150-438e-b9b4-ba950b12f1c3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:46.816781 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-06f10e79-5150-438e-b9b4-ba950b12f1c3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:46.817395 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-06f10e79-5150-438e-b9b4-ba950b12f1c3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:46.818199 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-06f10e79-5150-438e-b9b4-ba950b12f1c3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:46.818758 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-06f10e79-5150-438e-b9b4-ba950b12f1c3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:46.887348 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-06f10e79-5150-438e-b9b4-ba950b12f1c3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:46.895495 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-06f10e79-5150-438e-b9b4-ba950b12f1c3 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.089531 Jul 20 19:42:46.896081 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1336/1967] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:46 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:42:47.822843 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-cd9122df-d0e3-442a-bea0-e22ef1afbc7e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:47.823704 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-cd9122df-d0e3-442a-bea0-e22ef1afbc7e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:47.830661 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cd9122df-d0e3-442a-bea0-e22ef1afbc7e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:47.831366 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cd9122df-d0e3-442a-bea0-e22ef1afbc7e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:47.832383 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cd9122df-d0e3-442a-bea0-e22ef1afbc7e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:47.832830 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cd9122df-d0e3-442a-bea0-e22ef1afbc7e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:48.034570 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-cd9122df-d0e3-442a-bea0-e22ef1afbc7e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:48.043132 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-cd9122df-d0e3-442a-bea0-e22ef1afbc7e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.224269 Jul 20 19:42:48.043802 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1337/1968] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:47 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:42:48.049053 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-fccd882c-49c2-4d6f-9dd8-96061167c143 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:48.049917 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-fccd882c-49c2-4d6f-9dd8-96061167c143 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:48.056516 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fccd882c-49c2-4d6f-9dd8-96061167c143 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:48.056958 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fccd882c-49c2-4d6f-9dd8-96061167c143 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:48.057834 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fccd882c-49c2-4d6f-9dd8-96061167c143 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:48.058265 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fccd882c-49c2-4d6f-9dd8-96061167c143 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:48.133327 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-fccd882c-49c2-4d6f-9dd8-96061167c143 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:48.146880 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-fccd882c-49c2-4d6f-9dd8-96061167c143 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.101703 Jul 20 19:42:48.147751 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1338/1969] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:48 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:42:49.061899 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-2b7a4728-03dc-4537-8b7e-6eac2d37e60a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:49.062630 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-2b7a4728-03dc-4537-8b7e-6eac2d37e60a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:49.069684 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2b7a4728-03dc-4537-8b7e-6eac2d37e60a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:49.070133 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2b7a4728-03dc-4537-8b7e-6eac2d37e60a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:49.070882 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2b7a4728-03dc-4537-8b7e-6eac2d37e60a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:49.071312 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2b7a4728-03dc-4537-8b7e-6eac2d37e60a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:49.204700 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-2b7a4728-03dc-4537-8b7e-6eac2d37e60a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:49.212646 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-2b7a4728-03dc-4537-8b7e-6eac2d37e60a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.154736 Jul 20 19:42:49.213197 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1339/1970] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:49 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:42:49.217487 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-f2bdab66-a0ff-4f98-b7c5-ac8d5c6253f5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:49.218096 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-f2bdab66-a0ff-4f98-b7c5-ac8d5c6253f5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:49.224383 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f2bdab66-a0ff-4f98-b7c5-ac8d5c6253f5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:49.224823 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f2bdab66-a0ff-4f98-b7c5-ac8d5c6253f5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:49.225598 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f2bdab66-a0ff-4f98-b7c5-ac8d5c6253f5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:49.226031 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f2bdab66-a0ff-4f98-b7c5-ac8d5c6253f5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:49.286614 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-f2bdab66-a0ff-4f98-b7c5-ac8d5c6253f5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:49.293940 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-f2bdab66-a0ff-4f98-b7c5-ac8d5c6253f5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.079750 Jul 20 19:42:49.294495 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1340/1971] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:49 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:42:50.231067 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c7d5b462-45a1-47a3-af8b-8294fcbd6e2c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:50.231735 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c7d5b462-45a1-47a3-af8b-8294fcbd6e2c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:50.238974 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c7d5b462-45a1-47a3-af8b-8294fcbd6e2c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:50.239431 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c7d5b462-45a1-47a3-af8b-8294fcbd6e2c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:50.240221 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c7d5b462-45a1-47a3-af8b-8294fcbd6e2c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:50.240866 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c7d5b462-45a1-47a3-af8b-8294fcbd6e2c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:50.608632 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c7d5b462-45a1-47a3-af8b-8294fcbd6e2c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:50.616374 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c7d5b462-45a1-47a3-af8b-8294fcbd6e2c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.389272 Jul 20 19:42:50.616952 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1341/1972] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:50 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:42:50.621603 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-2bb773f6-1811-4cbb-8ef0-b80ed53c41d9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:50.622212 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-2bb773f6-1811-4cbb-8ef0-b80ed53c41d9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:50.628081 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2bb773f6-1811-4cbb-8ef0-b80ed53c41d9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:50.628642 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2bb773f6-1811-4cbb-8ef0-b80ed53c41d9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:50.629610 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2bb773f6-1811-4cbb-8ef0-b80ed53c41d9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:50.630064 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2bb773f6-1811-4cbb-8ef0-b80ed53c41d9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:50.701528 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-2bb773f6-1811-4cbb-8ef0-b80ed53c41d9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:50.710124 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-2bb773f6-1811-4cbb-8ef0-b80ed53c41d9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.092010 Jul 20 19:42:50.710714 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1342/1973] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:50 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:42:51.633766 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-406fcef4-f04c-485f-b1be-7d37de3c6d10 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:51.634606 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-406fcef4-f04c-485f-b1be-7d37de3c6d10 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:51.641276 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-406fcef4-f04c-485f-b1be-7d37de3c6d10 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:51.641757 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-406fcef4-f04c-485f-b1be-7d37de3c6d10 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:51.642542 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-406fcef4-f04c-485f-b1be-7d37de3c6d10 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:51.642975 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-406fcef4-f04c-485f-b1be-7d37de3c6d10 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:51.799872 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-406fcef4-f04c-485f-b1be-7d37de3c6d10 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:51.802861 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:42:51.809707 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-406fcef4-f04c-485f-b1be-7d37de3c6d10 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.179919 Jul 20 19:42:51.810309 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1343/1974] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:51 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:42:51.815040 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d46249fb-b1dc-401f-9d82-447690b850c5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:51.815643 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d46249fb-b1dc-401f-9d82-447690b850c5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:51.822446 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d46249fb-b1dc-401f-9d82-447690b850c5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:51.822893 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d46249fb-b1dc-401f-9d82-447690b850c5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:51.823671 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d46249fb-b1dc-401f-9d82-447690b850c5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:51.824268 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d46249fb-b1dc-401f-9d82-447690b850c5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:51.889111 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d46249fb-b1dc-401f-9d82-447690b850c5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:51.896758 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d46249fb-b1dc-401f-9d82-447690b850c5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.085477 Jul 20 19:42:51.897332 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1344/1975] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:51 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:42:52.827654 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-97394df8-c4a1-4917-a631-68233234f0a2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:52.828284 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-97394df8-c4a1-4917-a631-68233234f0a2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:52.835262 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-97394df8-c4a1-4917-a631-68233234f0a2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:52.835709 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-97394df8-c4a1-4917-a631-68233234f0a2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:52.836470 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-97394df8-c4a1-4917-a631-68233234f0a2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:52.836908 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-97394df8-c4a1-4917-a631-68233234f0a2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:52.972945 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-97394df8-c4a1-4917-a631-68233234f0a2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:52.981001 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-97394df8-c4a1-4917-a631-68233234f0a2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.157266 Jul 20 19:42:52.981659 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1345/1976] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:52 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:42:52.986019 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4b433706-5d32-4fb4-939a-3ec113814eba tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:52.986600 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-4b433706-5d32-4fb4-939a-3ec113814eba tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:52.992225 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4b433706-5d32-4fb4-939a-3ec113814eba tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:52.992671 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4b433706-5d32-4fb4-939a-3ec113814eba tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:52.993418 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4b433706-5d32-4fb4-939a-3ec113814eba tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:52.993879 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4b433706-5d32-4fb4-939a-3ec113814eba tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:53.058143 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-4b433706-5d32-4fb4-939a-3ec113814eba tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:53.065706 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-4b433706-5d32-4fb4-939a-3ec113814eba tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.083074 Jul 20 19:42:53.066263 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1346/1977] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:52 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:42:53.998077 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-6de5cf8d-71ab-4ffb-8d5d-f5ce83466be9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:53.998761 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-6de5cf8d-71ab-4ffb-8d5d-f5ce83466be9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:54.006183 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6de5cf8d-71ab-4ffb-8d5d-f5ce83466be9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:54.006628 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6de5cf8d-71ab-4ffb-8d5d-f5ce83466be9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:54.007406 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6de5cf8d-71ab-4ffb-8d5d-f5ce83466be9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:54.007833 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6de5cf8d-71ab-4ffb-8d5d-f5ce83466be9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:54.139464 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6de5cf8d-71ab-4ffb-8d5d-f5ce83466be9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:54.147669 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-6de5cf8d-71ab-4ffb-8d5d-f5ce83466be9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.153377 Jul 20 19:42:54.148231 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1347/1978] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:53 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:42:54.152578 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-9f47ba1f-6794-4110-afff-636d9a91711c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:54.153167 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-9f47ba1f-6794-4110-afff-636d9a91711c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:54.158967 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9f47ba1f-6794-4110-afff-636d9a91711c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:54.159406 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9f47ba1f-6794-4110-afff-636d9a91711c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:54.160236 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9f47ba1f-6794-4110-afff-636d9a91711c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:54.160868 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9f47ba1f-6794-4110-afff-636d9a91711c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:54.222380 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-9f47ba1f-6794-4110-afff-636d9a91711c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:54.229978 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-9f47ba1f-6794-4110-afff-636d9a91711c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080721 Jul 20 19:42:54.230667 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1348/1979] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:54 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:42:55.165191 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ff6c4cdc-6c64-4b3d-a2db-49631b17cb5e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:55.165942 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ff6c4cdc-6c64-4b3d-a2db-49631b17cb5e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:55.172556 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ff6c4cdc-6c64-4b3d-a2db-49631b17cb5e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:55.173018 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ff6c4cdc-6c64-4b3d-a2db-49631b17cb5e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:55.173797 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ff6c4cdc-6c64-4b3d-a2db-49631b17cb5e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:55.174232 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ff6c4cdc-6c64-4b3d-a2db-49631b17cb5e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:55.316386 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ff6c4cdc-6c64-4b3d-a2db-49631b17cb5e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:55.325043 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ff6c4cdc-6c64-4b3d-a2db-49631b17cb5e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.164257 Jul 20 19:42:55.325654 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1349/1980] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:55 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:42:55.330136 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-287cd54b-6201-403c-a765-63f6cbc26745 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:55.330738 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-287cd54b-6201-403c-a765-63f6cbc26745 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:55.336846 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-287cd54b-6201-403c-a765-63f6cbc26745 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:55.337297 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-287cd54b-6201-403c-a765-63f6cbc26745 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:55.338097 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-287cd54b-6201-403c-a765-63f6cbc26745 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:55.338533 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-287cd54b-6201-403c-a765-63f6cbc26745 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:55.403209 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-287cd54b-6201-403c-a765-63f6cbc26745 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:55.411568 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-287cd54b-6201-403c-a765-63f6cbc26745 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.084877 Jul 20 19:42:55.412374 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1350/1981] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:55 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:42:56.342931 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c492226f-3b63-4909-847c-363062c91f3c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:56.343530 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c492226f-3b63-4909-847c-363062c91f3c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:56.350470 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c492226f-3b63-4909-847c-363062c91f3c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:56.350910 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c492226f-3b63-4909-847c-363062c91f3c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:56.351657 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c492226f-3b63-4909-847c-363062c91f3c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:56.352084 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c492226f-3b63-4909-847c-363062c91f3c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:56.482844 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c492226f-3b63-4909-847c-363062c91f3c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:56.492526 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c492226f-3b63-4909-847c-363062c91f3c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.153395 Jul 20 19:42:56.493106 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1351/1982] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:56 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:42:56.497531 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-30c5f64a-de73-40ee-adb9-0b4f766fe401 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:56.498123 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-30c5f64a-de73-40ee-adb9-0b4f766fe401 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:56.503906 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-30c5f64a-de73-40ee-adb9-0b4f766fe401 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:56.504922 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-30c5f64a-de73-40ee-adb9-0b4f766fe401 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:56.505889 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-30c5f64a-de73-40ee-adb9-0b4f766fe401 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:56.506319 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-30c5f64a-de73-40ee-adb9-0b4f766fe401 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:56.572274 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-30c5f64a-de73-40ee-adb9-0b4f766fe401 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:56.579763 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-30c5f64a-de73-40ee-adb9-0b4f766fe401 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.085635 Jul 20 19:42:56.580257 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1352/1983] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:56 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:42:57.509602 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-52a61fe8-107a-4217-ad23-740d19682ef5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:57.510202 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-52a61fe8-107a-4217-ad23-740d19682ef5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:57.516499 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-52a61fe8-107a-4217-ad23-740d19682ef5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:57.516942 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-52a61fe8-107a-4217-ad23-740d19682ef5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:57.517716 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-52a61fe8-107a-4217-ad23-740d19682ef5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:57.518145 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-52a61fe8-107a-4217-ad23-740d19682ef5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:57.655240 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-52a61fe8-107a-4217-ad23-740d19682ef5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:57.664853 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-52a61fe8-107a-4217-ad23-740d19682ef5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.159071 Jul 20 19:42:57.672553 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1353/1984] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:57 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:42:57.672553 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d0a66e62-7bd7-4440-83ca-6d54d1ff5c61 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:57.672553 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d0a66e62-7bd7-4440-83ca-6d54d1ff5c61 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:57.677268 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d0a66e62-7bd7-4440-83ca-6d54d1ff5c61 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:57.677740 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d0a66e62-7bd7-4440-83ca-6d54d1ff5c61 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:57.678504 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d0a66e62-7bd7-4440-83ca-6d54d1ff5c61 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:57.678934 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d0a66e62-7bd7-4440-83ca-6d54d1ff5c61 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:57.742447 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d0a66e62-7bd7-4440-83ca-6d54d1ff5c61 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:57.749960 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d0a66e62-7bd7-4440-83ca-6d54d1ff5c61 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.083464 Jul 20 19:42:57.750551 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1354/1985] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:57 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:42:58.682872 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-6c6c684a-7464-4a2d-87cf-7996a507ecaf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:58.683564 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-6c6c684a-7464-4a2d-87cf-7996a507ecaf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:58.692261 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6c6c684a-7464-4a2d-87cf-7996a507ecaf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:58.692712 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6c6c684a-7464-4a2d-87cf-7996a507ecaf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:58.693483 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6c6c684a-7464-4a2d-87cf-7996a507ecaf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:58.693941 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6c6c684a-7464-4a2d-87cf-7996a507ecaf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:58.831754 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6c6c684a-7464-4a2d-87cf-7996a507ecaf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:58.839827 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-6c6c684a-7464-4a2d-87cf-7996a507ecaf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.161131 Jul 20 19:42:58.840385 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1355/1986] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:58 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:42:58.844666 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e82c5b2b-6bd6-46b7-bae2-abf1c4c08a81 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:58.845257 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e82c5b2b-6bd6-46b7-bae2-abf1c4c08a81 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:58.851681 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e82c5b2b-6bd6-46b7-bae2-abf1c4c08a81 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:58.852119 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e82c5b2b-6bd6-46b7-bae2-abf1c4c08a81 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:58.852861 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e82c5b2b-6bd6-46b7-bae2-abf1c4c08a81 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:58.853285 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e82c5b2b-6bd6-46b7-bae2-abf1c4c08a81 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:58.914090 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e82c5b2b-6bd6-46b7-bae2-abf1c4c08a81 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:58.921542 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e82c5b2b-6bd6-46b7-bae2-abf1c4c08a81 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080184 Jul 20 19:42:58.922100 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1356/1987] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:58 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:42:59.857829 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d25f3ba5-4388-4ae6-b6ed-f8f45b7d817b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:59.858531 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d25f3ba5-4388-4ae6-b6ed-f8f45b7d817b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:59.865215 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d25f3ba5-4388-4ae6-b6ed-f8f45b7d817b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:59.865701 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d25f3ba5-4388-4ae6-b6ed-f8f45b7d817b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:59.866455 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d25f3ba5-4388-4ae6-b6ed-f8f45b7d817b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:59.866885 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d25f3ba5-4388-4ae6-b6ed-f8f45b7d817b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:59.995854 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d25f3ba5-4388-4ae6-b6ed-f8f45b7d817b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:00.003385 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d25f3ba5-4388-4ae6-b6ed-f8f45b7d817b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.149462 Jul 20 19:43:00.003953 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1357/1988] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:59 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:43:00.008967 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-0ec73328-499b-4412-959d-9c8c4435e067 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:00.009603 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-0ec73328-499b-4412-959d-9c8c4435e067 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:00.015162 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0ec73328-499b-4412-959d-9c8c4435e067 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:00.015622 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0ec73328-499b-4412-959d-9c8c4435e067 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:00.016404 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0ec73328-499b-4412-959d-9c8c4435e067 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:00.016882 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0ec73328-499b-4412-959d-9c8c4435e067 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:00.091353 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0ec73328-499b-4412-959d-9c8c4435e067 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:00.099262 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-0ec73328-499b-4412-959d-9c8c4435e067 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.093714 Jul 20 19:43:00.099831 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1358/1989] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:00 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:43:01.020704 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-fb3b0484-e5ec-49b6-bcaa-eed4a9b0dfca tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:01.021390 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-fb3b0484-e5ec-49b6-bcaa-eed4a9b0dfca tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:01.028095 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fb3b0484-e5ec-49b6-bcaa-eed4a9b0dfca tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:01.028545 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fb3b0484-e5ec-49b6-bcaa-eed4a9b0dfca tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:01.029307 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fb3b0484-e5ec-49b6-bcaa-eed4a9b0dfca tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:01.029767 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fb3b0484-e5ec-49b6-bcaa-eed4a9b0dfca tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:01.160238 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-fb3b0484-e5ec-49b6-bcaa-eed4a9b0dfca tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:01.168653 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-fb3b0484-e5ec-49b6-bcaa-eed4a9b0dfca tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.152366 Jul 20 19:43:01.169221 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1359/1990] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:01 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:43:01.173609 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-6c641da4-3afd-45bb-9191-f71385ec80d0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:01.174211 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-6c641da4-3afd-45bb-9191-f71385ec80d0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:01.179906 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6c641da4-3afd-45bb-9191-f71385ec80d0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:01.180348 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6c641da4-3afd-45bb-9191-f71385ec80d0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:01.181101 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6c641da4-3afd-45bb-9191-f71385ec80d0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:01.181549 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6c641da4-3afd-45bb-9191-f71385ec80d0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:01.196059 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:43:01.244222 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6c641da4-3afd-45bb-9191-f71385ec80d0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:01.251659 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-6c641da4-3afd-45bb-9191-f71385ec80d0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.081473 Jul 20 19:43:01.252210 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1360/1991] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:01 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:43:02.185032 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-6aed917b-35db-49af-902d-cfaae96c9dce tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:02.185749 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-6aed917b-35db-49af-902d-cfaae96c9dce tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:02.192309 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6aed917b-35db-49af-902d-cfaae96c9dce tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:02.192757 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6aed917b-35db-49af-902d-cfaae96c9dce tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:02.193528 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6aed917b-35db-49af-902d-cfaae96c9dce tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:02.193966 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6aed917b-35db-49af-902d-cfaae96c9dce tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:02.327800 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6aed917b-35db-49af-902d-cfaae96c9dce tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:02.335535 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-6aed917b-35db-49af-902d-cfaae96c9dce tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.154335 Jul 20 19:43:02.336099 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1361/1992] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:02 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:43:02.340441 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c9419e52-09de-4aa9-91a2-0a9904a1b5b0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:02.341040 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c9419e52-09de-4aa9-91a2-0a9904a1b5b0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:02.346879 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c9419e52-09de-4aa9-91a2-0a9904a1b5b0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:02.347329 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c9419e52-09de-4aa9-91a2-0a9904a1b5b0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:02.348581 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c9419e52-09de-4aa9-91a2-0a9904a1b5b0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:02.349017 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c9419e52-09de-4aa9-91a2-0a9904a1b5b0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:02.408534 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c9419e52-09de-4aa9-91a2-0a9904a1b5b0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:02.416521 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c9419e52-09de-4aa9-91a2-0a9904a1b5b0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.079482 Jul 20 19:43:02.417077 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1362/1993] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:02 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:43:03.352625 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-8ec45513-c597-49d9-84ee-ba2a1d02044f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:03.353257 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-8ec45513-c597-49d9-84ee-ba2a1d02044f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:03.359735 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8ec45513-c597-49d9-84ee-ba2a1d02044f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:03.360174 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8ec45513-c597-49d9-84ee-ba2a1d02044f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:03.360918 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8ec45513-c597-49d9-84ee-ba2a1d02044f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:03.361346 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8ec45513-c597-49d9-84ee-ba2a1d02044f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:03.491986 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8ec45513-c597-49d9-84ee-ba2a1d02044f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:03.499305 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-8ec45513-c597-49d9-84ee-ba2a1d02044f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.150748 Jul 20 19:43:03.499913 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1363/1994] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:03 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:43:03.504243 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-0d04e168-7f3d-4197-8665-43e5eef41801 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:03.504834 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-0d04e168-7f3d-4197-8665-43e5eef41801 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:03.511097 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0d04e168-7f3d-4197-8665-43e5eef41801 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:03.511531 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0d04e168-7f3d-4197-8665-43e5eef41801 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:03.512275 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0d04e168-7f3d-4197-8665-43e5eef41801 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:03.512699 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0d04e168-7f3d-4197-8665-43e5eef41801 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:03.576897 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0d04e168-7f3d-4197-8665-43e5eef41801 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:03.584636 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-0d04e168-7f3d-4197-8665-43e5eef41801 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.083787 Jul 20 19:43:03.585196 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1364/1995] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:03 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:43:04.517323 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-55fdea29-f875-483f-9a31-a49448db7640 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:04.518253 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-55fdea29-f875-483f-9a31-a49448db7640 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:04.525272 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-55fdea29-f875-483f-9a31-a49448db7640 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:04.526382 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-55fdea29-f875-483f-9a31-a49448db7640 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:04.526715 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-55fdea29-f875-483f-9a31-a49448db7640 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:04.527151 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-55fdea29-f875-483f-9a31-a49448db7640 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:04.658757 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-55fdea29-f875-483f-9a31-a49448db7640 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:04.666464 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-55fdea29-f875-483f-9a31-a49448db7640 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.153160 Jul 20 19:43:04.667022 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1365/1996] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:04 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:43:04.671443 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ab9cdbd3-1e61-4ace-9eb9-0da48cee8fed tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:04.672178 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ab9cdbd3-1e61-4ace-9eb9-0da48cee8fed tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:04.673772 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_api:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:43:04.678933 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ab9cdbd3-1e61-4ace-9eb9-0da48cee8fed tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:04.679379 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ab9cdbd3-1e61-4ace-9eb9-0da48cee8fed tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:04.680148 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ab9cdbd3-1e61-4ace-9eb9-0da48cee8fed tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:04.680565 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ab9cdbd3-1e61-4ace-9eb9-0da48cee8fed tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:04.742148 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ab9cdbd3-1e61-4ace-9eb9-0da48cee8fed tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:04.749493 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ab9cdbd3-1e61-4ace-9eb9-0da48cee8fed tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.081539 Jul 20 19:43:04.750102 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1366/1997] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:04 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:43:05.684036 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-15e8481d-1d29-4125-a3aa-05c84ae7d829 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:05.684723 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-15e8481d-1d29-4125-a3aa-05c84ae7d829 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:05.691300 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-15e8481d-1d29-4125-a3aa-05c84ae7d829 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:05.691748 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-15e8481d-1d29-4125-a3aa-05c84ae7d829 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:05.692508 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-15e8481d-1d29-4125-a3aa-05c84ae7d829 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:05.693555 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-15e8481d-1d29-4125-a3aa-05c84ae7d829 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:05.824755 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-15e8481d-1d29-4125-a3aa-05c84ae7d829 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:05.832369 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-15e8481d-1d29-4125-a3aa-05c84ae7d829 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.152163 Jul 20 19:43:05.832939 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1367/1998] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:05 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:43:05.837797 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-fd2f75b8-36cc-48f9-a6ba-737e14fc9240 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:05.838400 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-fd2f75b8-36cc-48f9-a6ba-737e14fc9240 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:05.844060 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fd2f75b8-36cc-48f9-a6ba-737e14fc9240 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:05.844504 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fd2f75b8-36cc-48f9-a6ba-737e14fc9240 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:05.845258 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fd2f75b8-36cc-48f9-a6ba-737e14fc9240 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:05.845731 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fd2f75b8-36cc-48f9-a6ba-737e14fc9240 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:05.907583 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-fd2f75b8-36cc-48f9-a6ba-737e14fc9240 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:05.915272 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-fd2f75b8-36cc-48f9-a6ba-737e14fc9240 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080845 Jul 20 19:43:05.915837 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1368/1999] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:05 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:43:06.851066 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-48ee8201-2691-47b8-8bf0-6e10bdb62e84 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:06.851777 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-48ee8201-2691-47b8-8bf0-6e10bdb62e84 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:06.858205 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-48ee8201-2691-47b8-8bf0-6e10bdb62e84 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:06.858653 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-48ee8201-2691-47b8-8bf0-6e10bdb62e84 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:06.859453 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-48ee8201-2691-47b8-8bf0-6e10bdb62e84 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:06.859891 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-48ee8201-2691-47b8-8bf0-6e10bdb62e84 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:06.988892 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-48ee8201-2691-47b8-8bf0-6e10bdb62e84 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:06.997297 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-48ee8201-2691-47b8-8bf0-6e10bdb62e84 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.150990 Jul 20 19:43:06.997901 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1369/2000] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:06 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:43:07.002310 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-5be950f5-877c-4347-ace8-e87fba549266 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:07.002912 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-5be950f5-877c-4347-ace8-e87fba549266 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:07.008694 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5be950f5-877c-4347-ace8-e87fba549266 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:07.009145 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5be950f5-877c-4347-ace8-e87fba549266 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:07.009942 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5be950f5-877c-4347-ace8-e87fba549266 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:07.010379 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5be950f5-877c-4347-ace8-e87fba549266 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:07.075659 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-5be950f5-877c-4347-ace8-e87fba549266 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:07.083005 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-5be950f5-877c-4347-ace8-e87fba549266 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.084165 Jul 20 19:43:07.083570 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1370/2001] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:06 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:43:08.014194 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-1e84591d-8423-444e-a089-169e2efd1341 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:08.014863 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-1e84591d-8423-444e-a089-169e2efd1341 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:08.021410 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1e84591d-8423-444e-a089-169e2efd1341 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:08.022518 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1e84591d-8423-444e-a089-169e2efd1341 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:08.023285 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1e84591d-8423-444e-a089-169e2efd1341 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:08.023722 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1e84591d-8423-444e-a089-169e2efd1341 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:08.161787 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1e84591d-8423-444e-a089-169e2efd1341 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:08.169322 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-1e84591d-8423-444e-a089-169e2efd1341 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.158972 Jul 20 19:43:08.169937 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1371/2002] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:08 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:43:08.174288 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-382ac8e7-e7df-4318-b996-04c9505b3aa4 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:08.174877 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-382ac8e7-e7df-4318-b996-04c9505b3aa4 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:08.180442 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-382ac8e7-e7df-4318-b996-04c9505b3aa4 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:08.180881 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-382ac8e7-e7df-4318-b996-04c9505b3aa4 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:08.181657 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-382ac8e7-e7df-4318-b996-04c9505b3aa4 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:08.182085 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-382ac8e7-e7df-4318-b996-04c9505b3aa4 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:08.243327 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-382ac8e7-e7df-4318-b996-04c9505b3aa4 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:08.250741 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-382ac8e7-e7df-4318-b996-04c9505b3aa4 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.079881 Jul 20 19:43:08.251296 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1372/2003] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:08 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:43:09.185497 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-9419a92b-4b78-4f65-9503-3f319f5802d0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:09.186200 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-9419a92b-4b78-4f65-9503-3f319f5802d0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:09.192531 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9419a92b-4b78-4f65-9503-3f319f5802d0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:09.192971 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9419a92b-4b78-4f65-9503-3f319f5802d0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:09.194276 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9419a92b-4b78-4f65-9503-3f319f5802d0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:09.194789 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9419a92b-4b78-4f65-9503-3f319f5802d0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:09.329957 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-9419a92b-4b78-4f65-9503-3f319f5802d0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:09.338940 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-9419a92b-4b78-4f65-9503-3f319f5802d0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.157270 Jul 20 19:43:09.339505 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1373/2004] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:09 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:43:09.343843 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e77f1eed-817f-43a1-83fc-47cbda088d60 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:09.344439 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e77f1eed-817f-43a1-83fc-47cbda088d60 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:09.351041 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e77f1eed-817f-43a1-83fc-47cbda088d60 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:09.351591 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e77f1eed-817f-43a1-83fc-47cbda088d60 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:09.352363 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e77f1eed-817f-43a1-83fc-47cbda088d60 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:09.352779 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e77f1eed-817f-43a1-83fc-47cbda088d60 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:09.414061 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e77f1eed-817f-43a1-83fc-47cbda088d60 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:09.421457 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e77f1eed-817f-43a1-83fc-47cbda088d60 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.081007 Jul 20 19:43:09.422048 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1374/2005] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:09 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:43:10.356379 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-cb1a6a09-b6b1-44c8-b98b-9adc74a345f1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:10.357007 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-cb1a6a09-b6b1-44c8-b98b-9adc74a345f1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:10.363571 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cb1a6a09-b6b1-44c8-b98b-9adc74a345f1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:10.364013 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cb1a6a09-b6b1-44c8-b98b-9adc74a345f1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:10.364772 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cb1a6a09-b6b1-44c8-b98b-9adc74a345f1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:10.365200 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cb1a6a09-b6b1-44c8-b98b-9adc74a345f1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:10.496630 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-cb1a6a09-b6b1-44c8-b98b-9adc74a345f1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:10.504203 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-cb1a6a09-b6b1-44c8-b98b-9adc74a345f1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.151597 Jul 20 19:43:10.504705 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1375/2006] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:10 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:43:10.510062 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-0c28d3e7-e3c0-42a3-927e-cc9e3376def8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:10.510669 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-0c28d3e7-e3c0-42a3-927e-cc9e3376def8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:10.516431 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0c28d3e7-e3c0-42a3-927e-cc9e3376def8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:10.516888 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0c28d3e7-e3c0-42a3-927e-cc9e3376def8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:10.517692 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0c28d3e7-e3c0-42a3-927e-cc9e3376def8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:10.518128 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0c28d3e7-e3c0-42a3-927e-cc9e3376def8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:10.583441 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0c28d3e7-e3c0-42a3-927e-cc9e3376def8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:10.590957 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-0c28d3e7-e3c0-42a3-927e-cc9e3376def8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.085279 Jul 20 19:43:10.591513 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1376/2007] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:10 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:43:11.525814 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-3025319c-f468-44d1-a441-48d391bc6084 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:11.526498 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-3025319c-f468-44d1-a441-48d391bc6084 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:11.533081 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3025319c-f468-44d1-a441-48d391bc6084 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:11.533557 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3025319c-f468-44d1-a441-48d391bc6084 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:11.534332 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3025319c-f468-44d1-a441-48d391bc6084 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:11.534772 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3025319c-f468-44d1-a441-48d391bc6084 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:11.539602 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:43:11.665375 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3025319c-f468-44d1-a441-48d391bc6084 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:11.672883 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-3025319c-f468-44d1-a441-48d391bc6084 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.151627 Jul 20 19:43:11.673473 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1377/2008] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:11 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:43:11.677846 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d6f9b148-ad8e-4d0f-96ef-f2139e95968a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:11.678451 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d6f9b148-ad8e-4d0f-96ef-f2139e95968a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:11.684324 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d6f9b148-ad8e-4d0f-96ef-f2139e95968a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:11.684779 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d6f9b148-ad8e-4d0f-96ef-f2139e95968a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:11.685610 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d6f9b148-ad8e-4d0f-96ef-f2139e95968a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:11.686050 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d6f9b148-ad8e-4d0f-96ef-f2139e95968a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:11.748991 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d6f9b148-ad8e-4d0f-96ef-f2139e95968a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:11.757230 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d6f9b148-ad8e-4d0f-96ef-f2139e95968a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.082196 Jul 20 19:43:11.757901 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1378/2009] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:11 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:43:12.690098 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-cd2880b7-22d2-4428-b8af-f295d9db1c24 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:12.690782 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-cd2880b7-22d2-4428-b8af-f295d9db1c24 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:12.697177 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cd2880b7-22d2-4428-b8af-f295d9db1c24 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:12.697648 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cd2880b7-22d2-4428-b8af-f295d9db1c24 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:12.698395 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cd2880b7-22d2-4428-b8af-f295d9db1c24 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:12.698821 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cd2880b7-22d2-4428-b8af-f295d9db1c24 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:12.833086 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-cd2880b7-22d2-4428-b8af-f295d9db1c24 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:12.840599 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-cd2880b7-22d2-4428-b8af-f295d9db1c24 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.154337 Jul 20 19:43:12.841164 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1379/2010] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:12 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:43:12.845607 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-7a39586a-3a21-4770-bc95-211dd1b454f8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:12.846220 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-7a39586a-3a21-4770-bc95-211dd1b454f8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:12.852841 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7a39586a-3a21-4770-bc95-211dd1b454f8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:12.853290 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7a39586a-3a21-4770-bc95-211dd1b454f8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:12.854091 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7a39586a-3a21-4770-bc95-211dd1b454f8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:12.854528 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7a39586a-3a21-4770-bc95-211dd1b454f8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:12.918926 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-7a39586a-3a21-4770-bc95-211dd1b454f8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:12.926460 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-7a39586a-3a21-4770-bc95-211dd1b454f8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.084328 Jul 20 19:43:12.927022 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1380/2011] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:12 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:43:13.858591 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-5b746796-dcab-48be-86b2-e7a610e9c2be tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:13.859273 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-5b746796-dcab-48be-86b2-e7a610e9c2be tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:13.866322 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5b746796-dcab-48be-86b2-e7a610e9c2be tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:13.866824 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5b746796-dcab-48be-86b2-e7a610e9c2be tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:13.867587 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5b746796-dcab-48be-86b2-e7a610e9c2be tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:13.868019 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5b746796-dcab-48be-86b2-e7a610e9c2be tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:13.997952 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-5b746796-dcab-48be-86b2-e7a610e9c2be tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:14.005328 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-5b746796-dcab-48be-86b2-e7a610e9c2be tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.150600 Jul 20 19:43:14.005924 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1381/2012] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:13 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:43:14.010951 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e9ca80c3-c528-4ad8-97ed-f562ca1135ad tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:14.011550 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e9ca80c3-c528-4ad8-97ed-f562ca1135ad tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:14.017358 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e9ca80c3-c528-4ad8-97ed-f562ca1135ad tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:14.017860 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e9ca80c3-c528-4ad8-97ed-f562ca1135ad tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:14.018619 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e9ca80c3-c528-4ad8-97ed-f562ca1135ad tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:14.019079 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e9ca80c3-c528-4ad8-97ed-f562ca1135ad tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:14.083521 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e9ca80c3-c528-4ad8-97ed-f562ca1135ad tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:14.091402 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e9ca80c3-c528-4ad8-97ed-f562ca1135ad tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.083918 Jul 20 19:43:14.091968 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1382/2013] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:14 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:43:15.023391 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ab5a2483-0d4a-49c9-a4e8-72c08b2b2770 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:15.024087 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ab5a2483-0d4a-49c9-a4e8-72c08b2b2770 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:15.030517 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ab5a2483-0d4a-49c9-a4e8-72c08b2b2770 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:15.030963 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ab5a2483-0d4a-49c9-a4e8-72c08b2b2770 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:15.031713 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ab5a2483-0d4a-49c9-a4e8-72c08b2b2770 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:15.032142 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ab5a2483-0d4a-49c9-a4e8-72c08b2b2770 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:15.171670 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ab5a2483-0d4a-49c9-a4e8-72c08b2b2770 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:15.179699 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ab5a2483-0d4a-49c9-a4e8-72c08b2b2770 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.160211 Jul 20 19:43:15.180264 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1383/2014] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:15 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:43:15.184592 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-04ba77d8-c8e9-4949-ac85-81f70f26c1f4 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:15.185190 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-04ba77d8-c8e9-4949-ac85-81f70f26c1f4 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:15.190713 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-04ba77d8-c8e9-4949-ac85-81f70f26c1f4 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:15.191162 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-04ba77d8-c8e9-4949-ac85-81f70f26c1f4 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:15.191914 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-04ba77d8-c8e9-4949-ac85-81f70f26c1f4 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:15.192346 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-04ba77d8-c8e9-4949-ac85-81f70f26c1f4 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:15.253539 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-04ba77d8-c8e9-4949-ac85-81f70f26c1f4 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:15.261680 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-04ba77d8-c8e9-4949-ac85-81f70f26c1f4 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080443 Jul 20 19:43:15.262242 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1384/2015] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:15 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:43:16.196557 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-8d5a91fe-c733-46b3-9627-4125528fcab1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:16.197250 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-8d5a91fe-c733-46b3-9627-4125528fcab1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:16.208993 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8d5a91fe-c733-46b3-9627-4125528fcab1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:16.209495 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8d5a91fe-c733-46b3-9627-4125528fcab1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:16.210491 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8d5a91fe-c733-46b3-9627-4125528fcab1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:16.210934 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8d5a91fe-c733-46b3-9627-4125528fcab1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:16.355120 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8d5a91fe-c733-46b3-9627-4125528fcab1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:16.362645 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-8d5a91fe-c733-46b3-9627-4125528fcab1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.170573 Jul 20 19:43:16.363216 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1385/2016] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:16 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:43:16.367653 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-9a4b5fe8-3174-4ec1-83c9-f179f4b69877 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:16.368261 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-9a4b5fe8-3174-4ec1-83c9-f179f4b69877 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:16.373956 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9a4b5fe8-3174-4ec1-83c9-f179f4b69877 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:16.374401 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9a4b5fe8-3174-4ec1-83c9-f179f4b69877 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:16.375151 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9a4b5fe8-3174-4ec1-83c9-f179f4b69877 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:16.375577 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9a4b5fe8-3174-4ec1-83c9-f179f4b69877 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:16.438045 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-9a4b5fe8-3174-4ec1-83c9-f179f4b69877 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:16.446146 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-9a4b5fe8-3174-4ec1-83c9-f179f4b69877 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.081954 Jul 20 19:43:16.446760 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1386/2017] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:16 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:43:17.379559 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-45cec413-06a3-42cc-bb82-f9f0c12f8300 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:17.380214 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-45cec413-06a3-42cc-bb82-f9f0c12f8300 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:17.386738 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-45cec413-06a3-42cc-bb82-f9f0c12f8300 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:17.387181 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-45cec413-06a3-42cc-bb82-f9f0c12f8300 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:17.387934 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-45cec413-06a3-42cc-bb82-f9f0c12f8300 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:17.388363 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-45cec413-06a3-42cc-bb82-f9f0c12f8300 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:17.519116 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-45cec413-06a3-42cc-bb82-f9f0c12f8300 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:17.527391 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-45cec413-06a3-42cc-bb82-f9f0c12f8300 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.151700 Jul 20 19:43:17.527987 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1387/2018] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:17 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:43:17.532400 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-aa820d89-1bb7-4bba-9e27-ef22742fa478 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:17.532994 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-aa820d89-1bb7-4bba-9e27-ef22742fa478 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:17.539515 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aa820d89-1bb7-4bba-9e27-ef22742fa478 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:17.539961 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aa820d89-1bb7-4bba-9e27-ef22742fa478 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:17.540712 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aa820d89-1bb7-4bba-9e27-ef22742fa478 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:17.541141 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aa820d89-1bb7-4bba-9e27-ef22742fa478 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:17.604217 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-aa820d89-1bb7-4bba-9e27-ef22742fa478 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:17.611839 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-aa820d89-1bb7-4bba-9e27-ef22742fa478 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.082876 Jul 20 19:43:17.612416 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1388/2019] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:17 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:43:18.544137 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a7ed3963-8309-4036-a18f-be6df1a635ef tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:18.544764 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a7ed3963-8309-4036-a18f-be6df1a635ef tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:18.551257 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a7ed3963-8309-4036-a18f-be6df1a635ef tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:18.551697 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a7ed3963-8309-4036-a18f-be6df1a635ef tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:18.552445 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a7ed3963-8309-4036-a18f-be6df1a635ef tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:18.553374 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a7ed3963-8309-4036-a18f-be6df1a635ef tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:18.685302 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a7ed3963-8309-4036-a18f-be6df1a635ef tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:18.692923 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a7ed3963-8309-4036-a18f-be6df1a635ef tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.152634 Jul 20 19:43:18.693523 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1389/2020] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:18 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:43:18.697937 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-25e280ea-d444-43a2-a315-5704726268f5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:18.698541 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-25e280ea-d444-43a2-a315-5704726268f5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:18.704258 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-25e280ea-d444-43a2-a315-5704726268f5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:18.704709 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-25e280ea-d444-43a2-a315-5704726268f5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:18.705465 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-25e280ea-d444-43a2-a315-5704726268f5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:18.705933 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-25e280ea-d444-43a2-a315-5704726268f5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:18.768138 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-25e280ea-d444-43a2-a315-5704726268f5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:18.775736 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-25e280ea-d444-43a2-a315-5704726268f5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.081267 Jul 20 19:43:18.776303 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1390/2021] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:18 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:43:19.712688 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-22043075-8d61-42b7-bc3c-00b9d20ca668 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:19.713393 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-22043075-8d61-42b7-bc3c-00b9d20ca668 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:19.720094 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-22043075-8d61-42b7-bc3c-00b9d20ca668 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:19.720541 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-22043075-8d61-42b7-bc3c-00b9d20ca668 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:19.721317 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-22043075-8d61-42b7-bc3c-00b9d20ca668 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:19.722223 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-22043075-8d61-42b7-bc3c-00b9d20ca668 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:19.861475 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-22043075-8d61-42b7-bc3c-00b9d20ca668 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:19.869970 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-22043075-8d61-42b7-bc3c-00b9d20ca668 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.163654 Jul 20 19:43:19.870542 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1391/2022] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:19 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:43:19.875133 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-2ec6a751-78f6-4f0a-8bef-7fd9efa32672 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:19.875791 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-2ec6a751-78f6-4f0a-8bef-7fd9efa32672 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:19.882561 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2ec6a751-78f6-4f0a-8bef-7fd9efa32672 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:19.882998 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2ec6a751-78f6-4f0a-8bef-7fd9efa32672 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:19.883755 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2ec6a751-78f6-4f0a-8bef-7fd9efa32672 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:19.884179 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2ec6a751-78f6-4f0a-8bef-7fd9efa32672 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:19.945644 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-2ec6a751-78f6-4f0a-8bef-7fd9efa32672 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:19.953147 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-2ec6a751-78f6-4f0a-8bef-7fd9efa32672 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.081660 Jul 20 19:43:19.953753 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1392/2023] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:19 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:43:20.886531 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-37d71edd-6134-4d1c-8d50-025a9ffa4f77 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:20.887223 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-37d71edd-6134-4d1c-8d50-025a9ffa4f77 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:20.893650 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-37d71edd-6134-4d1c-8d50-025a9ffa4f77 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:20.894095 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-37d71edd-6134-4d1c-8d50-025a9ffa4f77 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:20.894839 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-37d71edd-6134-4d1c-8d50-025a9ffa4f77 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:20.895265 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-37d71edd-6134-4d1c-8d50-025a9ffa4f77 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:21.026742 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-37d71edd-6134-4d1c-8d50-025a9ffa4f77 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:21.028605 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:43:21.035105 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-37d71edd-6134-4d1c-8d50-025a9ffa4f77 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.152449 Jul 20 19:43:21.035677 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1393/2024] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:20 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:43:21.040706 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-1d1e0579-ea4d-4ed7-a3af-6d3054910eed tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:21.041310 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-1d1e0579-ea4d-4ed7-a3af-6d3054910eed tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:21.047219 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1d1e0579-ea4d-4ed7-a3af-6d3054910eed tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:21.047672 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1d1e0579-ea4d-4ed7-a3af-6d3054910eed tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:21.048434 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1d1e0579-ea4d-4ed7-a3af-6d3054910eed tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:21.048872 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1d1e0579-ea4d-4ed7-a3af-6d3054910eed tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:21.113905 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1d1e0579-ea4d-4ed7-a3af-6d3054910eed tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:21.122026 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-1d1e0579-ea4d-4ed7-a3af-6d3054910eed tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.085398 Jul 20 19:43:21.122596 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1394/2025] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:21 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:43:22.053344 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-2c33d9da-8ba2-45b1-9a6e-9610a2ee9714 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:22.054057 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-2c33d9da-8ba2-45b1-9a6e-9610a2ee9714 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:22.060532 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2c33d9da-8ba2-45b1-9a6e-9610a2ee9714 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:22.060970 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2c33d9da-8ba2-45b1-9a6e-9610a2ee9714 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:22.061764 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2c33d9da-8ba2-45b1-9a6e-9610a2ee9714 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:22.062188 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2c33d9da-8ba2-45b1-9a6e-9610a2ee9714 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:22.192809 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-2c33d9da-8ba2-45b1-9a6e-9610a2ee9714 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:22.200573 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-2c33d9da-8ba2-45b1-9a6e-9610a2ee9714 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.151746 Jul 20 19:43:22.201141 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1395/2026] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:22 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:43:22.205828 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-6369e75b-d33a-40d4-ad2e-6d0aa8be023b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:22.206427 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-6369e75b-d33a-40d4-ad2e-6d0aa8be023b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:22.212997 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6369e75b-d33a-40d4-ad2e-6d0aa8be023b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:22.213468 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6369e75b-d33a-40d4-ad2e-6d0aa8be023b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:22.214249 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6369e75b-d33a-40d4-ad2e-6d0aa8be023b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:22.214682 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6369e75b-d33a-40d4-ad2e-6d0aa8be023b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:22.279790 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6369e75b-d33a-40d4-ad2e-6d0aa8be023b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:22.291983 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-6369e75b-d33a-40d4-ad2e-6d0aa8be023b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.089686 Jul 20 19:43:22.292585 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1396/2027] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:22 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:43:23.218107 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d8fd35bf-c493-4233-952f-f204e657e0c6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:23.218768 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d8fd35bf-c493-4233-952f-f204e657e0c6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:23.226099 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d8fd35bf-c493-4233-952f-f204e657e0c6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:23.226546 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d8fd35bf-c493-4233-952f-f204e657e0c6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:23.227304 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d8fd35bf-c493-4233-952f-f204e657e0c6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:23.227736 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d8fd35bf-c493-4233-952f-f204e657e0c6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:23.363213 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d8fd35bf-c493-4233-952f-f204e657e0c6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:23.370783 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d8fd35bf-c493-4233-952f-f204e657e0c6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.156589 Jul 20 19:43:23.371365 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1397/2028] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:23 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:43:23.375808 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c033865b-c967-4fdd-a8f7-f4f231b8f1e6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:23.376403 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c033865b-c967-4fdd-a8f7-f4f231b8f1e6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:23.382815 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c033865b-c967-4fdd-a8f7-f4f231b8f1e6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:23.383264 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c033865b-c967-4fdd-a8f7-f4f231b8f1e6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:23.384017 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c033865b-c967-4fdd-a8f7-f4f231b8f1e6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:23.384449 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c033865b-c967-4fdd-a8f7-f4f231b8f1e6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:23.445399 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c033865b-c967-4fdd-a8f7-f4f231b8f1e6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:23.453142 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c033865b-c967-4fdd-a8f7-f4f231b8f1e6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080837 Jul 20 19:43:23.453736 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1398/2029] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:23 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:43:24.387800 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-0911497d-c820-4464-951e-e743ef199d3e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:24.388494 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-0911497d-c820-4464-951e-e743ef199d3e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:24.394911 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0911497d-c820-4464-951e-e743ef199d3e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:24.395347 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0911497d-c820-4464-951e-e743ef199d3e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:24.396109 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0911497d-c820-4464-951e-e743ef199d3e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:24.397072 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0911497d-c820-4464-951e-e743ef199d3e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:24.536419 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0911497d-c820-4464-951e-e743ef199d3e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:24.544691 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-0911497d-c820-4464-951e-e743ef199d3e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.160680 Jul 20 19:43:24.545282 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1399/2030] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:24 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:43:24.549757 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-702766be-54f6-4f47-a3d7-d7f4978edeee tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:24.550368 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-702766be-54f6-4f47-a3d7-d7f4978edeee tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:24.559156 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-702766be-54f6-4f47-a3d7-d7f4978edeee tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:24.559156 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-702766be-54f6-4f47-a3d7-d7f4978edeee tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:24.560236 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-702766be-54f6-4f47-a3d7-d7f4978edeee tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:24.560674 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-702766be-54f6-4f47-a3d7-d7f4978edeee tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:24.627911 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-702766be-54f6-4f47-a3d7-d7f4978edeee tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:24.635672 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-702766be-54f6-4f47-a3d7-d7f4978edeee tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.089356 Jul 20 19:43:24.636247 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1400/2031] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:24 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:43:25.563921 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a653a7c0-6cc2-448b-b86b-49ada6c1471f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:25.564635 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a653a7c0-6cc2-448b-b86b-49ada6c1471f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:25.571111 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a653a7c0-6cc2-448b-b86b-49ada6c1471f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:25.571554 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a653a7c0-6cc2-448b-b86b-49ada6c1471f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:25.572305 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a653a7c0-6cc2-448b-b86b-49ada6c1471f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:25.572732 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a653a7c0-6cc2-448b-b86b-49ada6c1471f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:25.702605 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a653a7c0-6cc2-448b-b86b-49ada6c1471f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:25.710591 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a653a7c0-6cc2-448b-b86b-49ada6c1471f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.150517 Jul 20 19:43:25.711155 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1401/2032] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:25 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:43:25.715611 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-55872a82-878b-42d1-bade-d9857dc810b8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:25.716215 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-55872a82-878b-42d1-bade-d9857dc810b8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:25.722104 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-55872a82-878b-42d1-bade-d9857dc810b8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:25.722554 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-55872a82-878b-42d1-bade-d9857dc810b8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:25.723317 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-55872a82-878b-42d1-bade-d9857dc810b8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:25.723754 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-55872a82-878b-42d1-bade-d9857dc810b8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:25.786530 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-55872a82-878b-42d1-bade-d9857dc810b8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:25.794701 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-55872a82-878b-42d1-bade-d9857dc810b8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.082600 Jul 20 19:43:25.795278 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1402/2033] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:25 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:43:26.729122 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-f961facb-10b0-400a-a4c9-044e07f8fc84 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:26.729838 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-f961facb-10b0-400a-a4c9-044e07f8fc84 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:26.737431 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f961facb-10b0-400a-a4c9-044e07f8fc84 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:26.737908 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f961facb-10b0-400a-a4c9-044e07f8fc84 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:26.738673 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f961facb-10b0-400a-a4c9-044e07f8fc84 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:26.739108 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f961facb-10b0-400a-a4c9-044e07f8fc84 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:26.895024 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-f961facb-10b0-400a-a4c9-044e07f8fc84 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:26.903547 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-f961facb-10b0-400a-a4c9-044e07f8fc84 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.179792 Jul 20 19:43:26.904125 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1403/2034] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:26 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:43:27.012269 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-fbb7d001-0955-4016-b076-05815ceef596 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:27.012959 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-fbb7d001-0955-4016-b076-05815ceef596 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:27.021565 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fbb7d001-0955-4016-b076-05815ceef596 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:27.022311 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fbb7d001-0955-4016-b076-05815ceef596 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:27.023608 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fbb7d001-0955-4016-b076-05815ceef596 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:27.024338 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fbb7d001-0955-4016-b076-05815ceef596 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:27.094229 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-fbb7d001-0955-4016-b076-05815ceef596 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:27.103230 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-fbb7d001-0955-4016-b076-05815ceef596 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.197983 Jul 20 19:43:27.104213 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1404/2035] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:26 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:43:27.922072 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-955f3f16-9989-44d2-be04-1a2d446a2ac7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:27.923130 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-955f3f16-9989-44d2-be04-1a2d446a2ac7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:27.929469 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-955f3f16-9989-44d2-be04-1a2d446a2ac7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:27.929951 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-955f3f16-9989-44d2-be04-1a2d446a2ac7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:27.930739 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-955f3f16-9989-44d2-be04-1a2d446a2ac7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:27.931178 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-955f3f16-9989-44d2-be04-1a2d446a2ac7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:28.059473 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-955f3f16-9989-44d2-be04-1a2d446a2ac7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:28.066950 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-955f3f16-9989-44d2-be04-1a2d446a2ac7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.148787 Jul 20 19:43:28.067517 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1405/2036] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:27 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:43:28.121010 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-174a0817-9a19-4737-9566-f34eae445a1d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:28.121638 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-174a0817-9a19-4737-9566-f34eae445a1d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:28.127489 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-174a0817-9a19-4737-9566-f34eae445a1d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:28.127940 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-174a0817-9a19-4737-9566-f34eae445a1d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:28.128702 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-174a0817-9a19-4737-9566-f34eae445a1d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:28.129138 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-174a0817-9a19-4737-9566-f34eae445a1d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:28.192581 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-174a0817-9a19-4737-9566-f34eae445a1d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:28.200702 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-174a0817-9a19-4737-9566-f34eae445a1d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.083302 Jul 20 19:43:28.201264 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1406/2037] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:28 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:43:29.084763 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e89c0227-ff70-4cf9-9990-7ca9e281daab tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:29.085469 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e89c0227-ff70-4cf9-9990-7ca9e281daab tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:29.091979 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e89c0227-ff70-4cf9-9990-7ca9e281daab tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:29.092428 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e89c0227-ff70-4cf9-9990-7ca9e281daab tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:29.093186 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e89c0227-ff70-4cf9-9990-7ca9e281daab tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:29.093658 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e89c0227-ff70-4cf9-9990-7ca9e281daab tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:29.224028 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e89c0227-ff70-4cf9-9990-7ca9e281daab tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:29.232327 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e89c0227-ff70-4cf9-9990-7ca9e281daab tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.151913 Jul 20 19:43:29.232886 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1407/2038] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:29 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:43:29.237640 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-43101788-64de-40c7-99d3-86339b80e64e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:29.238240 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-43101788-64de-40c7-99d3-86339b80e64e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:29.244696 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-43101788-64de-40c7-99d3-86339b80e64e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:29.245143 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-43101788-64de-40c7-99d3-86339b80e64e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:29.245923 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-43101788-64de-40c7-99d3-86339b80e64e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:29.246358 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-43101788-64de-40c7-99d3-86339b80e64e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:29.306377 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-43101788-64de-40c7-99d3-86339b80e64e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:29.313776 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-43101788-64de-40c7-99d3-86339b80e64e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.079841 Jul 20 19:43:29.314340 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1408/2039] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:29 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:43:30.249842 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ce201d5e-c416-4ece-93b3-33a38fe6a0c4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:30.250539 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ce201d5e-c416-4ece-93b3-33a38fe6a0c4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:30.257784 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ce201d5e-c416-4ece-93b3-33a38fe6a0c4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:30.258236 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ce201d5e-c416-4ece-93b3-33a38fe6a0c4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:30.259005 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ce201d5e-c416-4ece-93b3-33a38fe6a0c4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:30.259441 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ce201d5e-c416-4ece-93b3-33a38fe6a0c4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:30.396365 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ce201d5e-c416-4ece-93b3-33a38fe6a0c4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:30.404193 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ce201d5e-c416-4ece-93b3-33a38fe6a0c4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.158174 Jul 20 19:43:30.404785 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1409/2040] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:30 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:43:30.409104 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-aff5ed3c-2f9d-4b89-9faf-2b968c8d8e3f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:30.409716 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-aff5ed3c-2f9d-4b89-9faf-2b968c8d8e3f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:30.415599 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aff5ed3c-2f9d-4b89-9faf-2b968c8d8e3f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:30.416042 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aff5ed3c-2f9d-4b89-9faf-2b968c8d8e3f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:30.416790 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aff5ed3c-2f9d-4b89-9faf-2b968c8d8e3f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:30.417215 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aff5ed3c-2f9d-4b89-9faf-2b968c8d8e3f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:30.432701 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:43:30.481610 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-aff5ed3c-2f9d-4b89-9faf-2b968c8d8e3f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:30.489296 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-aff5ed3c-2f9d-4b89-9faf-2b968c8d8e3f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.083580 Jul 20 19:43:30.489903 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1410/2041] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:30 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:43:31.421664 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-36438305-686c-4f6d-86b4-461093348457 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:31.422334 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-36438305-686c-4f6d-86b4-461093348457 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:31.429481 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-36438305-686c-4f6d-86b4-461093348457 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:31.429955 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-36438305-686c-4f6d-86b4-461093348457 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:31.430720 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-36438305-686c-4f6d-86b4-461093348457 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:31.431156 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-36438305-686c-4f6d-86b4-461093348457 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:31.562431 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-36438305-686c-4f6d-86b4-461093348457 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:31.570174 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-36438305-686c-4f6d-86b4-461093348457 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.152377 Jul 20 19:43:31.570739 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1411/2042] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:31 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:43:31.575121 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-5b900afa-aacd-47e8-9a0a-5933bf39ae2b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:31.575661 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-5b900afa-aacd-47e8-9a0a-5933bf39ae2b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:31.581213 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5b900afa-aacd-47e8-9a0a-5933bf39ae2b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:31.581699 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5b900afa-aacd-47e8-9a0a-5933bf39ae2b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:31.582451 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5b900afa-aacd-47e8-9a0a-5933bf39ae2b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:31.582880 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5b900afa-aacd-47e8-9a0a-5933bf39ae2b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:31.647898 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-5b900afa-aacd-47e8-9a0a-5933bf39ae2b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:31.655365 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-5b900afa-aacd-47e8-9a0a-5933bf39ae2b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.083702 Jul 20 19:43:31.655925 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1412/2043] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:31 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:43:32.587024 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4c1cff08-cfb4-4547-9c6a-907a39214fcf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:32.587602 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-4c1cff08-cfb4-4547-9c6a-907a39214fcf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:32.594713 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4c1cff08-cfb4-4547-9c6a-907a39214fcf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:32.595158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4c1cff08-cfb4-4547-9c6a-907a39214fcf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:32.595914 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4c1cff08-cfb4-4547-9c6a-907a39214fcf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:32.596344 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4c1cff08-cfb4-4547-9c6a-907a39214fcf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:32.729408 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-4c1cff08-cfb4-4547-9c6a-907a39214fcf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:32.737027 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-4c1cff08-cfb4-4547-9c6a-907a39214fcf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.153877 Jul 20 19:43:32.737601 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1413/2044] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:32 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:43:32.742623 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-2618514a-7e09-49aa-be38-4ce6c69dede1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:32.743223 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-2618514a-7e09-49aa-be38-4ce6c69dede1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:32.749176 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2618514a-7e09-49aa-be38-4ce6c69dede1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:32.749666 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2618514a-7e09-49aa-be38-4ce6c69dede1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:32.750456 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2618514a-7e09-49aa-be38-4ce6c69dede1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:32.750920 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2618514a-7e09-49aa-be38-4ce6c69dede1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:32.813371 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-2618514a-7e09-49aa-be38-4ce6c69dede1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:32.821054 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-2618514a-7e09-49aa-be38-4ce6c69dede1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.082508 Jul 20 19:43:32.821645 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1414/2045] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:32 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:43:33.755307 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a406fa45-cb18-4895-8ab4-31197c11cefb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:33.756147 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a406fa45-cb18-4895-8ab4-31197c11cefb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:33.761965 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a406fa45-cb18-4895-8ab4-31197c11cefb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:33.762411 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a406fa45-cb18-4895-8ab4-31197c11cefb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:33.763165 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a406fa45-cb18-4895-8ab4-31197c11cefb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:33.763600 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a406fa45-cb18-4895-8ab4-31197c11cefb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:33.896911 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a406fa45-cb18-4895-8ab4-31197c11cefb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:33.905189 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a406fa45-cb18-4895-8ab4-31197c11cefb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.153879 Jul 20 19:43:33.905917 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1415/2046] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:33 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:43:33.910297 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c6cab85c-d32f-4943-a24f-4c8085ce8973 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:33.910894 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c6cab85c-d32f-4943-a24f-4c8085ce8973 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:33.913050 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_api:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:43:33.918543 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c6cab85c-d32f-4943-a24f-4c8085ce8973 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:33.919023 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c6cab85c-d32f-4943-a24f-4c8085ce8973 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:33.919793 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c6cab85c-d32f-4943-a24f-4c8085ce8973 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:33.920230 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c6cab85c-d32f-4943-a24f-4c8085ce8973 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:33.983611 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c6cab85c-d32f-4943-a24f-4c8085ce8973 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:33.991495 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c6cab85c-d32f-4943-a24f-4c8085ce8973 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.084600 Jul 20 19:43:33.992065 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1416/2047] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:33 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:43:34.926092 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-2197b4e8-127b-4b14-8306-8983d5f3f37a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:34.927140 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-2197b4e8-127b-4b14-8306-8983d5f3f37a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:34.934737 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2197b4e8-127b-4b14-8306-8983d5f3f37a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:34.935188 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2197b4e8-127b-4b14-8306-8983d5f3f37a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:34.935959 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2197b4e8-127b-4b14-8306-8983d5f3f37a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:34.936395 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2197b4e8-127b-4b14-8306-8983d5f3f37a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:35.073174 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-2197b4e8-127b-4b14-8306-8983d5f3f37a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:35.080807 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-2197b4e8-127b-4b14-8306-8983d5f3f37a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.161228 Jul 20 19:43:35.081366 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1417/2048] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:34 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:43:35.085900 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4782939f-c8e7-4a76-b080-6dfdab8ba353 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:35.086500 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-4782939f-c8e7-4a76-b080-6dfdab8ba353 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:35.092052 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4782939f-c8e7-4a76-b080-6dfdab8ba353 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:35.092499 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4782939f-c8e7-4a76-b080-6dfdab8ba353 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:35.093256 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4782939f-c8e7-4a76-b080-6dfdab8ba353 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:35.093873 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4782939f-c8e7-4a76-b080-6dfdab8ba353 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:35.158292 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-4782939f-c8e7-4a76-b080-6dfdab8ba353 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:35.166706 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-4782939f-c8e7-4a76-b080-6dfdab8ba353 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.084346 Jul 20 19:43:35.167256 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1418/2049] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:35 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:43:36.098338 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-b45e320b-ad7c-4424-8ac2-babb5d690e8f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:36.099016 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-b45e320b-ad7c-4424-8ac2-babb5d690e8f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:36.105465 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b45e320b-ad7c-4424-8ac2-babb5d690e8f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:36.105949 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b45e320b-ad7c-4424-8ac2-babb5d690e8f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:36.106712 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b45e320b-ad7c-4424-8ac2-babb5d690e8f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:36.107146 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b45e320b-ad7c-4424-8ac2-babb5d690e8f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:36.240663 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-b45e320b-ad7c-4424-8ac2-babb5d690e8f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:36.248320 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-b45e320b-ad7c-4424-8ac2-babb5d690e8f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.154127 Jul 20 19:43:36.248885 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1419/2050] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:36 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:43:36.253338 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a300f613-2d5f-4d06-8d0c-e020660225bb tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:36.254010 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a300f613-2d5f-4d06-8d0c-e020660225bb tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:36.261124 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a300f613-2d5f-4d06-8d0c-e020660225bb tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:36.261629 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a300f613-2d5f-4d06-8d0c-e020660225bb tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:36.262619 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a300f613-2d5f-4d06-8d0c-e020660225bb tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:36.263084 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a300f613-2d5f-4d06-8d0c-e020660225bb tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:36.326300 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a300f613-2d5f-4d06-8d0c-e020660225bb tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:36.333994 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a300f613-2d5f-4d06-8d0c-e020660225bb tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.083941 Jul 20 19:43:36.334549 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1420/2051] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:36 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:43:37.265600 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-3f473451-d197-40e8-a768-90d2afb099f4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:37.266282 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-3f473451-d197-40e8-a768-90d2afb099f4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:37.272870 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3f473451-d197-40e8-a768-90d2afb099f4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:37.273316 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3f473451-d197-40e8-a768-90d2afb099f4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:37.274103 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3f473451-d197-40e8-a768-90d2afb099f4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:37.274538 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3f473451-d197-40e8-a768-90d2afb099f4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:37.410848 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3f473451-d197-40e8-a768-90d2afb099f4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:37.419467 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-3f473451-d197-40e8-a768-90d2afb099f4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.157798 Jul 20 19:43:37.420039 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1421/2052] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:37 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:43:37.424483 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c1039422-eca2-49d1-a708-da682f078cb7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:37.425085 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c1039422-eca2-49d1-a708-da682f078cb7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:37.431766 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c1039422-eca2-49d1-a708-da682f078cb7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:37.432215 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c1039422-eca2-49d1-a708-da682f078cb7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:37.432968 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c1039422-eca2-49d1-a708-da682f078cb7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:37.433399 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c1039422-eca2-49d1-a708-da682f078cb7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:37.496792 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c1039422-eca2-49d1-a708-da682f078cb7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:37.504422 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c1039422-eca2-49d1-a708-da682f078cb7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.083442 Jul 20 19:43:37.504995 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1422/2053] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:37 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:43:38.437705 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-05988fa1-9342-4a52-9166-441e0527656f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:38.438366 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-05988fa1-9342-4a52-9166-441e0527656f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:38.445850 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-05988fa1-9342-4a52-9166-441e0527656f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:38.446312 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-05988fa1-9342-4a52-9166-441e0527656f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:38.447078 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-05988fa1-9342-4a52-9166-441e0527656f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:38.447516 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-05988fa1-9342-4a52-9166-441e0527656f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:38.588557 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-05988fa1-9342-4a52-9166-441e0527656f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:38.596256 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-05988fa1-9342-4a52-9166-441e0527656f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.162449 Jul 20 19:43:38.597080 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1423/2054] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:38 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:43:38.602244 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-49aaadc0-7135-4ffa-b004-2895783dd792 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:38.602848 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-49aaadc0-7135-4ffa-b004-2895783dd792 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:38.608522 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-49aaadc0-7135-4ffa-b004-2895783dd792 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:38.608966 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-49aaadc0-7135-4ffa-b004-2895783dd792 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:38.609755 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-49aaadc0-7135-4ffa-b004-2895783dd792 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:38.610188 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-49aaadc0-7135-4ffa-b004-2895783dd792 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:38.673437 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-49aaadc0-7135-4ffa-b004-2895783dd792 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:38.681794 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-49aaadc0-7135-4ffa-b004-2895783dd792 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.083045 Jul 20 19:43:38.682352 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1424/2055] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:38 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:43:39.613460 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c7f8a171-2526-4634-bf6e-ba0a2c2aaccb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:39.614127 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c7f8a171-2526-4634-bf6e-ba0a2c2aaccb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:39.620631 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c7f8a171-2526-4634-bf6e-ba0a2c2aaccb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:39.621077 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c7f8a171-2526-4634-bf6e-ba0a2c2aaccb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:39.621864 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c7f8a171-2526-4634-bf6e-ba0a2c2aaccb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:39.622302 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c7f8a171-2526-4634-bf6e-ba0a2c2aaccb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:39.753816 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c7f8a171-2526-4634-bf6e-ba0a2c2aaccb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:39.762224 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c7f8a171-2526-4634-bf6e-ba0a2c2aaccb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.152709 Jul 20 19:43:39.762924 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1425/2056] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:39 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:43:39.767402 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-5b55cc10-d147-43c5-90ed-809c531b8ebb tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:39.767989 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-5b55cc10-d147-43c5-90ed-809c531b8ebb tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:39.774694 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5b55cc10-d147-43c5-90ed-809c531b8ebb tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:39.775144 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5b55cc10-d147-43c5-90ed-809c531b8ebb tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:39.775885 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5b55cc10-d147-43c5-90ed-809c531b8ebb tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:39.776318 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5b55cc10-d147-43c5-90ed-809c531b8ebb tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:39.838084 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-5b55cc10-d147-43c5-90ed-809c531b8ebb tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:39.845615 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-5b55cc10-d147-43c5-90ed-809c531b8ebb tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.081739 Jul 20 19:43:39.846173 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1426/2057] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:39 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:43:40.779965 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-91131a45-c82c-4a53-a96b-7163f5a55773 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:40.780657 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-91131a45-c82c-4a53-a96b-7163f5a55773 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:40.787186 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-91131a45-c82c-4a53-a96b-7163f5a55773 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:40.787700 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-91131a45-c82c-4a53-a96b-7163f5a55773 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:40.788476 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-91131a45-c82c-4a53-a96b-7163f5a55773 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:40.788908 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-91131a45-c82c-4a53-a96b-7163f5a55773 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:40.791658 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:43:40.922638 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-91131a45-c82c-4a53-a96b-7163f5a55773 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:40.930920 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-91131a45-c82c-4a53-a96b-7163f5a55773 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.154883 Jul 20 19:43:40.931490 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1427/2058] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:40 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:43:40.935942 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-5d6de70e-1eb8-43a1-854e-e1770cd1fa1b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:40.936540 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-5d6de70e-1eb8-43a1-854e-e1770cd1fa1b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:40.942309 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5d6de70e-1eb8-43a1-854e-e1770cd1fa1b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:40.943430 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5d6de70e-1eb8-43a1-854e-e1770cd1fa1b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:40.944336 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5d6de70e-1eb8-43a1-854e-e1770cd1fa1b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:40.944788 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5d6de70e-1eb8-43a1-854e-e1770cd1fa1b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:41.006248 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-5d6de70e-1eb8-43a1-854e-e1770cd1fa1b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:41.014144 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-5d6de70e-1eb8-43a1-854e-e1770cd1fa1b tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.081722 Jul 20 19:43:41.014695 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1428/2059] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:40 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:43:41.948233 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-3312db85-9a97-4ddb-a8d4-12344b4e99bf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:41.948914 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-3312db85-9a97-4ddb-a8d4-12344b4e99bf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:41.955504 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3312db85-9a97-4ddb-a8d4-12344b4e99bf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:41.955943 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3312db85-9a97-4ddb-a8d4-12344b4e99bf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:41.956694 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3312db85-9a97-4ddb-a8d4-12344b4e99bf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:41.957117 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3312db85-9a97-4ddb-a8d4-12344b4e99bf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:42.090038 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3312db85-9a97-4ddb-a8d4-12344b4e99bf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:42.097784 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-3312db85-9a97-4ddb-a8d4-12344b4e99bf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.153362 Jul 20 19:43:42.098350 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1429/2060] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:41 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:43:42.102981 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-16fecaca-c491-4098-8c35-98b3e8f809d6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:42.103583 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-16fecaca-c491-4098-8c35-98b3e8f809d6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:42.109455 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-16fecaca-c491-4098-8c35-98b3e8f809d6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:42.109924 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-16fecaca-c491-4098-8c35-98b3e8f809d6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:42.110803 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-16fecaca-c491-4098-8c35-98b3e8f809d6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:42.111238 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-16fecaca-c491-4098-8c35-98b3e8f809d6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:42.177767 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-16fecaca-c491-4098-8c35-98b3e8f809d6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:42.185251 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-16fecaca-c491-4098-8c35-98b3e8f809d6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.085898 Jul 20 19:43:42.185848 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1430/2061] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:42 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:43:43.116013 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4e74f798-a044-415c-a5ae-5c1c64a72c4d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:43.116907 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-4e74f798-a044-415c-a5ae-5c1c64a72c4d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:43.123399 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4e74f798-a044-415c-a5ae-5c1c64a72c4d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:43.123846 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4e74f798-a044-415c-a5ae-5c1c64a72c4d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:43.124609 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4e74f798-a044-415c-a5ae-5c1c64a72c4d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:43.125041 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4e74f798-a044-415c-a5ae-5c1c64a72c4d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:43.326623 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-4e74f798-a044-415c-a5ae-5c1c64a72c4d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:43.335006 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-4e74f798-a044-415c-a5ae-5c1c64a72c4d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.223546 Jul 20 19:43:43.335619 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1431/2062] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:43 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:43:43.340106 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-5a856bd4-7136-4352-ade7-8affdf6c9991 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:43.340707 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-5a856bd4-7136-4352-ade7-8affdf6c9991 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:43.346431 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5a856bd4-7136-4352-ade7-8affdf6c9991 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:43.347147 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5a856bd4-7136-4352-ade7-8affdf6c9991 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:43.347905 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5a856bd4-7136-4352-ade7-8affdf6c9991 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:43.348336 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5a856bd4-7136-4352-ade7-8affdf6c9991 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:43.410914 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-5a856bd4-7136-4352-ade7-8affdf6c9991 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:43.418786 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-5a856bd4-7136-4352-ade7-8affdf6c9991 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.082206 Jul 20 19:43:43.419353 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1432/2063] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:43 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:43:44.351523 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-cf7fd71a-fe87-4914-8fe7-afb793cf647d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:44.352208 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-cf7fd71a-fe87-4914-8fe7-afb793cf647d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:44.358626 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cf7fd71a-fe87-4914-8fe7-afb793cf647d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:44.359156 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cf7fd71a-fe87-4914-8fe7-afb793cf647d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:44.359848 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cf7fd71a-fe87-4914-8fe7-afb793cf647d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:44.360274 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cf7fd71a-fe87-4914-8fe7-afb793cf647d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:44.508830 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-cf7fd71a-fe87-4914-8fe7-afb793cf647d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:44.517276 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-cf7fd71a-fe87-4914-8fe7-afb793cf647d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.169677 Jul 20 19:43:44.517903 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1433/2064] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:44 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:43:44.522677 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-99f6e1ac-3232-4819-a218-a9930f34fbb8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:44.523281 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-99f6e1ac-3232-4819-a218-a9930f34fbb8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:44.529194 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-99f6e1ac-3232-4819-a218-a9930f34fbb8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:44.529698 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-99f6e1ac-3232-4819-a218-a9930f34fbb8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:44.530459 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-99f6e1ac-3232-4819-a218-a9930f34fbb8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:44.530891 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-99f6e1ac-3232-4819-a218-a9930f34fbb8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:44.600632 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-99f6e1ac-3232-4819-a218-a9930f34fbb8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:44.608302 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-99f6e1ac-3232-4819-a218-a9930f34fbb8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.089430 Jul 20 19:43:44.608873 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1434/2065] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:44 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:43:45.534915 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-0aafca75-cf73-4121-a243-2524afa2f21b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:45.535568 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-0aafca75-cf73-4121-a243-2524afa2f21b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:45.542912 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0aafca75-cf73-4121-a243-2524afa2f21b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:45.543384 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0aafca75-cf73-4121-a243-2524afa2f21b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:45.544140 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0aafca75-cf73-4121-a243-2524afa2f21b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:45.544564 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0aafca75-cf73-4121-a243-2524afa2f21b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:45.680994 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0aafca75-cf73-4121-a243-2524afa2f21b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:45.688805 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-0aafca75-cf73-4121-a243-2524afa2f21b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.157758 Jul 20 19:43:45.689362 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1435/2066] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:45 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:43:45.694186 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-f9caed46-e475-4201-8048-e449aa9d03fc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:45.694783 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-f9caed46-e475-4201-8048-e449aa9d03fc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:45.700741 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f9caed46-e475-4201-8048-e449aa9d03fc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:45.701177 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f9caed46-e475-4201-8048-e449aa9d03fc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:45.701967 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f9caed46-e475-4201-8048-e449aa9d03fc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:45.702398 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f9caed46-e475-4201-8048-e449aa9d03fc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:45.767335 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-f9caed46-e475-4201-8048-e449aa9d03fc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:45.774850 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-f9caed46-e475-4201-8048-e449aa9d03fc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.084513 Jul 20 19:43:45.775408 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1436/2067] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:45 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:43:46.706028 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-2754a83c-b78b-4024-9311-66142fbf97d2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:46.706714 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-2754a83c-b78b-4024-9311-66142fbf97d2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:46.713683 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2754a83c-b78b-4024-9311-66142fbf97d2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:46.714127 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2754a83c-b78b-4024-9311-66142fbf97d2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:46.714875 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2754a83c-b78b-4024-9311-66142fbf97d2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:46.715299 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2754a83c-b78b-4024-9311-66142fbf97d2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:46.847210 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-2754a83c-b78b-4024-9311-66142fbf97d2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:46.855670 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-2754a83c-b78b-4024-9311-66142fbf97d2 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.153397 Jul 20 19:43:46.856245 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1437/2068] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:46 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:43:46.860816 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-71e1917a-d721-47ef-b74c-47dede69dc65 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:46.861416 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-71e1917a-d721-47ef-b74c-47dede69dc65 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:46.867298 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-71e1917a-d721-47ef-b74c-47dede69dc65 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:46.867747 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-71e1917a-d721-47ef-b74c-47dede69dc65 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:46.868541 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-71e1917a-d721-47ef-b74c-47dede69dc65 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:46.868977 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-71e1917a-d721-47ef-b74c-47dede69dc65 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:46.930654 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-71e1917a-d721-47ef-b74c-47dede69dc65 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:46.938273 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-71e1917a-d721-47ef-b74c-47dede69dc65 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.081069 Jul 20 19:43:46.938835 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1438/2069] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:46 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:43:47.872978 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-9cf40564-a9d7-4afa-aa19-bd5c6a94e9a9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:47.873708 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-9cf40564-a9d7-4afa-aa19-bd5c6a94e9a9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:47.880831 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9cf40564-a9d7-4afa-aa19-bd5c6a94e9a9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:47.881273 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9cf40564-a9d7-4afa-aa19-bd5c6a94e9a9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:47.882076 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9cf40564-a9d7-4afa-aa19-bd5c6a94e9a9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:47.882507 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9cf40564-a9d7-4afa-aa19-bd5c6a94e9a9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:48.022395 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-9cf40564-a9d7-4afa-aa19-bd5c6a94e9a9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:48.030559 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-9cf40564-a9d7-4afa-aa19-bd5c6a94e9a9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.161425 Jul 20 19:43:48.031142 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1439/2070] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:47 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:43:48.037243 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-708be112-2ce5-472e-98ad-9c277a8a41e4 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:48.037882 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-708be112-2ce5-472e-98ad-9c277a8a41e4 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:48.043820 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-708be112-2ce5-472e-98ad-9c277a8a41e4 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:48.044255 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-708be112-2ce5-472e-98ad-9c277a8a41e4 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:48.045007 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-708be112-2ce5-472e-98ad-9c277a8a41e4 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:48.045429 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-708be112-2ce5-472e-98ad-9c277a8a41e4 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:48.113265 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-708be112-2ce5-472e-98ad-9c277a8a41e4 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:48.121499 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-708be112-2ce5-472e-98ad-9c277a8a41e4 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.089314 Jul 20 19:43:48.122094 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1440/2071] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:48 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:43:49.048181 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-684cca43-f172-40f2-86b2-092493dfd2be tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:49.048849 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-684cca43-f172-40f2-86b2-092493dfd2be tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:49.055896 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-684cca43-f172-40f2-86b2-092493dfd2be tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:49.056349 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-684cca43-f172-40f2-86b2-092493dfd2be tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:49.057119 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-684cca43-f172-40f2-86b2-092493dfd2be tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:49.057590 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-684cca43-f172-40f2-86b2-092493dfd2be tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:49.191281 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-684cca43-f172-40f2-86b2-092493dfd2be tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:49.199727 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-684cca43-f172-40f2-86b2-092493dfd2be tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.155565 Jul 20 19:43:49.200300 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1441/2072] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:49 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:43:49.204801 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e1d9c7c8-f3bc-4d6b-b969-a593efec2fb6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:49.205393 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e1d9c7c8-f3bc-4d6b-b969-a593efec2fb6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:49.211370 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e1d9c7c8-f3bc-4d6b-b969-a593efec2fb6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:49.211817 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e1d9c7c8-f3bc-4d6b-b969-a593efec2fb6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:49.212601 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e1d9c7c8-f3bc-4d6b-b969-a593efec2fb6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:49.213030 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e1d9c7c8-f3bc-4d6b-b969-a593efec2fb6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:49.277658 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e1d9c7c8-f3bc-4d6b-b969-a593efec2fb6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:49.285375 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e1d9c7c8-f3bc-4d6b-b969-a593efec2fb6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.084117 Jul 20 19:43:49.286013 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1442/2073] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:49 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:43:50.220105 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-aeffdd36-2b78-468b-ad1c-952cb3b70f85 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:50.221127 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-aeffdd36-2b78-468b-ad1c-952cb3b70f85 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:50.232043 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aeffdd36-2b78-468b-ad1c-952cb3b70f85 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:50.232809 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aeffdd36-2b78-468b-ad1c-952cb3b70f85 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:50.234143 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aeffdd36-2b78-468b-ad1c-952cb3b70f85 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:50.234901 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aeffdd36-2b78-468b-ad1c-952cb3b70f85 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:50.394218 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-aeffdd36-2b78-468b-ad1c-952cb3b70f85 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:50.397127 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:43:50.404571 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-aeffdd36-2b78-468b-ad1c-952cb3b70f85 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.191060 Jul 20 19:43:50.405196 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1443/2074] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:50 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:43:50.409876 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-367ffdfa-65ba-4233-9151-e56730af1232 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:50.410476 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-367ffdfa-65ba-4233-9151-e56730af1232 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:50.416625 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-367ffdfa-65ba-4233-9151-e56730af1232 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:50.417076 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-367ffdfa-65ba-4233-9151-e56730af1232 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:50.417872 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-367ffdfa-65ba-4233-9151-e56730af1232 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:50.418352 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-367ffdfa-65ba-4233-9151-e56730af1232 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:50.483133 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-367ffdfa-65ba-4233-9151-e56730af1232 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:50.491258 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-367ffdfa-65ba-4233-9151-e56730af1232 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.085111 Jul 20 19:43:50.491851 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1444/2075] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:50 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:43:51.421206 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-8c0b7b20-fb03-4437-ae94-b6319a46cc18 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:51.421907 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-8c0b7b20-fb03-4437-ae94-b6319a46cc18 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:51.430492 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8c0b7b20-fb03-4437-ae94-b6319a46cc18 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:51.430941 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8c0b7b20-fb03-4437-ae94-b6319a46cc18 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:51.431710 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8c0b7b20-fb03-4437-ae94-b6319a46cc18 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:51.432141 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8c0b7b20-fb03-4437-ae94-b6319a46cc18 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:51.571189 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8c0b7b20-fb03-4437-ae94-b6319a46cc18 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:51.578854 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-8c0b7b20-fb03-4437-ae94-b6319a46cc18 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.161505 Jul 20 19:43:51.579355 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1445/2076] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:51 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:43:51.583791 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e4ce0c78-24f9-41d5-a079-926669aaca31 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:51.584400 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e4ce0c78-24f9-41d5-a079-926669aaca31 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:51.590301 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e4ce0c78-24f9-41d5-a079-926669aaca31 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:51.590800 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e4ce0c78-24f9-41d5-a079-926669aaca31 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:51.591571 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e4ce0c78-24f9-41d5-a079-926669aaca31 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:51.592005 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e4ce0c78-24f9-41d5-a079-926669aaca31 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:51.656867 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e4ce0c78-24f9-41d5-a079-926669aaca31 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:51.665179 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e4ce0c78-24f9-41d5-a079-926669aaca31 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.084867 Jul 20 19:43:51.665777 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1446/2077] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:51 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:43:52.596581 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ce3ef79d-b627-4462-9741-4b861ae7a1c4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:52.597593 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ce3ef79d-b627-4462-9741-4b861ae7a1c4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:52.604687 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ce3ef79d-b627-4462-9741-4b861ae7a1c4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:52.605123 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ce3ef79d-b627-4462-9741-4b861ae7a1c4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:52.605930 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ce3ef79d-b627-4462-9741-4b861ae7a1c4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:52.606356 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ce3ef79d-b627-4462-9741-4b861ae7a1c4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:52.852636 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ce3ef79d-b627-4462-9741-4b861ae7a1c4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:52.860235 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ce3ef79d-b627-4462-9741-4b861ae7a1c4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.267554 Jul 20 19:43:52.860842 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1447/2078] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:52 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:43:52.865663 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-3784b61a-b98e-4656-8498-ad997138d706 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:52.866266 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-3784b61a-b98e-4656-8498-ad997138d706 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:52.872670 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3784b61a-b98e-4656-8498-ad997138d706 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:52.873147 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3784b61a-b98e-4656-8498-ad997138d706 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:52.873900 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3784b61a-b98e-4656-8498-ad997138d706 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:52.874325 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3784b61a-b98e-4656-8498-ad997138d706 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:52.953278 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3784b61a-b98e-4656-8498-ad997138d706 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:52.963156 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-3784b61a-b98e-4656-8498-ad997138d706 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.100543 Jul 20 19:43:52.972939 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1448/2079] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:52 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:43:53.877283 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-92791a00-e04a-4211-9a4f-9dd2325f240c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:53.878008 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-92791a00-e04a-4211-9a4f-9dd2325f240c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:53.884807 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-92791a00-e04a-4211-9a4f-9dd2325f240c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:53.885246 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-92791a00-e04a-4211-9a4f-9dd2325f240c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:53.886025 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-92791a00-e04a-4211-9a4f-9dd2325f240c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:53.886448 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-92791a00-e04a-4211-9a4f-9dd2325f240c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:54.018398 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-92791a00-e04a-4211-9a4f-9dd2325f240c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:54.026012 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-92791a00-e04a-4211-9a4f-9dd2325f240c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.152601 Jul 20 19:43:54.026576 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1449/2080] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:53 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:43:54.030888 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-1dc981ed-0477-44c5-bb8e-dc6af67834a5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:54.031480 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-1dc981ed-0477-44c5-bb8e-dc6af67834a5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:54.037912 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1dc981ed-0477-44c5-bb8e-dc6af67834a5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:54.038361 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1dc981ed-0477-44c5-bb8e-dc6af67834a5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:54.039124 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1dc981ed-0477-44c5-bb8e-dc6af67834a5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:54.039558 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1dc981ed-0477-44c5-bb8e-dc6af67834a5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:54.104383 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1dc981ed-0477-44c5-bb8e-dc6af67834a5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:54.111890 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-1dc981ed-0477-44c5-bb8e-dc6af67834a5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.084381 Jul 20 19:43:54.112451 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1450/2081] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:54 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:43:55.043278 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-2b287eeb-8847-49c7-888e-553193826f86 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:55.043932 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-2b287eeb-8847-49c7-888e-553193826f86 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:55.050345 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2b287eeb-8847-49c7-888e-553193826f86 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:55.050786 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2b287eeb-8847-49c7-888e-553193826f86 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:55.051544 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2b287eeb-8847-49c7-888e-553193826f86 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:55.052152 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2b287eeb-8847-49c7-888e-553193826f86 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:55.185171 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-2b287eeb-8847-49c7-888e-553193826f86 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:55.193444 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-2b287eeb-8847-49c7-888e-553193826f86 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.153893 Jul 20 19:43:55.194028 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1451/2082] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:55 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:43:55.198475 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-31cb16f3-0896-4e1f-8f7b-320493097a3d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:55.199073 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-31cb16f3-0896-4e1f-8f7b-320493097a3d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:55.204842 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-31cb16f3-0896-4e1f-8f7b-320493097a3d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:55.205289 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-31cb16f3-0896-4e1f-8f7b-320493097a3d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:55.206078 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-31cb16f3-0896-4e1f-8f7b-320493097a3d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:55.206510 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-31cb16f3-0896-4e1f-8f7b-320493097a3d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:55.268389 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-31cb16f3-0896-4e1f-8f7b-320493097a3d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:55.276102 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-31cb16f3-0896-4e1f-8f7b-320493097a3d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.081089 Jul 20 19:43:55.276704 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1452/2083] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:55 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:43:56.210679 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c92476c6-aa72-41b9-9511-01fd20c7ee78 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:56.211427 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c92476c6-aa72-41b9-9511-01fd20c7ee78 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:56.226347 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c92476c6-aa72-41b9-9511-01fd20c7ee78 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:56.226796 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c92476c6-aa72-41b9-9511-01fd20c7ee78 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:56.227582 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c92476c6-aa72-41b9-9511-01fd20c7ee78 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:56.228282 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c92476c6-aa72-41b9-9511-01fd20c7ee78 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:56.369304 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c92476c6-aa72-41b9-9511-01fd20c7ee78 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:56.376940 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c92476c6-aa72-41b9-9511-01fd20c7ee78 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.170331 Jul 20 19:43:56.377740 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1453/2084] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:56 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:43:56.383093 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-5b6e71a5-3762-4d24-b524-3d8f8d1c5825 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:56.383700 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-5b6e71a5-3762-4d24-b524-3d8f8d1c5825 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:56.389843 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5b6e71a5-3762-4d24-b524-3d8f8d1c5825 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:56.390298 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5b6e71a5-3762-4d24-b524-3d8f8d1c5825 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:56.391069 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5b6e71a5-3762-4d24-b524-3d8f8d1c5825 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:56.391505 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5b6e71a5-3762-4d24-b524-3d8f8d1c5825 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:56.452566 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-5b6e71a5-3762-4d24-b524-3d8f8d1c5825 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:56.460851 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-5b6e71a5-3762-4d24-b524-3d8f8d1c5825 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.082232 Jul 20 19:43:56.461356 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1454/2085] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:56 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:43:57.393959 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-1ceb9680-42d4-461b-9b95-9a8bcd2425f3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:57.394604 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-1ceb9680-42d4-461b-9b95-9a8bcd2425f3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:57.401869 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1ceb9680-42d4-461b-9b95-9a8bcd2425f3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:57.402314 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1ceb9680-42d4-461b-9b95-9a8bcd2425f3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:57.403079 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1ceb9680-42d4-461b-9b95-9a8bcd2425f3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:57.403510 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1ceb9680-42d4-461b-9b95-9a8bcd2425f3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:57.540055 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1ceb9680-42d4-461b-9b95-9a8bcd2425f3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:57.548543 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-1ceb9680-42d4-461b-9b95-9a8bcd2425f3 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.158333 Jul 20 19:43:57.549254 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1455/2086] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:57 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:43:57.554851 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e0bc9255-5486-456d-824d-6e240d2e9d6f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:57.555455 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e0bc9255-5486-456d-824d-6e240d2e9d6f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:57.561332 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e0bc9255-5486-456d-824d-6e240d2e9d6f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:57.561806 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e0bc9255-5486-456d-824d-6e240d2e9d6f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:57.562559 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e0bc9255-5486-456d-824d-6e240d2e9d6f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:57.562988 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e0bc9255-5486-456d-824d-6e240d2e9d6f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:57.628425 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e0bc9255-5486-456d-824d-6e240d2e9d6f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:57.636727 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e0bc9255-5486-456d-824d-6e240d2e9d6f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.086263 Jul 20 19:43:57.637299 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1456/2087] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:57 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:43:58.566362 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-8d7b36aa-6424-486f-ba41-51154d8d1e1f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:58.566860 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-8d7b36aa-6424-486f-ba41-51154d8d1e1f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:58.573683 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8d7b36aa-6424-486f-ba41-51154d8d1e1f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:58.574184 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8d7b36aa-6424-486f-ba41-51154d8d1e1f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:58.574896 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8d7b36aa-6424-486f-ba41-51154d8d1e1f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:58.575332 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8d7b36aa-6424-486f-ba41-51154d8d1e1f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:58.713435 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8d7b36aa-6424-486f-ba41-51154d8d1e1f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:58.722111 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-8d7b36aa-6424-486f-ba41-51154d8d1e1f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.159294 Jul 20 19:43:58.730925 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1457/2088] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:58 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:43:58.730925 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-672cfaa7-2443-475f-808d-28863ad92eb7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:58.730925 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-672cfaa7-2443-475f-808d-28863ad92eb7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:58.751352 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-672cfaa7-2443-475f-808d-28863ad92eb7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:58.751804 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-672cfaa7-2443-475f-808d-28863ad92eb7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:58.752581 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-672cfaa7-2443-475f-808d-28863ad92eb7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:58.753049 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-672cfaa7-2443-475f-808d-28863ad92eb7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:58.816841 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-672cfaa7-2443-475f-808d-28863ad92eb7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:58.825479 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-672cfaa7-2443-475f-808d-28863ad92eb7 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.100190 Jul 20 19:43:58.826065 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1458/2089] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:58 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:43:59.739778 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d08bbc41-059f-4c0a-967d-c3041a23d8f4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:59.740463 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d08bbc41-059f-4c0a-967d-c3041a23d8f4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:59.747061 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d08bbc41-059f-4c0a-967d-c3041a23d8f4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:59.747514 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d08bbc41-059f-4c0a-967d-c3041a23d8f4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:59.748282 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d08bbc41-059f-4c0a-967d-c3041a23d8f4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:59.748717 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d08bbc41-059f-4c0a-967d-c3041a23d8f4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:59.884508 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d08bbc41-059f-4c0a-967d-c3041a23d8f4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:59.892028 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d08bbc41-059f-4c0a-967d-c3041a23d8f4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.156184 Jul 20 19:43:59.892592 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1459/2090] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:59 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:43:59.897715 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-2c1f5cd0-66ff-4a7a-bc15-071261d7edb5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:43:59.898324 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-2c1f5cd0-66ff-4a7a-bc15-071261d7edb5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:43:59.904129 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2c1f5cd0-66ff-4a7a-bc15-071261d7edb5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:59.904578 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2c1f5cd0-66ff-4a7a-bc15-071261d7edb5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:59.905337 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2c1f5cd0-66ff-4a7a-bc15-071261d7edb5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:43:59.905823 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2c1f5cd0-66ff-4a7a-bc15-071261d7edb5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:43:59.931557 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:43:59.979433 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-2c1f5cd0-66ff-4a7a-bc15-071261d7edb5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:43:59.987044 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-2c1f5cd0-66ff-4a7a-bc15-071261d7edb5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.093507 Jul 20 19:43:59.987603 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1460/2091] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:43:59 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:44:00.910329 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-62c73dd4-0096-4b46-afae-a6e622b001a6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:00.911650 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-62c73dd4-0096-4b46-afae-a6e622b001a6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:00.918624 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-62c73dd4-0096-4b46-afae-a6e622b001a6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:00.919126 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-62c73dd4-0096-4b46-afae-a6e622b001a6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:00.920036 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-62c73dd4-0096-4b46-afae-a6e622b001a6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:00.920474 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-62c73dd4-0096-4b46-afae-a6e622b001a6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:01.062984 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-62c73dd4-0096-4b46-afae-a6e622b001a6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:01.071311 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-62c73dd4-0096-4b46-afae-a6e622b001a6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.165070 Jul 20 19:44:01.071898 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1461/2092] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:00 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:44:01.076413 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-eba45c98-9387-4bf2-8c86-82add1ae9b1e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:01.077028 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-eba45c98-9387-4bf2-8c86-82add1ae9b1e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:01.083662 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-eba45c98-9387-4bf2-8c86-82add1ae9b1e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:01.084112 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-eba45c98-9387-4bf2-8c86-82add1ae9b1e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:01.084877 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-eba45c98-9387-4bf2-8c86-82add1ae9b1e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:01.085313 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-eba45c98-9387-4bf2-8c86-82add1ae9b1e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:01.155380 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-eba45c98-9387-4bf2-8c86-82add1ae9b1e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:01.163505 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-eba45c98-9387-4bf2-8c86-82add1ae9b1e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.090587 Jul 20 19:44:01.164000 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1462/2093] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:01 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:44:02.088876 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-cc81260c-fbf3-41a3-a250-616d71520d3a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:02.089527 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-cc81260c-fbf3-41a3-a250-616d71520d3a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:02.096024 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cc81260c-fbf3-41a3-a250-616d71520d3a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:02.096473 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cc81260c-fbf3-41a3-a250-616d71520d3a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:02.097538 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cc81260c-fbf3-41a3-a250-616d71520d3a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:02.097974 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cc81260c-fbf3-41a3-a250-616d71520d3a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:02.232194 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-cc81260c-fbf3-41a3-a250-616d71520d3a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:02.240060 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-cc81260c-fbf3-41a3-a250-616d71520d3a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.154985 Jul 20 19:44:02.240632 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1463/2094] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:02 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:44:02.245071 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d7255e7e-5e6f-4896-a1f0-bd10079a78f0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:02.245727 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d7255e7e-5e6f-4896-a1f0-bd10079a78f0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:02.251525 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d7255e7e-5e6f-4896-a1f0-bd10079a78f0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:02.251962 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d7255e7e-5e6f-4896-a1f0-bd10079a78f0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:02.252707 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d7255e7e-5e6f-4896-a1f0-bd10079a78f0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:02.253131 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d7255e7e-5e6f-4896-a1f0-bd10079a78f0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:02.317904 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d7255e7e-5e6f-4896-a1f0-bd10079a78f0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:02.325580 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d7255e7e-5e6f-4896-a1f0-bd10079a78f0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.083895 Jul 20 19:44:02.326156 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1464/2095] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:02 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:44:03.322799 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-0de4aafd-8013-4232-bdbc-d5c81cdaf11f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:03.323461 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-0de4aafd-8013-4232-bdbc-d5c81cdaf11f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:03.329444 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0de4aafd-8013-4232-bdbc-d5c81cdaf11f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:03.329924 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0de4aafd-8013-4232-bdbc-d5c81cdaf11f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:03.330688 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0de4aafd-8013-4232-bdbc-d5c81cdaf11f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:03.331125 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0de4aafd-8013-4232-bdbc-d5c81cdaf11f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:03.469334 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0de4aafd-8013-4232-bdbc-d5c81cdaf11f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:03.477503 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-0de4aafd-8013-4232-bdbc-d5c81cdaf11f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.224247 Jul 20 19:44:03.478100 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1465/2096] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:03 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:44:03.482602 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-f0fd1738-c095-4ab7-9f8e-c82961ab10bf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:03.483345 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-f0fd1738-c095-4ab7-9f8e-c82961ab10bf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:03.485216 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_api:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:44:03.491193 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f0fd1738-c095-4ab7-9f8e-c82961ab10bf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:03.491640 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f0fd1738-c095-4ab7-9f8e-c82961ab10bf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:03.492409 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f0fd1738-c095-4ab7-9f8e-c82961ab10bf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:03.492837 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f0fd1738-c095-4ab7-9f8e-c82961ab10bf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:03.557174 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-f0fd1738-c095-4ab7-9f8e-c82961ab10bf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:03.565015 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-f0fd1738-c095-4ab7-9f8e-c82961ab10bf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.085860 Jul 20 19:44:03.565609 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1466/2097] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:03 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:44:04.495622 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ef790d68-454e-4b82-86d9-98454487c2b5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:04.496364 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ef790d68-454e-4b82-86d9-98454487c2b5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:04.502585 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ef790d68-454e-4b82-86d9-98454487c2b5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:04.503026 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ef790d68-454e-4b82-86d9-98454487c2b5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:04.503775 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ef790d68-454e-4b82-86d9-98454487c2b5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:04.504201 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ef790d68-454e-4b82-86d9-98454487c2b5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:04.636114 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ef790d68-454e-4b82-86d9-98454487c2b5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:04.643619 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ef790d68-454e-4b82-86d9-98454487c2b5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.152016 Jul 20 19:44:04.644182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1467/2098] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:04 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:44:04.648720 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-29b77bb0-02ba-4188-9e59-45ff9530fcd0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:04.649314 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-29b77bb0-02ba-4188-9e59-45ff9530fcd0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:04.655139 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-29b77bb0-02ba-4188-9e59-45ff9530fcd0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:04.655583 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-29b77bb0-02ba-4188-9e59-45ff9530fcd0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:04.656327 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-29b77bb0-02ba-4188-9e59-45ff9530fcd0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:04.656757 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-29b77bb0-02ba-4188-9e59-45ff9530fcd0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:04.721680 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-29b77bb0-02ba-4188-9e59-45ff9530fcd0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:04.729488 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-29b77bb0-02ba-4188-9e59-45ff9530fcd0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.084370 Jul 20 19:44:04.730074 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1468/2099] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:04 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:44:05.660302 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-999248d8-0622-402b-9813-5fb5105d7845 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:05.661746 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-999248d8-0622-402b-9813-5fb5105d7845 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:05.668238 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-999248d8-0622-402b-9813-5fb5105d7845 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:05.668707 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-999248d8-0622-402b-9813-5fb5105d7845 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:05.669446 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-999248d8-0622-402b-9813-5fb5105d7845 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:05.669903 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-999248d8-0622-402b-9813-5fb5105d7845 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:05.799956 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-999248d8-0622-402b-9813-5fb5105d7845 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:05.808076 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-999248d8-0622-402b-9813-5fb5105d7845 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.151735 Jul 20 19:44:05.808634 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1469/2100] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:05 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:44:05.812958 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-29c4b76b-4fe7-4054-9be6-2215ad95d585 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:05.813586 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-29c4b76b-4fe7-4054-9be6-2215ad95d585 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:05.819846 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-29c4b76b-4fe7-4054-9be6-2215ad95d585 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:05.820298 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-29c4b76b-4fe7-4054-9be6-2215ad95d585 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:05.821059 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-29c4b76b-4fe7-4054-9be6-2215ad95d585 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:05.821492 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-29c4b76b-4fe7-4054-9be6-2215ad95d585 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:05.881756 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-29c4b76b-4fe7-4054-9be6-2215ad95d585 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:05.889229 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-29c4b76b-4fe7-4054-9be6-2215ad95d585 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.079639 Jul 20 19:44:05.889834 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1470/2101] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:05 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:44:06.825839 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c996cef5-44bd-4432-9118-364b42625f93 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:06.826513 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c996cef5-44bd-4432-9118-364b42625f93 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:06.833536 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c996cef5-44bd-4432-9118-364b42625f93 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:06.833996 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c996cef5-44bd-4432-9118-364b42625f93 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:06.834812 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c996cef5-44bd-4432-9118-364b42625f93 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:06.835240 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c996cef5-44bd-4432-9118-364b42625f93 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:06.977009 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c996cef5-44bd-4432-9118-364b42625f93 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:06.984481 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c996cef5-44bd-4432-9118-364b42625f93 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.162489 Jul 20 19:44:06.985047 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1471/2102] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:06 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:44:06.989996 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-1a908c78-9215-46cb-8074-a416e4929ed6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:06.990592 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-1a908c78-9215-46cb-8074-a416e4929ed6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:06.996321 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1a908c78-9215-46cb-8074-a416e4929ed6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:06.996818 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1a908c78-9215-46cb-8074-a416e4929ed6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:06.997592 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1a908c78-9215-46cb-8074-a416e4929ed6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:06.998050 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1a908c78-9215-46cb-8074-a416e4929ed6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:07.057772 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1a908c78-9215-46cb-8074-a416e4929ed6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:07.065271 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-1a908c78-9215-46cb-8074-a416e4929ed6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.079275 Jul 20 19:44:07.065864 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1472/2103] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:06 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:44:08.001911 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-8477a7c9-583b-433f-a50b-8ce2798adffd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:08.002634 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-8477a7c9-583b-433f-a50b-8ce2798adffd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:08.009243 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8477a7c9-583b-433f-a50b-8ce2798adffd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:08.009723 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8477a7c9-583b-433f-a50b-8ce2798adffd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:08.010481 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8477a7c9-583b-433f-a50b-8ce2798adffd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:08.010910 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8477a7c9-583b-433f-a50b-8ce2798adffd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:08.144404 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8477a7c9-583b-433f-a50b-8ce2798adffd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:08.152929 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-8477a7c9-583b-433f-a50b-8ce2798adffd tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.154875 Jul 20 19:44:08.153739 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1473/2104] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:07 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:44:08.158214 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-b4fe3e08-3ad9-4782-ba47-16cdd554c93c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:08.158815 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-b4fe3e08-3ad9-4782-ba47-16cdd554c93c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:08.164664 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b4fe3e08-3ad9-4782-ba47-16cdd554c93c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:08.165114 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b4fe3e08-3ad9-4782-ba47-16cdd554c93c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:08.165911 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b4fe3e08-3ad9-4782-ba47-16cdd554c93c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:08.166473 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b4fe3e08-3ad9-4782-ba47-16cdd554c93c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:08.232763 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-b4fe3e08-3ad9-4782-ba47-16cdd554c93c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:08.240607 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-b4fe3e08-3ad9-4782-ba47-16cdd554c93c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.086107 Jul 20 19:44:08.241373 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1474/2105] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:08 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:44:09.170007 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-5535ee90-97a2-4891-9e3c-1a279e9a7755 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:09.170662 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-5535ee90-97a2-4891-9e3c-1a279e9a7755 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:09.177105 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5535ee90-97a2-4891-9e3c-1a279e9a7755 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:09.177566 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5535ee90-97a2-4891-9e3c-1a279e9a7755 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:09.178313 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5535ee90-97a2-4891-9e3c-1a279e9a7755 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:09.178734 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5535ee90-97a2-4891-9e3c-1a279e9a7755 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:09.308936 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-5535ee90-97a2-4891-9e3c-1a279e9a7755 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:09.316470 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-5535ee90-97a2-4891-9e3c-1a279e9a7755 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.150289 Jul 20 19:44:09.317650 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1475/2106] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:09 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:44:09.322232 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4fd8540b-b84b-4d38-9409-50dc1392f7ed tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:09.322846 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-4fd8540b-b84b-4d38-9409-50dc1392f7ed tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:09.328748 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4fd8540b-b84b-4d38-9409-50dc1392f7ed tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:09.329198 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4fd8540b-b84b-4d38-9409-50dc1392f7ed tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:09.329991 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4fd8540b-b84b-4d38-9409-50dc1392f7ed tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:09.330429 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4fd8540b-b84b-4d38-9409-50dc1392f7ed tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:09.391394 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-4fd8540b-b84b-4d38-9409-50dc1392f7ed tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:09.399605 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-4fd8540b-b84b-4d38-9409-50dc1392f7ed tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080992 Jul 20 19:44:09.400163 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1476/2107] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:09 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:44:10.334460 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-bfd3082b-e9bf-4c66-a8a0-7606561054de tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:10.335045 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-bfd3082b-e9bf-4c66-a8a0-7606561054de tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:10.341425 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bfd3082b-e9bf-4c66-a8a0-7606561054de tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:10.341889 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bfd3082b-e9bf-4c66-a8a0-7606561054de tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:10.342633 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bfd3082b-e9bf-4c66-a8a0-7606561054de tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:10.343059 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bfd3082b-e9bf-4c66-a8a0-7606561054de tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:10.345546 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:44:10.479326 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-bfd3082b-e9bf-4c66-a8a0-7606561054de tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:10.486834 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-bfd3082b-e9bf-4c66-a8a0-7606561054de tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.156800 Jul 20 19:44:10.487405 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1477/2108] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:10 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:44:10.492464 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ba0e4de4-109d-4f69-a6b9-13982fa849c2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:10.493069 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ba0e4de4-109d-4f69-a6b9-13982fa849c2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:10.499072 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ba0e4de4-109d-4f69-a6b9-13982fa849c2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:10.499520 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ba0e4de4-109d-4f69-a6b9-13982fa849c2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:10.500271 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ba0e4de4-109d-4f69-a6b9-13982fa849c2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:10.500701 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ba0e4de4-109d-4f69-a6b9-13982fa849c2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:10.560719 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ba0e4de4-109d-4f69-a6b9-13982fa849c2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:10.568876 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ba0e4de4-109d-4f69-a6b9-13982fa849c2 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080526 Jul 20 19:44:10.569667 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1478/2109] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:10 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:44:11.505257 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-68127876-f09d-4415-8e26-c0b1d457a53f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:11.505977 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-68127876-f09d-4415-8e26-c0b1d457a53f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:11.512337 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-68127876-f09d-4415-8e26-c0b1d457a53f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:11.512780 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-68127876-f09d-4415-8e26-c0b1d457a53f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:11.513543 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-68127876-f09d-4415-8e26-c0b1d457a53f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:11.513975 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-68127876-f09d-4415-8e26-c0b1d457a53f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:11.644012 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-68127876-f09d-4415-8e26-c0b1d457a53f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:11.652308 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-68127876-f09d-4415-8e26-c0b1d457a53f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.151420 Jul 20 19:44:11.652877 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1479/2110] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:11 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:44:11.657288 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d0af6d19-f237-47db-8a7f-ae05927d2aa6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:11.657905 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d0af6d19-f237-47db-8a7f-ae05927d2aa6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:11.664557 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d0af6d19-f237-47db-8a7f-ae05927d2aa6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:11.665002 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d0af6d19-f237-47db-8a7f-ae05927d2aa6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:11.665793 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d0af6d19-f237-47db-8a7f-ae05927d2aa6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:11.666220 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d0af6d19-f237-47db-8a7f-ae05927d2aa6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:11.731473 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d0af6d19-f237-47db-8a7f-ae05927d2aa6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:11.739434 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d0af6d19-f237-47db-8a7f-ae05927d2aa6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.085333 Jul 20 19:44:11.739729 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1480/2111] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:11 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:44:12.669793 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-f8f1116d-b0ec-4907-8623-ee3642fcfb3d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:12.670546 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-f8f1116d-b0ec-4907-8623-ee3642fcfb3d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:12.677571 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f8f1116d-b0ec-4907-8623-ee3642fcfb3d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:12.678031 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f8f1116d-b0ec-4907-8623-ee3642fcfb3d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:12.678793 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f8f1116d-b0ec-4907-8623-ee3642fcfb3d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:12.679228 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f8f1116d-b0ec-4907-8623-ee3642fcfb3d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:12.810947 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-f8f1116d-b0ec-4907-8623-ee3642fcfb3d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:12.818437 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-f8f1116d-b0ec-4907-8623-ee3642fcfb3d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.152595 Jul 20 19:44:12.819017 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1481/2112] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:12 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:44:12.823534 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4d6ff82c-8959-4df5-86b6-7b141df8967e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:12.824136 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-4d6ff82c-8959-4df5-86b6-7b141df8967e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:12.829801 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4d6ff82c-8959-4df5-86b6-7b141df8967e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:12.830251 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4d6ff82c-8959-4df5-86b6-7b141df8967e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:12.831009 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4d6ff82c-8959-4df5-86b6-7b141df8967e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:12.831447 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4d6ff82c-8959-4df5-86b6-7b141df8967e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:12.893101 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-4d6ff82c-8959-4df5-86b6-7b141df8967e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:12.900639 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-4d6ff82c-8959-4df5-86b6-7b141df8967e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080683 Jul 20 19:44:12.901205 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1482/2113] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:12 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:44:13.835762 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-7b7cac23-5a56-4543-9f21-1378220546aa tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:13.836446 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-7b7cac23-5a56-4543-9f21-1378220546aa tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:13.842931 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7b7cac23-5a56-4543-9f21-1378220546aa tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:13.843379 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7b7cac23-5a56-4543-9f21-1378220546aa tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:13.844139 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7b7cac23-5a56-4543-9f21-1378220546aa tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:13.844576 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7b7cac23-5a56-4543-9f21-1378220546aa tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:13.978651 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-7b7cac23-5a56-4543-9f21-1378220546aa tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:13.986145 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-7b7cac23-5a56-4543-9f21-1378220546aa tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.154811 Jul 20 19:44:13.986708 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1483/2114] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:13 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:44:13.991923 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-59ca6ea5-78c7-417f-bc9a-31af2d5c02e8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:13.992525 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-59ca6ea5-78c7-417f-bc9a-31af2d5c02e8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:13.998177 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-59ca6ea5-78c7-417f-bc9a-31af2d5c02e8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:13.998630 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-59ca6ea5-78c7-417f-bc9a-31af2d5c02e8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:13.999392 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-59ca6ea5-78c7-417f-bc9a-31af2d5c02e8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:13.999830 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-59ca6ea5-78c7-417f-bc9a-31af2d5c02e8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:14.059625 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-59ca6ea5-78c7-417f-bc9a-31af2d5c02e8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:14.067688 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-59ca6ea5-78c7-417f-bc9a-31af2d5c02e8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080031 Jul 20 19:44:14.068260 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1484/2115] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:13 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:44:15.003574 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-407fc2fa-30c2-463f-8e19-a50c3351635a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:15.004282 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-407fc2fa-30c2-463f-8e19-a50c3351635a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:15.011007 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-407fc2fa-30c2-463f-8e19-a50c3351635a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:15.011459 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-407fc2fa-30c2-463f-8e19-a50c3351635a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:15.012219 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-407fc2fa-30c2-463f-8e19-a50c3351635a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:15.012658 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-407fc2fa-30c2-463f-8e19-a50c3351635a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:15.143896 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-407fc2fa-30c2-463f-8e19-a50c3351635a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:15.152063 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-407fc2fa-30c2-463f-8e19-a50c3351635a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.152319 Jul 20 19:44:15.152636 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1485/2116] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:14 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:44:15.157047 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d0d8223f-1d1c-4005-9ecb-9000cb63338f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:15.157670 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d0d8223f-1d1c-4005-9ecb-9000cb63338f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:15.163420 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d0d8223f-1d1c-4005-9ecb-9000cb63338f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:15.163881 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d0d8223f-1d1c-4005-9ecb-9000cb63338f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:15.164642 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d0d8223f-1d1c-4005-9ecb-9000cb63338f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:15.165077 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d0d8223f-1d1c-4005-9ecb-9000cb63338f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:15.228606 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d0d8223f-1d1c-4005-9ecb-9000cb63338f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:15.236168 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d0d8223f-1d1c-4005-9ecb-9000cb63338f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.082599 Jul 20 19:44:15.236731 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1486/2117] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:15 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:44:16.169106 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-6a2aafc9-7abd-4e81-8237-08c0c3c6e1b6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:16.169826 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-6a2aafc9-7abd-4e81-8237-08c0c3c6e1b6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:16.176758 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6a2aafc9-7abd-4e81-8237-08c0c3c6e1b6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:16.177292 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6a2aafc9-7abd-4e81-8237-08c0c3c6e1b6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:16.178074 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6a2aafc9-7abd-4e81-8237-08c0c3c6e1b6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:16.178510 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6a2aafc9-7abd-4e81-8237-08c0c3c6e1b6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:16.307030 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6a2aafc9-7abd-4e81-8237-08c0c3c6e1b6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:16.314680 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-6a2aafc9-7abd-4e81-8237-08c0c3c6e1b6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.149446 Jul 20 19:44:16.315251 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1487/2118] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:16 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:44:16.320348 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4abc1df4-409d-47ab-a7af-26b80c7f70db tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:16.321005 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-4abc1df4-409d-47ab-a7af-26b80c7f70db tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:16.327111 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4abc1df4-409d-47ab-a7af-26b80c7f70db tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:16.327586 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4abc1df4-409d-47ab-a7af-26b80c7f70db tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:16.328352 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4abc1df4-409d-47ab-a7af-26b80c7f70db tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:16.328782 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4abc1df4-409d-47ab-a7af-26b80c7f70db tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:16.392104 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-4abc1df4-409d-47ab-a7af-26b80c7f70db tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:16.399755 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-4abc1df4-409d-47ab-a7af-26b80c7f70db tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.083555 Jul 20 19:44:16.400322 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1488/2119] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:16 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:44:17.332780 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-30f168dd-467f-4fba-bdc8-c355b6d124af tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:17.333455 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-30f168dd-467f-4fba-bdc8-c355b6d124af tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:17.339942 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-30f168dd-467f-4fba-bdc8-c355b6d124af tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:17.340395 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-30f168dd-467f-4fba-bdc8-c355b6d124af tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:17.341155 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-30f168dd-467f-4fba-bdc8-c355b6d124af tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:17.341623 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-30f168dd-467f-4fba-bdc8-c355b6d124af tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:17.476122 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-30f168dd-467f-4fba-bdc8-c355b6d124af tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:17.483499 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-30f168dd-467f-4fba-bdc8-c355b6d124af tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.155238 Jul 20 19:44:17.484060 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1489/2120] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:17 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:44:17.488836 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-18406d65-73e4-4a6b-a84a-796eaa0d5348 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:17.489432 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-18406d65-73e4-4a6b-a84a-796eaa0d5348 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:17.495231 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-18406d65-73e4-4a6b-a84a-796eaa0d5348 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:17.495669 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-18406d65-73e4-4a6b-a84a-796eaa0d5348 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:17.496416 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-18406d65-73e4-4a6b-a84a-796eaa0d5348 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:17.496844 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-18406d65-73e4-4a6b-a84a-796eaa0d5348 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:17.556884 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-18406d65-73e4-4a6b-a84a-796eaa0d5348 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:17.564334 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-18406d65-73e4-4a6b-a84a-796eaa0d5348 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.079349 Jul 20 19:44:17.564900 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1490/2121] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:17 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:44:18.501011 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-58c85a94-f583-4445-8015-f656a59609e4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:18.501665 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-58c85a94-f583-4445-8015-f656a59609e4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:18.509031 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-58c85a94-f583-4445-8015-f656a59609e4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:18.509474 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-58c85a94-f583-4445-8015-f656a59609e4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:18.510255 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-58c85a94-f583-4445-8015-f656a59609e4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:18.510689 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-58c85a94-f583-4445-8015-f656a59609e4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:18.640894 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-58c85a94-f583-4445-8015-f656a59609e4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:18.649273 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-58c85a94-f583-4445-8015-f656a59609e4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.152113 Jul 20 19:44:18.649873 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1491/2122] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:18 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:44:18.654232 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-3594ba69-6fb5-4856-a73a-b8eae8ace535 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:18.654826 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-3594ba69-6fb5-4856-a73a-b8eae8ace535 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:18.660545 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3594ba69-6fb5-4856-a73a-b8eae8ace535 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:18.660983 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3594ba69-6fb5-4856-a73a-b8eae8ace535 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:18.661766 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3594ba69-6fb5-4856-a73a-b8eae8ace535 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:18.662194 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3594ba69-6fb5-4856-a73a-b8eae8ace535 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:18.727450 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3594ba69-6fb5-4856-a73a-b8eae8ace535 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:18.734884 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-3594ba69-6fb5-4856-a73a-b8eae8ace535 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.084087 Jul 20 19:44:18.735437 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1492/2123] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:18 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:44:19.665839 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-bf3e5236-6395-4588-804a-a53db30fa504 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:19.666501 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-bf3e5236-6395-4588-804a-a53db30fa504 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:19.673343 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bf3e5236-6395-4588-804a-a53db30fa504 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:19.673822 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bf3e5236-6395-4588-804a-a53db30fa504 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:19.674570 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bf3e5236-6395-4588-804a-a53db30fa504 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:19.674997 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bf3e5236-6395-4588-804a-a53db30fa504 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:19.809696 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-bf3e5236-6395-4588-804a-a53db30fa504 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:19.811876 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:44:19.819311 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-bf3e5236-6395-4588-804a-a53db30fa504 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.157290 Jul 20 19:44:19.819886 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1493/2124] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:19 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:44:19.824407 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-619e0192-10b2-41f3-948c-06dab1a1997a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:19.825006 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-619e0192-10b2-41f3-948c-06dab1a1997a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:19.830838 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-619e0192-10b2-41f3-948c-06dab1a1997a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:19.831309 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-619e0192-10b2-41f3-948c-06dab1a1997a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:19.832116 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-619e0192-10b2-41f3-948c-06dab1a1997a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:19.832545 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-619e0192-10b2-41f3-948c-06dab1a1997a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:19.893639 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-619e0192-10b2-41f3-948c-06dab1a1997a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:19.901205 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-619e0192-10b2-41f3-948c-06dab1a1997a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080377 Jul 20 19:44:19.901800 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1494/2125] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:19 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:44:20.837017 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-2375c0b6-dd2c-495c-84e4-d955a18bdada tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:20.837678 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-2375c0b6-dd2c-495c-84e4-d955a18bdada tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:20.844036 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2375c0b6-dd2c-495c-84e4-d955a18bdada tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:20.844480 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2375c0b6-dd2c-495c-84e4-d955a18bdada tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:20.845227 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2375c0b6-dd2c-495c-84e4-d955a18bdada tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:20.845693 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2375c0b6-dd2c-495c-84e4-d955a18bdada tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:20.981627 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-2375c0b6-dd2c-495c-84e4-d955a18bdada tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:20.989111 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-2375c0b6-dd2c-495c-84e4-d955a18bdada tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.156970 Jul 20 19:44:20.989734 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1495/2126] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:20 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:44:20.994067 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-fe726c02-8e8f-438a-80ac-5534d9fa2e39 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:20.994662 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-fe726c02-8e8f-438a-80ac-5534d9fa2e39 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:21.000381 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fe726c02-8e8f-438a-80ac-5534d9fa2e39 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:21.000828 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fe726c02-8e8f-438a-80ac-5534d9fa2e39 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:21.001613 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fe726c02-8e8f-438a-80ac-5534d9fa2e39 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:21.002055 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fe726c02-8e8f-438a-80ac-5534d9fa2e39 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:21.064191 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-fe726c02-8e8f-438a-80ac-5534d9fa2e39 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:21.072284 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-fe726c02-8e8f-438a-80ac-5534d9fa2e39 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.081615 Jul 20 19:44:21.072875 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1496/2127] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:20 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:44:22.006078 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-3f4709a1-9751-45c1-8ee2-c0294a48d980 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:22.006854 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-3f4709a1-9751-45c1-8ee2-c0294a48d980 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:22.013194 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3f4709a1-9751-45c1-8ee2-c0294a48d980 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:22.013679 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3f4709a1-9751-45c1-8ee2-c0294a48d980 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:22.014439 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3f4709a1-9751-45c1-8ee2-c0294a48d980 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:22.014874 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3f4709a1-9751-45c1-8ee2-c0294a48d980 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:22.142673 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3f4709a1-9751-45c1-8ee2-c0294a48d980 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:22.150672 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-3f4709a1-9751-45c1-8ee2-c0294a48d980 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.148581 Jul 20 19:44:22.151238 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1497/2128] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:22 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:44:22.155577 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-0c21a677-32c4-4ad2-b498-a2a302a5b38c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:22.156185 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-0c21a677-32c4-4ad2-b498-a2a302a5b38c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:22.162400 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0c21a677-32c4-4ad2-b498-a2a302a5b38c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:22.162852 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0c21a677-32c4-4ad2-b498-a2a302a5b38c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:22.163614 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0c21a677-32c4-4ad2-b498-a2a302a5b38c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:22.164049 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0c21a677-32c4-4ad2-b498-a2a302a5b38c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:22.227668 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0c21a677-32c4-4ad2-b498-a2a302a5b38c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:22.235235 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-0c21a677-32c4-4ad2-b498-a2a302a5b38c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.083060 Jul 20 19:44:22.235803 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1498/2129] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:22 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:44:23.167631 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c3952d5c-6aba-4499-b980-56ac268afcb7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:23.168285 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c3952d5c-6aba-4499-b980-56ac268afcb7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:23.174720 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c3952d5c-6aba-4499-b980-56ac268afcb7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:23.175171 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c3952d5c-6aba-4499-b980-56ac268afcb7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:23.175929 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c3952d5c-6aba-4499-b980-56ac268afcb7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:23.176363 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c3952d5c-6aba-4499-b980-56ac268afcb7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:23.305130 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c3952d5c-6aba-4499-b980-56ac268afcb7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:23.312608 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c3952d5c-6aba-4499-b980-56ac268afcb7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.148952 Jul 20 19:44:23.313173 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1499/2130] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:23 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:44:23.318216 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-b1ad90c5-c0f4-45c6-ad9a-e1b22cd249a8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:23.318826 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-b1ad90c5-c0f4-45c6-ad9a-e1b22cd249a8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:23.324944 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b1ad90c5-c0f4-45c6-ad9a-e1b22cd249a8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:23.325401 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b1ad90c5-c0f4-45c6-ad9a-e1b22cd249a8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:23.326269 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b1ad90c5-c0f4-45c6-ad9a-e1b22cd249a8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:23.327625 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b1ad90c5-c0f4-45c6-ad9a-e1b22cd249a8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:23.388447 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-b1ad90c5-c0f4-45c6-ad9a-e1b22cd249a8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:23.396611 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-b1ad90c5-c0f4-45c6-ad9a-e1b22cd249a8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.082456 Jul 20 19:44:23.397183 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1500/2131] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:23 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:44:24.330557 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-1c56d44d-9ef8-4ee8-986c-287bd86c9ada tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:24.331145 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-1c56d44d-9ef8-4ee8-986c-287bd86c9ada tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:24.337782 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1c56d44d-9ef8-4ee8-986c-287bd86c9ada tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:24.338222 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1c56d44d-9ef8-4ee8-986c-287bd86c9ada tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:24.338963 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1c56d44d-9ef8-4ee8-986c-287bd86c9ada tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:24.339389 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1c56d44d-9ef8-4ee8-986c-287bd86c9ada tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:24.475092 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1c56d44d-9ef8-4ee8-986c-287bd86c9ada tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:24.482784 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-1c56d44d-9ef8-4ee8-986c-287bd86c9ada tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.156016 Jul 20 19:44:24.483351 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1501/2132] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:24 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:44:24.487789 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-895d8bcb-b4f9-4b06-8e9b-2530609af94c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:24.488893 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-895d8bcb-b4f9-4b06-8e9b-2530609af94c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:24.494849 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-895d8bcb-b4f9-4b06-8e9b-2530609af94c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:24.495324 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-895d8bcb-b4f9-4b06-8e9b-2530609af94c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:24.496074 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-895d8bcb-b4f9-4b06-8e9b-2530609af94c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:24.496506 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-895d8bcb-b4f9-4b06-8e9b-2530609af94c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:24.557147 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-895d8bcb-b4f9-4b06-8e9b-2530609af94c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:24.565025 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-895d8bcb-b4f9-4b06-8e9b-2530609af94c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080385 Jul 20 19:44:24.566254 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1502/2133] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:24 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:44:25.500201 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-430e1994-64af-4414-b1a6-2d2cff1512e5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:25.500867 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-430e1994-64af-4414-b1a6-2d2cff1512e5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:25.507892 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-430e1994-64af-4414-b1a6-2d2cff1512e5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:25.508339 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-430e1994-64af-4414-b1a6-2d2cff1512e5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:25.509098 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-430e1994-64af-4414-b1a6-2d2cff1512e5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:25.509539 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-430e1994-64af-4414-b1a6-2d2cff1512e5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:25.639825 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-430e1994-64af-4414-b1a6-2d2cff1512e5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:25.648099 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-430e1994-64af-4414-b1a6-2d2cff1512e5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.151835 Jul 20 19:44:25.648665 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1503/2134] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:25 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:44:25.653002 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-1be2e988-6a60-4a8a-b76a-ffb863812f6c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:25.653633 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-1be2e988-6a60-4a8a-b76a-ffb863812f6c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:25.659283 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1be2e988-6a60-4a8a-b76a-ffb863812f6c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:25.659735 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1be2e988-6a60-4a8a-b76a-ffb863812f6c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:25.660648 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1be2e988-6a60-4a8a-b76a-ffb863812f6c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:25.661088 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1be2e988-6a60-4a8a-b76a-ffb863812f6c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:25.727014 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1be2e988-6a60-4a8a-b76a-ffb863812f6c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:25.734519 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-1be2e988-6a60-4a8a-b76a-ffb863812f6c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.084917 Jul 20 19:44:25.735080 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1504/2135] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:25 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:44:26.665660 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-6077934e-89a1-46f6-8940-5a9e3c13af6e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:26.666341 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-6077934e-89a1-46f6-8940-5a9e3c13af6e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:26.672952 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6077934e-89a1-46f6-8940-5a9e3c13af6e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:26.673402 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6077934e-89a1-46f6-8940-5a9e3c13af6e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:26.674189 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6077934e-89a1-46f6-8940-5a9e3c13af6e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:26.674626 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6077934e-89a1-46f6-8940-5a9e3c13af6e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:26.809396 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6077934e-89a1-46f6-8940-5a9e3c13af6e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:26.816935 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-6077934e-89a1-46f6-8940-5a9e3c13af6e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.155206 Jul 20 19:44:26.817495 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1505/2136] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:26 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:44:26.821866 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-b32cce1e-24b0-4f27-943f-70450aa5d1e4 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:26.822465 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-b32cce1e-24b0-4f27-943f-70450aa5d1e4 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:26.828342 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b32cce1e-24b0-4f27-943f-70450aa5d1e4 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:26.828729 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b32cce1e-24b0-4f27-943f-70450aa5d1e4 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:26.829478 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b32cce1e-24b0-4f27-943f-70450aa5d1e4 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:26.829948 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b32cce1e-24b0-4f27-943f-70450aa5d1e4 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:26.891491 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-b32cce1e-24b0-4f27-943f-70450aa5d1e4 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:26.899810 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-b32cce1e-24b0-4f27-943f-70450aa5d1e4 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.081323 Jul 20 19:44:26.899810 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1506/2137] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:26 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:44:27.833972 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ad411143-07d6-4398-812b-4ede7a34e5bc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:27.835175 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ad411143-07d6-4398-812b-4ede7a34e5bc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:27.842639 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ad411143-07d6-4398-812b-4ede7a34e5bc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:27.843074 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ad411143-07d6-4398-812b-4ede7a34e5bc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:27.844860 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ad411143-07d6-4398-812b-4ede7a34e5bc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:27.845419 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ad411143-07d6-4398-812b-4ede7a34e5bc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:27.998576 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ad411143-07d6-4398-812b-4ede7a34e5bc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:28.006834 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ad411143-07d6-4398-812b-4ede7a34e5bc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.176921 Jul 20 19:44:28.007394 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1507/2138] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:27 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:44:28.011686 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ac5ecd80-8d64-4ffb-8dee-48221fe72c52 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:28.012276 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ac5ecd80-8d64-4ffb-8dee-48221fe72c52 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:28.017733 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ac5ecd80-8d64-4ffb-8dee-48221fe72c52 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:28.018178 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ac5ecd80-8d64-4ffb-8dee-48221fe72c52 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:28.018920 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ac5ecd80-8d64-4ffb-8dee-48221fe72c52 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:28.019500 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ac5ecd80-8d64-4ffb-8dee-48221fe72c52 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:28.079528 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ac5ecd80-8d64-4ffb-8dee-48221fe72c52 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:28.087132 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ac5ecd80-8d64-4ffb-8dee-48221fe72c52 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.078749 Jul 20 19:44:28.087630 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1508/2139] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:28 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:44:29.024449 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-5cb13b42-27d6-4a7b-a0c4-5aaebe231d31 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:29.025085 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-5cb13b42-27d6-4a7b-a0c4-5aaebe231d31 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:29.031646 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5cb13b42-27d6-4a7b-a0c4-5aaebe231d31 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:29.032093 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5cb13b42-27d6-4a7b-a0c4-5aaebe231d31 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:29.032849 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5cb13b42-27d6-4a7b-a0c4-5aaebe231d31 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:29.033281 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5cb13b42-27d6-4a7b-a0c4-5aaebe231d31 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:29.164966 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-5cb13b42-27d6-4a7b-a0c4-5aaebe231d31 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:29.172336 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-5cb13b42-27d6-4a7b-a0c4-5aaebe231d31 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.151990 Jul 20 19:44:29.172900 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1509/2140] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:29 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:44:29.177360 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-73bcd6fd-1e91-45fa-b5ad-8fc0a62f9f5f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:29.177979 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-73bcd6fd-1e91-45fa-b5ad-8fc0a62f9f5f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:29.183560 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-73bcd6fd-1e91-45fa-b5ad-8fc0a62f9f5f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:29.184000 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-73bcd6fd-1e91-45fa-b5ad-8fc0a62f9f5f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:29.184744 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-73bcd6fd-1e91-45fa-b5ad-8fc0a62f9f5f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:29.185170 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-73bcd6fd-1e91-45fa-b5ad-8fc0a62f9f5f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:29.199832 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:44:29.249360 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-73bcd6fd-1e91-45fa-b5ad-8fc0a62f9f5f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:29.257795 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-73bcd6fd-1e91-45fa-b5ad-8fc0a62f9f5f tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.083932 Jul 20 19:44:29.258359 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1510/2141] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:29 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:44:30.189674 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-0fe48c4c-a15a-41a9-93f4-8c8b4c1dbf54 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:30.190364 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-0fe48c4c-a15a-41a9-93f4-8c8b4c1dbf54 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:30.197408 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0fe48c4c-a15a-41a9-93f4-8c8b4c1dbf54 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:30.197959 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0fe48c4c-a15a-41a9-93f4-8c8b4c1dbf54 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:30.198713 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0fe48c4c-a15a-41a9-93f4-8c8b4c1dbf54 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:30.199145 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0fe48c4c-a15a-41a9-93f4-8c8b4c1dbf54 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:30.330895 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0fe48c4c-a15a-41a9-93f4-8c8b4c1dbf54 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:30.338473 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-0fe48c4c-a15a-41a9-93f4-8c8b4c1dbf54 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.152651 Jul 20 19:44:30.339029 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1511/2142] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:30 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:44:30.343299 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-f6558740-3251-47dd-821f-a631f9d0fdb1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:30.343890 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-f6558740-3251-47dd-821f-a631f9d0fdb1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:30.349799 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f6558740-3251-47dd-821f-a631f9d0fdb1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:30.350242 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f6558740-3251-47dd-821f-a631f9d0fdb1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:30.350984 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f6558740-3251-47dd-821f-a631f9d0fdb1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:30.351410 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f6558740-3251-47dd-821f-a631f9d0fdb1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:30.411766 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-f6558740-3251-47dd-821f-a631f9d0fdb1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:30.419247 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-f6558740-3251-47dd-821f-a631f9d0fdb1 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.079288 Jul 20 19:44:30.419818 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1512/2143] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:30 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:44:31.355649 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-5d3f00e7-8458-4501-bce0-9b30647d9da6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:31.356267 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-5d3f00e7-8458-4501-bce0-9b30647d9da6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:31.362684 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5d3f00e7-8458-4501-bce0-9b30647d9da6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:31.363992 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5d3f00e7-8458-4501-bce0-9b30647d9da6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:31.364738 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5d3f00e7-8458-4501-bce0-9b30647d9da6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:31.365086 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5d3f00e7-8458-4501-bce0-9b30647d9da6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:31.496567 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-5d3f00e7-8458-4501-bce0-9b30647d9da6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:31.504664 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-5d3f00e7-8458-4501-bce0-9b30647d9da6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.152948 Jul 20 19:44:31.505220 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1513/2144] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:31 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:44:31.509536 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-450c342e-a565-41c1-951c-fd7506b0461d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:31.510236 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-450c342e-a565-41c1-951c-fd7506b0461d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:31.515713 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-450c342e-a565-41c1-951c-fd7506b0461d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:31.516159 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-450c342e-a565-41c1-951c-fd7506b0461d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:31.516900 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-450c342e-a565-41c1-951c-fd7506b0461d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:31.517323 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-450c342e-a565-41c1-951c-fd7506b0461d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:31.577429 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-450c342e-a565-41c1-951c-fd7506b0461d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:31.585781 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-450c342e-a565-41c1-951c-fd7506b0461d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.079565 Jul 20 19:44:31.586351 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1514/2145] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:31 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:44:32.521810 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-3d1c2b55-1b89-44f9-a3fb-f4141d35f282 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:32.522492 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-3d1c2b55-1b89-44f9-a3fb-f4141d35f282 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:32.528898 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3d1c2b55-1b89-44f9-a3fb-f4141d35f282 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:32.529348 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3d1c2b55-1b89-44f9-a3fb-f4141d35f282 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:32.530155 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3d1c2b55-1b89-44f9-a3fb-f4141d35f282 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:32.530589 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3d1c2b55-1b89-44f9-a3fb-f4141d35f282 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:32.659917 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3d1c2b55-1b89-44f9-a3fb-f4141d35f282 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:32.667474 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-3d1c2b55-1b89-44f9-a3fb-f4141d35f282 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.149704 Jul 20 19:44:32.668035 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1515/2146] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:32 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:44:32.672358 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-48d3559c-35e7-4ded-b7e4-9ce1e15506e6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:32.672949 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-48d3559c-35e7-4ded-b7e4-9ce1e15506e6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:32.674579 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_api:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:44:32.680503 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-48d3559c-35e7-4ded-b7e4-9ce1e15506e6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:32.680950 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-48d3559c-35e7-4ded-b7e4-9ce1e15506e6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:32.681746 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-48d3559c-35e7-4ded-b7e4-9ce1e15506e6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:32.682181 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-48d3559c-35e7-4ded-b7e4-9ce1e15506e6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:32.745931 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-48d3559c-35e7-4ded-b7e4-9ce1e15506e6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:32.753467 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-48d3559c-35e7-4ded-b7e4-9ce1e15506e6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.084498 Jul 20 19:44:32.754884 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1516/2147] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:32 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:44:33.685207 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-83a0c645-52d0-4a8b-ae7c-a77651fbeb6c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:33.685897 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-83a0c645-52d0-4a8b-ae7c-a77651fbeb6c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:33.692516 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-83a0c645-52d0-4a8b-ae7c-a77651fbeb6c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:33.692965 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-83a0c645-52d0-4a8b-ae7c-a77651fbeb6c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:33.693772 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-83a0c645-52d0-4a8b-ae7c-a77651fbeb6c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:33.694209 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-83a0c645-52d0-4a8b-ae7c-a77651fbeb6c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:33.824402 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-83a0c645-52d0-4a8b-ae7c-a77651fbeb6c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:33.832398 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-83a0c645-52d0-4a8b-ae7c-a77651fbeb6c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.150576 Jul 20 19:44:33.832961 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1517/2148] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:33 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:44:33.837411 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-1ce263a2-dd85-4f1e-afac-8c5c15feb1c5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:33.838042 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-1ce263a2-dd85-4f1e-afac-8c5c15feb1c5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:33.843656 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1ce263a2-dd85-4f1e-afac-8c5c15feb1c5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:33.844105 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1ce263a2-dd85-4f1e-afac-8c5c15feb1c5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:33.844860 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1ce263a2-dd85-4f1e-afac-8c5c15feb1c5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:33.845290 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1ce263a2-dd85-4f1e-afac-8c5c15feb1c5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:33.905692 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1ce263a2-dd85-4f1e-afac-8c5c15feb1c5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:33.913951 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-1ce263a2-dd85-4f1e-afac-8c5c15feb1c5 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080026 Jul 20 19:44:33.914520 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1518/2149] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:33 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:44:34.848817 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-8e16c63f-b412-4ae4-ba9a-413598885319 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:34.849456 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-8e16c63f-b412-4ae4-ba9a-413598885319 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:34.855802 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8e16c63f-b412-4ae4-ba9a-413598885319 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:34.856247 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8e16c63f-b412-4ae4-ba9a-413598885319 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:34.857000 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8e16c63f-b412-4ae4-ba9a-413598885319 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:34.857432 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8e16c63f-b412-4ae4-ba9a-413598885319 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:34.991277 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8e16c63f-b412-4ae4-ba9a-413598885319 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:34.999316 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-8e16c63f-b412-4ae4-ba9a-413598885319 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.154873 Jul 20 19:44:34.999880 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1519/2150] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:34 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:44:35.004941 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a7e19efe-bbd9-4b0c-9588-64c5daa239b9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:35.005565 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a7e19efe-bbd9-4b0c-9588-64c5daa239b9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:35.011210 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a7e19efe-bbd9-4b0c-9588-64c5daa239b9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:35.011659 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a7e19efe-bbd9-4b0c-9588-64c5daa239b9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:35.012416 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a7e19efe-bbd9-4b0c-9588-64c5daa239b9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:35.012851 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a7e19efe-bbd9-4b0c-9588-64c5daa239b9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:35.074883 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a7e19efe-bbd9-4b0c-9588-64c5daa239b9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:35.082848 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a7e19efe-bbd9-4b0c-9588-64c5daa239b9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.082021 Jul 20 19:44:35.083600 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1520/2151] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:34 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:44:36.017026 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-8f8aeb39-6226-49af-ada9-1a93a3cd40bb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:36.017691 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-8f8aeb39-6226-49af-ada9-1a93a3cd40bb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:36.025111 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8f8aeb39-6226-49af-ada9-1a93a3cd40bb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:36.025582 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8f8aeb39-6226-49af-ada9-1a93a3cd40bb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:36.026372 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8f8aeb39-6226-49af-ada9-1a93a3cd40bb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:36.026805 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8f8aeb39-6226-49af-ada9-1a93a3cd40bb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:36.156893 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8f8aeb39-6226-49af-ada9-1a93a3cd40bb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:36.164890 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-8f8aeb39-6226-49af-ada9-1a93a3cd40bb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.151780 Jul 20 19:44:36.165443 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1521/2152] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:36 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:44:36.169948 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-9c597545-0a2e-499c-a797-62099b6f2943 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:36.170543 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-9c597545-0a2e-499c-a797-62099b6f2943 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:36.176671 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9c597545-0a2e-499c-a797-62099b6f2943 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:36.177113 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9c597545-0a2e-499c-a797-62099b6f2943 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:36.177880 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9c597545-0a2e-499c-a797-62099b6f2943 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:36.178310 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9c597545-0a2e-499c-a797-62099b6f2943 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:36.241312 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-9c597545-0a2e-499c-a797-62099b6f2943 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:36.249057 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-9c597545-0a2e-499c-a797-62099b6f2943 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.082635 Jul 20 19:44:36.249630 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1522/2153] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:36 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:44:37.182375 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-00672b3b-6f76-4619-95c2-69eefa3a7731 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:37.183082 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-00672b3b-6f76-4619-95c2-69eefa3a7731 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:37.189456 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-00672b3b-6f76-4619-95c2-69eefa3a7731 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:37.189932 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-00672b3b-6f76-4619-95c2-69eefa3a7731 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:37.190759 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-00672b3b-6f76-4619-95c2-69eefa3a7731 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:37.191236 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-00672b3b-6f76-4619-95c2-69eefa3a7731 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:37.320628 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-00672b3b-6f76-4619-95c2-69eefa3a7731 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:37.328488 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-00672b3b-6f76-4619-95c2-69eefa3a7731 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.150570 Jul 20 19:44:37.329054 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1523/2154] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:37 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:44:37.334485 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-741f393a-d05c-4137-ac2d-911e7668e07d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:37.335082 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-741f393a-d05c-4137-ac2d-911e7668e07d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:37.340814 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-741f393a-d05c-4137-ac2d-911e7668e07d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:37.341258 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-741f393a-d05c-4137-ac2d-911e7668e07d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:37.342045 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-741f393a-d05c-4137-ac2d-911e7668e07d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:37.342486 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-741f393a-d05c-4137-ac2d-911e7668e07d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:37.403346 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-741f393a-d05c-4137-ac2d-911e7668e07d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:37.410994 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-741f393a-d05c-4137-ac2d-911e7668e07d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080954 Jul 20 19:44:37.411557 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1524/2155] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:37 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:44:38.345899 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d7f1392a-e796-40b1-88a4-1a04cbc92caf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:38.346485 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d7f1392a-e796-40b1-88a4-1a04cbc92caf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:38.353201 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d7f1392a-e796-40b1-88a4-1a04cbc92caf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:38.353687 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d7f1392a-e796-40b1-88a4-1a04cbc92caf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:38.354439 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d7f1392a-e796-40b1-88a4-1a04cbc92caf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:38.354870 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d7f1392a-e796-40b1-88a4-1a04cbc92caf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:38.488680 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d7f1392a-e796-40b1-88a4-1a04cbc92caf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:38.496203 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d7f1392a-e796-40b1-88a4-1a04cbc92caf tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.154090 Jul 20 19:44:38.496755 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1525/2156] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:38 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:44:38.501029 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-eef2947a-94fe-4336-b566-08fd2db14b05 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:38.501666 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-eef2947a-94fe-4336-b566-08fd2db14b05 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:38.507994 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-eef2947a-94fe-4336-b566-08fd2db14b05 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:38.508435 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-eef2947a-94fe-4336-b566-08fd2db14b05 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:38.509185 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-eef2947a-94fe-4336-b566-08fd2db14b05 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:38.509639 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-eef2947a-94fe-4336-b566-08fd2db14b05 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:38.570294 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-eef2947a-94fe-4336-b566-08fd2db14b05 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:38.577780 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-eef2947a-94fe-4336-b566-08fd2db14b05 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080006 Jul 20 19:44:38.578280 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1526/2157] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:38 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:44:39.514091 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-71f6f39e-043b-4231-865c-6d6ba1b9067f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:39.514748 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-71f6f39e-043b-4231-865c-6d6ba1b9067f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:39.522136 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-71f6f39e-043b-4231-865c-6d6ba1b9067f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:39.522586 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-71f6f39e-043b-4231-865c-6d6ba1b9067f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:39.523372 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-71f6f39e-043b-4231-865c-6d6ba1b9067f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:39.523807 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-71f6f39e-043b-4231-865c-6d6ba1b9067f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:39.526353 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:44:39.656899 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-71f6f39e-043b-4231-865c-6d6ba1b9067f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:39.664504 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-71f6f39e-043b-4231-865c-6d6ba1b9067f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.154315 Jul 20 19:44:39.665069 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1527/2158] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:39 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:44:39.669660 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-00eabc8f-1bd3-4efb-8ad6-b5a5b51504ad tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:39.670269 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-00eabc8f-1bd3-4efb-8ad6-b5a5b51504ad tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:39.676358 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-00eabc8f-1bd3-4efb-8ad6-b5a5b51504ad tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:39.676816 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-00eabc8f-1bd3-4efb-8ad6-b5a5b51504ad tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:39.677615 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-00eabc8f-1bd3-4efb-8ad6-b5a5b51504ad tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:39.678056 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-00eabc8f-1bd3-4efb-8ad6-b5a5b51504ad tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:39.743774 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-00eabc8f-1bd3-4efb-8ad6-b5a5b51504ad tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:39.751222 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-00eabc8f-1bd3-4efb-8ad6-b5a5b51504ad tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.085188 Jul 20 19:44:39.751785 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1528/2159] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:39 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:44:40.681907 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-96ced13f-12d9-4518-bbd6-dfd9202c9178 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:40.682546 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-96ced13f-12d9-4518-bbd6-dfd9202c9178 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:40.689256 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-96ced13f-12d9-4518-bbd6-dfd9202c9178 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:40.689741 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-96ced13f-12d9-4518-bbd6-dfd9202c9178 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:40.690507 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-96ced13f-12d9-4518-bbd6-dfd9202c9178 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:40.690988 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-96ced13f-12d9-4518-bbd6-dfd9202c9178 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:40.823172 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-96ced13f-12d9-4518-bbd6-dfd9202c9178 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:40.830718 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-96ced13f-12d9-4518-bbd6-dfd9202c9178 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.152667 Jul 20 19:44:40.831827 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1529/2160] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:40 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:44:40.836323 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-07a67c08-8ca1-4738-b867-4785fd3aec6a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:40.836895 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-07a67c08-8ca1-4738-b867-4785fd3aec6a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:40.842524 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-07a67c08-8ca1-4738-b867-4785fd3aec6a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:40.842977 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-07a67c08-8ca1-4738-b867-4785fd3aec6a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:40.843742 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-07a67c08-8ca1-4738-b867-4785fd3aec6a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:40.844208 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-07a67c08-8ca1-4738-b867-4785fd3aec6a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:40.905110 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-07a67c08-8ca1-4738-b867-4785fd3aec6a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:40.913227 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-07a67c08-8ca1-4738-b867-4785fd3aec6a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080412 Jul 20 19:44:40.913819 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1530/2161] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:40 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:44:41.848744 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-bcc57650-3916-4437-b135-d36d422631ca tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:41.849458 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-bcc57650-3916-4437-b135-d36d422631ca tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:41.855984 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bcc57650-3916-4437-b135-d36d422631ca tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:41.856428 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bcc57650-3916-4437-b135-d36d422631ca tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:41.857213 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bcc57650-3916-4437-b135-d36d422631ca tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:41.857674 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bcc57650-3916-4437-b135-d36d422631ca tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:41.992445 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-bcc57650-3916-4437-b135-d36d422631ca tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:41.999772 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-bcc57650-3916-4437-b135-d36d422631ca tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.155524 Jul 20 19:44:42.000357 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1531/2162] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:41 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:44:42.004814 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-bd11baaf-2c57-49c7-9661-3ba291e33b15 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:42.005407 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-bd11baaf-2c57-49c7-9661-3ba291e33b15 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:42.010944 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bd11baaf-2c57-49c7-9661-3ba291e33b15 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:42.011388 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bd11baaf-2c57-49c7-9661-3ba291e33b15 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:42.012126 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bd11baaf-2c57-49c7-9661-3ba291e33b15 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:42.012550 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bd11baaf-2c57-49c7-9661-3ba291e33b15 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:42.073010 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-bd11baaf-2c57-49c7-9661-3ba291e33b15 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:42.080308 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-bd11baaf-2c57-49c7-9661-3ba291e33b15 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.079031 Jul 20 19:44:42.080860 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1532/2163] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:42 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:44:43.016173 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e0d771ce-65f0-454b-a111-e56f5cfdb541 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:43.016903 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e0d771ce-65f0-454b-a111-e56f5cfdb541 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:43.023622 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e0d771ce-65f0-454b-a111-e56f5cfdb541 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:43.024073 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e0d771ce-65f0-454b-a111-e56f5cfdb541 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:43.024838 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e0d771ce-65f0-454b-a111-e56f5cfdb541 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:43.025268 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e0d771ce-65f0-454b-a111-e56f5cfdb541 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:43.157940 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e0d771ce-65f0-454b-a111-e56f5cfdb541 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:43.165469 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e0d771ce-65f0-454b-a111-e56f5cfdb541 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.153147 Jul 20 19:44:43.166067 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1533/2164] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:43 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:44:43.170605 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4b04025f-c364-4b04-9ff3-4e0acf541636 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:43.171200 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-4b04025f-c364-4b04-9ff3-4e0acf541636 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:43.177412 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4b04025f-c364-4b04-9ff3-4e0acf541636 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:43.177893 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4b04025f-c364-4b04-9ff3-4e0acf541636 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:43.178659 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4b04025f-c364-4b04-9ff3-4e0acf541636 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:43.179090 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4b04025f-c364-4b04-9ff3-4e0acf541636 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:43.243656 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-4b04025f-c364-4b04-9ff3-4e0acf541636 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:43.251553 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-4b04025f-c364-4b04-9ff3-4e0acf541636 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.084504 Jul 20 19:44:43.252124 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1534/2165] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:43 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:44:44.183160 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-04cdd3c3-7c61-4e58-91eb-1789a460fcf4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:44.183887 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-04cdd3c3-7c61-4e58-91eb-1789a460fcf4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:44.190328 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-04cdd3c3-7c61-4e58-91eb-1789a460fcf4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:44.191312 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-04cdd3c3-7c61-4e58-91eb-1789a460fcf4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:44.192177 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-04cdd3c3-7c61-4e58-91eb-1789a460fcf4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:44.192616 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-04cdd3c3-7c61-4e58-91eb-1789a460fcf4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:44.323088 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-04cdd3c3-7c61-4e58-91eb-1789a460fcf4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:44.330524 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-04cdd3c3-7c61-4e58-91eb-1789a460fcf4 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.151244 Jul 20 19:44:44.331352 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1535/2166] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:44 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:44:44.336343 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-2910463c-49a2-4c14-b4a9-63cb42c2fafd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:44.336977 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-2910463c-49a2-4c14-b4a9-63cb42c2fafd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:44.342600 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2910463c-49a2-4c14-b4a9-63cb42c2fafd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:44.343045 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2910463c-49a2-4c14-b4a9-63cb42c2fafd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:44.343800 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2910463c-49a2-4c14-b4a9-63cb42c2fafd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:44.344237 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2910463c-49a2-4c14-b4a9-63cb42c2fafd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:44.406429 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-2910463c-49a2-4c14-b4a9-63cb42c2fafd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:44.413875 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-2910463c-49a2-4c14-b4a9-63cb42c2fafd tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.081035 Jul 20 19:44:44.414438 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1536/2167] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:44 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:44:45.349282 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-bca77a06-a3ae-4b69-b0e1-a1cff81fcee7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:45.349944 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-bca77a06-a3ae-4b69-b0e1-a1cff81fcee7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:45.356344 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bca77a06-a3ae-4b69-b0e1-a1cff81fcee7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:45.356791 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bca77a06-a3ae-4b69-b0e1-a1cff81fcee7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:45.357565 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bca77a06-a3ae-4b69-b0e1-a1cff81fcee7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:45.358004 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bca77a06-a3ae-4b69-b0e1-a1cff81fcee7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:45.489816 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-bca77a06-a3ae-4b69-b0e1-a1cff81fcee7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:45.497195 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-bca77a06-a3ae-4b69-b0e1-a1cff81fcee7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.152919 Jul 20 19:44:45.497789 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1537/2168] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:45 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:44:45.502063 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-beb521e4-367c-41ef-8b1e-0a7d6c88a980 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:45.502660 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-beb521e4-367c-41ef-8b1e-0a7d6c88a980 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:45.508200 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-beb521e4-367c-41ef-8b1e-0a7d6c88a980 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:45.508646 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-beb521e4-367c-41ef-8b1e-0a7d6c88a980 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:45.509397 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-beb521e4-367c-41ef-8b1e-0a7d6c88a980 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:45.509855 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-beb521e4-367c-41ef-8b1e-0a7d6c88a980 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:45.570089 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-beb521e4-367c-41ef-8b1e-0a7d6c88a980 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:45.577544 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-beb521e4-367c-41ef-8b1e-0a7d6c88a980 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.078745 Jul 20 19:44:45.578045 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1538/2169] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:45 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:44:46.513965 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-09e3537d-e35e-470a-aa1b-351de8b08ac1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:46.514625 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-09e3537d-e35e-470a-aa1b-351de8b08ac1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:46.521391 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-09e3537d-e35e-470a-aa1b-351de8b08ac1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:46.521873 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-09e3537d-e35e-470a-aa1b-351de8b08ac1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:46.522632 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-09e3537d-e35e-470a-aa1b-351de8b08ac1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:46.523064 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-09e3537d-e35e-470a-aa1b-351de8b08ac1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:46.653808 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-09e3537d-e35e-470a-aa1b-351de8b08ac1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:46.661945 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-09e3537d-e35e-470a-aa1b-351de8b08ac1 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.151811 Jul 20 19:44:46.662509 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1539/2170] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:46 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:44:46.666835 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-720e1e8e-e5f5-49e8-ae48-44b87d735ea6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:46.667435 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-720e1e8e-e5f5-49e8-ae48-44b87d735ea6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:46.672958 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-720e1e8e-e5f5-49e8-ae48-44b87d735ea6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:46.673403 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-720e1e8e-e5f5-49e8-ae48-44b87d735ea6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:46.674200 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-720e1e8e-e5f5-49e8-ae48-44b87d735ea6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:46.674642 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-720e1e8e-e5f5-49e8-ae48-44b87d735ea6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:46.738399 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-720e1e8e-e5f5-49e8-ae48-44b87d735ea6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:46.745859 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-720e1e8e-e5f5-49e8-ae48-44b87d735ea6 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.082382 Jul 20 19:44:46.746422 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1540/2171] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:46 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:44:47.679221 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-314669b0-2c21-46e8-8309-c8ae5564f966 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:47.679880 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-314669b0-2c21-46e8-8309-c8ae5564f966 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:47.686323 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-314669b0-2c21-46e8-8309-c8ae5564f966 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:47.686771 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-314669b0-2c21-46e8-8309-c8ae5564f966 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:47.687524 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-314669b0-2c21-46e8-8309-c8ae5564f966 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:47.687953 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-314669b0-2c21-46e8-8309-c8ae5564f966 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:47.819407 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-314669b0-2c21-46e8-8309-c8ae5564f966 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:47.826849 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-314669b0-2c21-46e8-8309-c8ae5564f966 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.152038 Jul 20 19:44:47.827660 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1541/2172] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:47 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:44:47.831864 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-b9768c2b-38ca-49c4-acc5-b8370bba8fe8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:47.832463 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-b9768c2b-38ca-49c4-acc5-b8370bba8fe8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:47.838098 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b9768c2b-38ca-49c4-acc5-b8370bba8fe8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:47.838539 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b9768c2b-38ca-49c4-acc5-b8370bba8fe8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:47.839300 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b9768c2b-38ca-49c4-acc5-b8370bba8fe8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:47.839731 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b9768c2b-38ca-49c4-acc5-b8370bba8fe8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:47.907326 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-b9768c2b-38ca-49c4-acc5-b8370bba8fe8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:47.915213 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-b9768c2b-38ca-49c4-acc5-b8370bba8fe8 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.086872 Jul 20 19:44:47.915774 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1542/2173] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:47 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:44:48.844387 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-126439e8-681e-4951-ab89-1757d3f1069e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:48.845033 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-126439e8-681e-4951-ab89-1757d3f1069e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:48.851887 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-126439e8-681e-4951-ab89-1757d3f1069e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:48.852332 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-126439e8-681e-4951-ab89-1757d3f1069e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:48.853086 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-126439e8-681e-4951-ab89-1757d3f1069e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:48.853531 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-126439e8-681e-4951-ab89-1757d3f1069e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:48.986924 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-126439e8-681e-4951-ab89-1757d3f1069e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:48.989777 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:44:48.996142 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-126439e8-681e-4951-ab89-1757d3f1069e tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.155744 Jul 20 19:44:48.996721 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1543/2174] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:48 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:44:49.001142 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-bf27bb49-fa8b-4acf-a1c1-1e7ba847c90d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:49.001768 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-bf27bb49-fa8b-4acf-a1c1-1e7ba847c90d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:49.008194 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bf27bb49-fa8b-4acf-a1c1-1e7ba847c90d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:49.008644 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bf27bb49-fa8b-4acf-a1c1-1e7ba847c90d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:49.009437 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bf27bb49-fa8b-4acf-a1c1-1e7ba847c90d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:49.009895 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bf27bb49-fa8b-4acf-a1c1-1e7ba847c90d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:49.071987 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-bf27bb49-fa8b-4acf-a1c1-1e7ba847c90d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:49.079520 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-bf27bb49-fa8b-4acf-a1c1-1e7ba847c90d tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.081857 Jul 20 19:44:49.080079 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1544/2175] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:48 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:44:50.013689 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-79a751c8-fe4a-4c48-9371-5691316b49b0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:50.014299 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-79a751c8-fe4a-4c48-9371-5691316b49b0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:50.021598 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-79a751c8-fe4a-4c48-9371-5691316b49b0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:50.022045 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-79a751c8-fe4a-4c48-9371-5691316b49b0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:50.022800 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-79a751c8-fe4a-4c48-9371-5691316b49b0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:50.023228 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-79a751c8-fe4a-4c48-9371-5691316b49b0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:50.155050 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-79a751c8-fe4a-4c48-9371-5691316b49b0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:50.162585 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-79a751c8-fe4a-4c48-9371-5691316b49b0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.152753 Jul 20 19:44:50.163153 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1545/2176] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:50 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:44:50.167503 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-f4417ae9-ca06-4ac5-8a5b-da6fb0e2fd73 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:50.168114 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-f4417ae9-ca06-4ac5-8a5b-da6fb0e2fd73 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:50.173678 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f4417ae9-ca06-4ac5-8a5b-da6fb0e2fd73 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:50.174130 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f4417ae9-ca06-4ac5-8a5b-da6fb0e2fd73 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:50.174955 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f4417ae9-ca06-4ac5-8a5b-da6fb0e2fd73 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:50.175568 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f4417ae9-ca06-4ac5-8a5b-da6fb0e2fd73 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:50.240028 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-f4417ae9-ca06-4ac5-8a5b-da6fb0e2fd73 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:50.247498 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-f4417ae9-ca06-4ac5-8a5b-da6fb0e2fd73 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.083354 Jul 20 19:44:50.247987 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1546/2177] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:50 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:44:51.180353 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d761085b-8d81-43a5-8932-2e918641d963 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:51.181026 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d761085b-8d81-43a5-8932-2e918641d963 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:51.187538 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d761085b-8d81-43a5-8932-2e918641d963 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:51.187979 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d761085b-8d81-43a5-8932-2e918641d963 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:51.188722 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d761085b-8d81-43a5-8932-2e918641d963 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:51.189147 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d761085b-8d81-43a5-8932-2e918641d963 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:51.319244 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d761085b-8d81-43a5-8932-2e918641d963 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:51.326928 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d761085b-8d81-43a5-8932-2e918641d963 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.150414 Jul 20 19:44:51.327501 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1547/2178] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:51 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:44:51.332625 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-09ab9892-cf29-480b-be57-16a8890de706 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:51.333230 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-09ab9892-cf29-480b-be57-16a8890de706 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:51.338952 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-09ab9892-cf29-480b-be57-16a8890de706 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:51.339403 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-09ab9892-cf29-480b-be57-16a8890de706 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:51.340165 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-09ab9892-cf29-480b-be57-16a8890de706 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:51.340600 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-09ab9892-cf29-480b-be57-16a8890de706 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:51.401433 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-09ab9892-cf29-480b-be57-16a8890de706 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:51.408928 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-09ab9892-cf29-480b-be57-16a8890de706 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080491 Jul 20 19:44:51.410561 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1548/2179] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:51 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:44:52.344208 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c0a1fefa-78ce-467f-b001-817e7532602b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:52.344809 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c0a1fefa-78ce-467f-b001-817e7532602b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:52.352307 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c0a1fefa-78ce-467f-b001-817e7532602b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:52.352759 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c0a1fefa-78ce-467f-b001-817e7532602b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:52.353547 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c0a1fefa-78ce-467f-b001-817e7532602b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:52.353978 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c0a1fefa-78ce-467f-b001-817e7532602b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:52.484750 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c0a1fefa-78ce-467f-b001-817e7532602b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:52.493186 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c0a1fefa-78ce-467f-b001-817e7532602b tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.152843 Jul 20 19:44:52.493802 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1549/2180] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:52 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:44:52.498135 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-0024b323-8c81-4fe5-8542-60558b726f43 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:52.498733 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-0024b323-8c81-4fe5-8542-60558b726f43 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:52.504568 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0024b323-8c81-4fe5-8542-60558b726f43 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:52.505006 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0024b323-8c81-4fe5-8542-60558b726f43 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:52.505783 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0024b323-8c81-4fe5-8542-60558b726f43 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:52.506216 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0024b323-8c81-4fe5-8542-60558b726f43 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:52.565897 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0024b323-8c81-4fe5-8542-60558b726f43 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:52.573402 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-0024b323-8c81-4fe5-8542-60558b726f43 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.078605 Jul 20 19:44:52.573936 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1550/2181] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:52 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:44:53.510137 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-f499e819-fe4c-4378-baa6-9eed9b0cb9dc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:53.510758 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-f499e819-fe4c-4378-baa6-9eed9b0cb9dc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:53.517206 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f499e819-fe4c-4378-baa6-9eed9b0cb9dc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:53.517690 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f499e819-fe4c-4378-baa6-9eed9b0cb9dc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:53.518460 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f499e819-fe4c-4378-baa6-9eed9b0cb9dc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:53.518936 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f499e819-fe4c-4378-baa6-9eed9b0cb9dc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:53.647924 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-f499e819-fe4c-4378-baa6-9eed9b0cb9dc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:53.655562 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-f499e819-fe4c-4378-baa6-9eed9b0cb9dc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.149293 Jul 20 19:44:53.656130 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1551/2182] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:53 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:44:53.660510 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-6b67edaa-7b64-4f64-8ffd-9ba635a1a960 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:53.661110 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-6b67edaa-7b64-4f64-8ffd-9ba635a1a960 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:53.666838 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6b67edaa-7b64-4f64-8ffd-9ba635a1a960 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:53.667290 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6b67edaa-7b64-4f64-8ffd-9ba635a1a960 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:53.668050 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6b67edaa-7b64-4f64-8ffd-9ba635a1a960 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:53.668489 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6b67edaa-7b64-4f64-8ffd-9ba635a1a960 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:53.733940 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6b67edaa-7b64-4f64-8ffd-9ba635a1a960 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:53.741999 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-6b67edaa-7b64-4f64-8ffd-9ba635a1a960 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.084926 Jul 20 19:44:53.742565 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1552/2183] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:53 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:44:54.672236 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-1522fab4-e60e-4b51-802b-d3744240ba92 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:54.672825 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-1522fab4-e60e-4b51-802b-d3744240ba92 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:54.679458 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1522fab4-e60e-4b51-802b-d3744240ba92 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:54.679910 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1522fab4-e60e-4b51-802b-d3744240ba92 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:54.680676 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1522fab4-e60e-4b51-802b-d3744240ba92 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:54.681107 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1522fab4-e60e-4b51-802b-d3744240ba92 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:54.813388 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1522fab4-e60e-4b51-802b-d3744240ba92 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:54.821418 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-1522fab4-e60e-4b51-802b-d3744240ba92 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.153093 Jul 20 19:44:54.822061 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1553/2184] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:54 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:44:54.826494 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-7d921c22-6a15-46a6-ad28-1940886bdf32 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:54.827088 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-7d921c22-6a15-46a6-ad28-1940886bdf32 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:54.833337 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7d921c22-6a15-46a6-ad28-1940886bdf32 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:54.833813 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7d921c22-6a15-46a6-ad28-1940886bdf32 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:54.834568 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7d921c22-6a15-46a6-ad28-1940886bdf32 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:54.834997 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7d921c22-6a15-46a6-ad28-1940886bdf32 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:54.895404 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-7d921c22-6a15-46a6-ad28-1940886bdf32 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:54.902806 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-7d921c22-6a15-46a6-ad28-1940886bdf32 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.079817 Jul 20 19:44:54.903368 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1554/2185] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:54 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:44:55.841215 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-94739c0c-656e-4243-83d1-1da2a70c9a87 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:55.841897 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-94739c0c-656e-4243-83d1-1da2a70c9a87 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:55.849420 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-94739c0c-656e-4243-83d1-1da2a70c9a87 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:55.849907 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-94739c0c-656e-4243-83d1-1da2a70c9a87 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:55.850675 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-94739c0c-656e-4243-83d1-1da2a70c9a87 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:55.851109 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-94739c0c-656e-4243-83d1-1da2a70c9a87 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:56.229213 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-94739c0c-656e-4243-83d1-1da2a70c9a87 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:56.237022 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-94739c0c-656e-4243-83d1-1da2a70c9a87 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.401689 Jul 20 19:44:56.237749 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1555/2186] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:55 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:44:56.242237 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4aa5e5c3-380b-4c88-82b1-6bda0c5d456a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:56.242831 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-4aa5e5c3-380b-4c88-82b1-6bda0c5d456a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:56.248408 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4aa5e5c3-380b-4c88-82b1-6bda0c5d456a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:56.248849 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4aa5e5c3-380b-4c88-82b1-6bda0c5d456a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:56.249624 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4aa5e5c3-380b-4c88-82b1-6bda0c5d456a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:56.250054 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4aa5e5c3-380b-4c88-82b1-6bda0c5d456a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:56.310968 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-4aa5e5c3-380b-4c88-82b1-6bda0c5d456a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:56.319318 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-4aa5e5c3-380b-4c88-82b1-6bda0c5d456a tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.080436 Jul 20 19:44:56.319893 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1556/2187] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:56 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:44:57.255312 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d88d7336-b2f5-4e82-96a1-d75c9196dfb0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:57.256060 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d88d7336-b2f5-4e82-96a1-d75c9196dfb0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:57.262484 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d88d7336-b2f5-4e82-96a1-d75c9196dfb0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:57.263017 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d88d7336-b2f5-4e82-96a1-d75c9196dfb0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:57.263852 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d88d7336-b2f5-4e82-96a1-d75c9196dfb0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:57.264365 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d88d7336-b2f5-4e82-96a1-d75c9196dfb0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:57.400912 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d88d7336-b2f5-4e82-96a1-d75c9196dfb0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:57.408405 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d88d7336-b2f5-4e82-96a1-d75c9196dfb0 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.158067 Jul 20 19:44:57.408991 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1557/2188] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:57 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:44:57.413427 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d23b100a-6c3c-49b2-afda-6895fb04fdd9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:57.414053 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d23b100a-6c3c-49b2-afda-6895fb04fdd9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:57.420247 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d23b100a-6c3c-49b2-afda-6895fb04fdd9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:57.420703 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d23b100a-6c3c-49b2-afda-6895fb04fdd9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:57.421529 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d23b100a-6c3c-49b2-afda-6895fb04fdd9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:57.421972 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d23b100a-6c3c-49b2-afda-6895fb04fdd9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:57.488043 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d23b100a-6c3c-49b2-afda-6895fb04fdd9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:57.495523 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d23b100a-6c3c-49b2-afda-6895fb04fdd9 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.085594 Jul 20 19:44:57.496091 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1558/2189] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:57 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:44:58.424948 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-f5326087-a0df-40b3-a221-bfa389c74720 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:58.425748 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-f5326087-a0df-40b3-a221-bfa389c74720 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:58.432761 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f5326087-a0df-40b3-a221-bfa389c74720 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:58.433209 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f5326087-a0df-40b3-a221-bfa389c74720 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:58.433993 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f5326087-a0df-40b3-a221-bfa389c74720 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:58.434425 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f5326087-a0df-40b3-a221-bfa389c74720 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:58.569626 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-f5326087-a0df-40b3-a221-bfa389c74720 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:58.577117 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-f5326087-a0df-40b3-a221-bfa389c74720 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.156239 Jul 20 19:44:58.577654 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1559/2190] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:58 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:44:58.582694 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-afa315b5-dad1-4493-a447-b2f974ca832e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:58.583292 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-afa315b5-dad1-4493-a447-b2f974ca832e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:58.588824 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-afa315b5-dad1-4493-a447-b2f974ca832e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:58.589266 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-afa315b5-dad1-4493-a447-b2f974ca832e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:58.590060 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-afa315b5-dad1-4493-a447-b2f974ca832e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:58.590498 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-afa315b5-dad1-4493-a447-b2f974ca832e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:58.607159 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:44:58.654116 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-afa315b5-dad1-4493-a447-b2f974ca832e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:58.662303 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-afa315b5-dad1-4493-a447-b2f974ca832e tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.083708 Jul 20 19:44:58.662879 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1560/2191] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:58 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:44:59.594877 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-150282d2-b650-427a-b349-946dbd5e7ea5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:59.596177 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-150282d2-b650-427a-b349-946dbd5e7ea5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:59.603034 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-150282d2-b650-427a-b349-946dbd5e7ea5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:59.603469 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-150282d2-b650-427a-b349-946dbd5e7ea5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:59.604216 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-150282d2-b650-427a-b349-946dbd5e7ea5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:59.604642 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-150282d2-b650-427a-b349-946dbd5e7ea5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:59.741955 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-150282d2-b650-427a-b349-946dbd5e7ea5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:59.749888 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-150282d2-b650-427a-b349-946dbd5e7ea5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.158868 Jul 20 19:44:59.750460 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1561/2192] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:59 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:44:59.755569 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-88bca35e-8334-438a-a093-64383d1a8a48 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:44:59.756167 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-88bca35e-8334-438a-a093-64383d1a8a48 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:44:59.761892 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-88bca35e-8334-438a-a093-64383d1a8a48 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:59.762341 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-88bca35e-8334-438a-a093-64383d1a8a48 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:59.763096 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-88bca35e-8334-438a-a093-64383d1a8a48 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:44:59.763532 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-88bca35e-8334-438a-a093-64383d1a8a48 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:44:59.823745 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-88bca35e-8334-438a-a093-64383d1a8a48 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:44:59.831669 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-88bca35e-8334-438a-a093-64383d1a8a48 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.079708 Jul 20 19:44:59.832558 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1562/2193] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:44:59 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:45:00.767381 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c530ba8f-6b2f-4279-aa53-cba747754fa6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:45:00.768046 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c530ba8f-6b2f-4279-aa53-cba747754fa6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:45:00.775054 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c530ba8f-6b2f-4279-aa53-cba747754fa6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:45:00.775494 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c530ba8f-6b2f-4279-aa53-cba747754fa6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:45:00.776240 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c530ba8f-6b2f-4279-aa53-cba747754fa6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:45:00.776664 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c530ba8f-6b2f-4279-aa53-cba747754fa6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:45:00.906645 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c530ba8f-6b2f-4279-aa53-cba747754fa6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:45:00.914686 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c530ba8f-6b2f-4279-aa53-cba747754fa6 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.151148 Jul 20 19:45:00.915245 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1563/2194] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:45:00 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:45:00.919677 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-70e1b516-464f-44f6-98e5-465f217e5ad0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:45:00.920268 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-70e1b516-464f-44f6-98e5-465f217e5ad0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:45:00.926687 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-70e1b516-464f-44f6-98e5-465f217e5ad0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:45:00.927122 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-70e1b516-464f-44f6-98e5-465f217e5ad0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:45:00.927931 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-70e1b516-464f-44f6-98e5-465f217e5ad0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:45:00.928322 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-70e1b516-464f-44f6-98e5-465f217e5ad0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:45:00.992751 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-70e1b516-464f-44f6-98e5-465f217e5ad0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:45:01.000208 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-70e1b516-464f-44f6-98e5-465f217e5ad0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.084030 Jul 20 19:45:01.000763 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1564/2195] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:45:00 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:45:01.931902 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-6d2a7337-c101-468d-bc97-115bae0243c9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:45:01.932598 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-6d2a7337-c101-468d-bc97-115bae0243c9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:45:01.939155 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6d2a7337-c101-468d-bc97-115bae0243c9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:45:01.939603 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6d2a7337-c101-468d-bc97-115bae0243c9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:45:01.941172 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6d2a7337-c101-468d-bc97-115bae0243c9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:45:01.941708 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6d2a7337-c101-468d-bc97-115bae0243c9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:45:02.075083 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6d2a7337-c101-468d-bc97-115bae0243c9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:45:02.083479 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-6d2a7337-c101-468d-bc97-115bae0243c9 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.155406 Jul 20 19:45:02.084056 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1565/2196] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:45:01 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:45:02.088742 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-9064628a-a616-4ba4-8044-fa8a2b7f3ed0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:45:02.089381 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-9064628a-a616-4ba4-8044-fa8a2b7f3ed0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:45:02.091121 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_api:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:45:02.098203 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9064628a-a616-4ba4-8044-fa8a2b7f3ed0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:45:02.098694 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9064628a-a616-4ba4-8044-fa8a2b7f3ed0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:45:02.099589 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9064628a-a616-4ba4-8044-fa8a2b7f3ed0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:45:02.100020 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9064628a-a616-4ba4-8044-fa8a2b7f3ed0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:45:02.162263 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-9064628a-a616-4ba4-8044-fa8a2b7f3ed0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:45:02.169733 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-9064628a-a616-4ba4-8044-fa8a2b7f3ed0 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.084697 Jul 20 19:45:02.170303 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1566/2197] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:45:02 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:45:03.103444 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4999ff12-ee68-4fe5-9f5c-28e3e78f434a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:45:03.104128 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-4999ff12-ee68-4fe5-9f5c-28e3e78f434a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:45:03.110631 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4999ff12-ee68-4fe5-9f5c-28e3e78f434a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:45:03.111070 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4999ff12-ee68-4fe5-9f5c-28e3e78f434a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:45:03.111815 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4999ff12-ee68-4fe5-9f5c-28e3e78f434a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:45:03.112242 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4999ff12-ee68-4fe5-9f5c-28e3e78f434a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:45:03.247851 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-4999ff12-ee68-4fe5-9f5c-28e3e78f434a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:45:03.255991 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-4999ff12-ee68-4fe5-9f5c-28e3e78f434a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.157019 Jul 20 19:45:03.256565 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1567/2198] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:45:03 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:45:03.261020 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-0ac58120-02c7-496c-9124-4173ccb4d4cf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:45:03.261648 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-0ac58120-02c7-496c-9124-4173ccb4d4cf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:45:03.267588 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0ac58120-02c7-496c-9124-4173ccb4d4cf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:45:03.268060 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0ac58120-02c7-496c-9124-4173ccb4d4cf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:45:03.268910 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0ac58120-02c7-496c-9124-4173ccb4d4cf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:45:03.269714 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0ac58120-02c7-496c-9124-4173ccb4d4cf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:45:03.334488 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0ac58120-02c7-496c-9124-4173ccb4d4cf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:45:03.341982 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-0ac58120-02c7-496c-9124-4173ccb4d4cf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.084476 Jul 20 19:45:03.342544 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1568/2199] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:45:03 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:45:04.274944 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a0846788-edd4-4808-a807-da1b5eba0328 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:45:04.275634 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a0846788-edd4-4808-a807-da1b5eba0328 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:45:04.281673 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a0846788-edd4-4808-a807-da1b5eba0328 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:45:04.282126 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a0846788-edd4-4808-a807-da1b5eba0328 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:45:04.282884 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a0846788-edd4-4808-a807-da1b5eba0328 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:45:04.283318 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a0846788-edd4-4808-a807-da1b5eba0328 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:45:04.412508 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a0846788-edd4-4808-a807-da1b5eba0328 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:45:04.420039 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a0846788-edd4-4808-a807-da1b5eba0328 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.149066 Jul 20 19:45:04.420636 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1569/2200] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:45:04 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:45:04.425591 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-96f7684a-5a02-42ea-9bb3-4c140874d6bb tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:45:04.426325 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-96f7684a-5a02-42ea-9bb3-4c140874d6bb tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:45:04.432201 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-96f7684a-5a02-42ea-9bb3-4c140874d6bb tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:45:04.432684 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-96f7684a-5a02-42ea-9bb3-4c140874d6bb tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:45:04.433483 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-96f7684a-5a02-42ea-9bb3-4c140874d6bb tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:45:04.433939 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-96f7684a-5a02-42ea-9bb3-4c140874d6bb tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:45:04.502304 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-96f7684a-5a02-42ea-9bb3-4c140874d6bb tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:45:04.510321 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-96f7684a-5a02-42ea-9bb3-4c140874d6bb tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.088541 Jul 20 19:45:04.510879 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1570/2201] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:45:04 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:45:05.438730 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e4b64e5e-a8cc-4dea-8894-cb39f42749de tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:45:05.439434 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e4b64e5e-a8cc-4dea-8894-cb39f42749de tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:45:05.447031 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e4b64e5e-a8cc-4dea-8894-cb39f42749de tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:45:05.447481 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e4b64e5e-a8cc-4dea-8894-cb39f42749de tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:45:05.448265 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e4b64e5e-a8cc-4dea-8894-cb39f42749de tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:45:05.449036 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e4b64e5e-a8cc-4dea-8894-cb39f42749de tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:45:05.582555 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e4b64e5e-a8cc-4dea-8894-cb39f42749de tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:45:05.590162 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e4b64e5e-a8cc-4dea-8894-cb39f42749de tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.157415 Jul 20 19:45:05.590733 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1571/2202] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:45:05 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:45:05.595084 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-fcd29126-8d2a-4d00-a4bf-428fde11a24c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:45:05.595689 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-fcd29126-8d2a-4d00-a4bf-428fde11a24c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:45:05.602416 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fcd29126-8d2a-4d00-a4bf-428fde11a24c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:45:05.602869 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fcd29126-8d2a-4d00-a4bf-428fde11a24c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:45:05.603633 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fcd29126-8d2a-4d00-a4bf-428fde11a24c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:45:05.604069 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fcd29126-8d2a-4d00-a4bf-428fde11a24c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:45:05.666494 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-fcd29126-8d2a-4d00-a4bf-428fde11a24c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:45:05.674128 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-fcd29126-8d2a-4d00-a4bf-428fde11a24c tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.082434 Jul 20 19:45:05.674689 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1572/2203] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:45:05 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:45:06.608267 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-207f5397-a4be-4f51-a18d-ac61d6b8ebfb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:45:06.608858 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-207f5397-a4be-4f51-a18d-ac61d6b8ebfb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:45:06.616652 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-207f5397-a4be-4f51-a18d-ac61d6b8ebfb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:45:06.617173 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-207f5397-a4be-4f51-a18d-ac61d6b8ebfb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:45:06.618066 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-207f5397-a4be-4f51-a18d-ac61d6b8ebfb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:45:06.618569 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-207f5397-a4be-4f51-a18d-ac61d6b8ebfb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:45:06.756416 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-207f5397-a4be-4f51-a18d-ac61d6b8ebfb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:45:06.764168 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-207f5397-a4be-4f51-a18d-ac61d6b8ebfb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.160065 Jul 20 19:45:06.764735 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1573/2204] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:45:06 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:45:06.770591 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-20630f60-2364-4367-a4dc-e7bad12f1e22 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:45:06.771200 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-20630f60-2364-4367-a4dc-e7bad12f1e22 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:45:06.777887 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-20630f60-2364-4367-a4dc-e7bad12f1e22 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:45:06.778342 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-20630f60-2364-4367-a4dc-e7bad12f1e22 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:45:06.779109 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-20630f60-2364-4367-a4dc-e7bad12f1e22 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:45:06.779546 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-20630f60-2364-4367-a4dc-e7bad12f1e22 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:45:06.840918 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-20630f60-2364-4367-a4dc-e7bad12f1e22 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:45:06.849710 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-20630f60-2364-4367-a4dc-e7bad12f1e22 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.084000 Jul 20 19:45:06.850342 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1574/2205] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:45:06 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:45:07.782112 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-6f2cf3ff-6ea4-45b5-860e-929ad2809e33 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:45:07.782855 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-6f2cf3ff-6ea4-45b5-860e-929ad2809e33 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:45:07.789161 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6f2cf3ff-6ea4-45b5-860e-929ad2809e33 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:45:07.789643 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6f2cf3ff-6ea4-45b5-860e-929ad2809e33 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:45:07.790398 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6f2cf3ff-6ea4-45b5-860e-929ad2809e33 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:45:07.790830 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6f2cf3ff-6ea4-45b5-860e-929ad2809e33 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:45:07.926188 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6f2cf3ff-6ea4-45b5-860e-929ad2809e33 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:45:07.934134 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-6f2cf3ff-6ea4-45b5-860e-929ad2809e33 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.156051 Jul 20 19:45:07.934698 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1575/2206] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:45:07 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:45:07.939166 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-98b7310d-b549-46f6-bb65-191e8118b720 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:45:07.939754 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-98b7310d-b549-46f6-bb65-191e8118b720 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] [instance: 0aee5176-53ab-4288-91da-4284ac2e443e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:45:07.945533 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-98b7310d-b549-46f6-bb65-191e8118b720 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:45:07.945984 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-98b7310d-b549-46f6-bb65-191e8118b720 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:45:07.946732 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-98b7310d-b549-46f6-bb65-191e8118b720 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:45:07.947161 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-98b7310d-b549-46f6-bb65-191e8118b720 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:45:08.012054 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-98b7310d-b549-46f6-bb65-191e8118b720 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67fe170c60476d88610d85f2528c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064950f9a1942149aa8d6c08c206850', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:45:08.019491 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-98b7310d-b549-46f6-bb65-191e8118b720 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e" status: 200 len: 1224 microversion: 2.1 time: 0.083873 Jul 20 19:45:08.020049 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1576/2207] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:45:07 2022] GET /compute/v2.1/servers/0aee5176-53ab-4288-91da-4284ac2e443e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:45:08.950656 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-974a6a04-bf1a-4415-af01-fd8d12b4b455 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:45:08.951340 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-974a6a04-bf1a-4415-af01-fd8d12b4b455 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:45:08.957843 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-974a6a04-bf1a-4415-af01-fd8d12b4b455 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:45:08.958299 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-974a6a04-bf1a-4415-af01-fd8d12b4b455 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:45:08.959053 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-974a6a04-bf1a-4415-af01-fd8d12b4b455 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:45:08.959594 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-974a6a04-bf1a-4415-af01-fd8d12b4b455 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:45:08.964516 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:45:09.091097 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-974a6a04-bf1a-4415-af01-fd8d12b4b455 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:45:09.098818 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-974a6a04-bf1a-4415-af01-fd8d12b4b455 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.152054 Jul 20 19:45:09.099381 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1577/2208] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:45:08 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:45:10.115611 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-1359444d-bf3e-470c-8ad3-5091449b6560 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:45:10.116245 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-1359444d-bf3e-470c-8ad3-5091449b6560 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:45:10.123854 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1359444d-bf3e-470c-8ad3-5091449b6560 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:45:10.124295 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1359444d-bf3e-470c-8ad3-5091449b6560 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:45:10.125042 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1359444d-bf3e-470c-8ad3-5091449b6560 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:45:10.125469 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1359444d-bf3e-470c-8ad3-5091449b6560 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:45:10.259584 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1359444d-bf3e-470c-8ad3-5091449b6560 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:45:10.267198 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-1359444d-bf3e-470c-8ad3-5091449b6560 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1449 microversion: 2.1 time: 0.155368 Jul 20 19:45:10.267769 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1578/2209] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:45:10 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:45:10.561194 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ca575553-0532-480e-b018-58d134810420 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:45:10.561830 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ca575553-0532-480e-b018-58d134810420 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] [instance: 43fe56ab-bf09-4ec0-84d5-306f16cb9d5a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:45:10.567928 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ca575553-0532-480e-b018-58d134810420 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:45:10.568376 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ca575553-0532-480e-b018-58d134810420 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:45:10.569147 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ca575553-0532-480e-b018-58d134810420 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:45:10.570228 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ca575553-0532-480e-b018-58d134810420 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:45:20.565976 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_api:SELECT=27 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:45:20.590284 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=15 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:45:25.082936 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 19:45:25.083668 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Wed Jul 20 19:45:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a/os-volume_attachments/314fa7fd-d882-4be3-a319-c7a44c9d8bba (ip 10.222.0.69) !!! Jul 20 19:45:27.177168 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 19:45:27.177820 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Wed Jul 20 19:45:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a/os-volume_attachments/314fa7fd-d882-4be3-a319-c7a44c9d8bba (ip 10.222.0.69) !!! Jul 20 19:45:43.136513 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 19:45:43.137822 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Wed Jul 20 19:45:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a/os-volume_attachments/314fa7fd-d882-4be3-a319-c7a44c9d8bba (ip 10.222.0.69) !!! Jul 20 19:47:10.741015 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.objects.instance [None req-ca575553-0532-480e-b018-58d134810420 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lazy-loading 'services' on Instance uuid 43fe56ab-bf09-4ec0-84d5-306f16cb9d5a {{(pid=117761) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:47:20.745034 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=4 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:48:45.091284 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 19:48:45.092534 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Wed Jul 20 19:48:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a/os-volume_attachments/314fa7fd-d882-4be3-a319-c7a44c9d8bba (ip 10.222.0.69) !!! Jul 20 19:48:47.185236 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 19:48:47.186397 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Wed Jul 20 19:48:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a/os-volume_attachments/314fa7fd-d882-4be3-a319-c7a44c9d8bba (ip 10.222.0.69) !!! Jul 20 19:48:58.484265 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ca575553-0532-480e-b018-58d134810420 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] [5eabb59e-c424-4ee1-a3ee-3043cb1dbd04] AMQP server on 10.222.0.69:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 20 19:48:59.491721 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO oslo.messaging._drivers.impl_rabbit [None req-ca575553-0532-480e-b018-58d134810420 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] [5eabb59e-c424-4ee1-a3ee-3043cb1dbd04] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 43900. Jul 20 19:48:59.494905 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ca575553-0532-480e-b018-58d134810420 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] 10.222.0.69 "DELETE /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a/os-volume_attachments/314fa7fd-d882-4be3-a319-c7a44c9d8bba" status: 202 len: 0 microversion: 2.1 time: 228.937548 Jul 20 19:48:59.495494 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1579/2210] 10.222.0.69 () {58 vars in 1415 bytes} [Wed Jul 20 19:45:10 2022] DELETE /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a/os-volume_attachments/314fa7fd-d882-4be3-a319-c7a44c9d8bba => generated 0 bytes in 228939 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 19:48:59.501448 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-8067802f-a2da-44ed-a36e-487077248adc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:48:59.502179 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-8067802f-a2da-44ed-a36e-487077248adc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:48:59.510419 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8067802f-a2da-44ed-a36e-487077248adc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:48:59.510890 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8067802f-a2da-44ed-a36e-487077248adc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:48:59.511919 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8067802f-a2da-44ed-a36e-487077248adc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:48:59.512474 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8067802f-a2da-44ed-a36e-487077248adc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:48:59.728334 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8067802f-a2da-44ed-a36e-487077248adc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:48:59.736019 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-8067802f-a2da-44ed-a36e-487077248adc tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1214 microversion: 2.1 time: 0.239260 Jul 20 19:48:59.736586 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1580/2211] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:48:59 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1214 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:48:59.808941 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-9a6cb2b6-4696-49eb-8979-72ce2c5908cb tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:48:59.809440 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-9a6cb2b6-4696-49eb-8979-72ce2c5908cb tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 2b8da868-71d1-49ad-be95-25d0a41393e9] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:48:59.815981 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9a6cb2b6-4696-49eb-8979-72ce2c5908cb tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:48:59.816432 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9a6cb2b6-4696-49eb-8979-72ce2c5908cb tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:48:59.817188 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9a6cb2b6-4696-49eb-8979-72ce2c5908cb tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:48:59.817648 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9a6cb2b6-4696-49eb-8979-72ce2c5908cb tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:48:59.842078 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-9a6cb2b6-4696-49eb-8979-72ce2c5908cb tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 2b8da868-71d1-49ad-be95-25d0a41393e9] Going to try to terminate instance {{(pid=117761) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 19:48:59.917835 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-9a6cb2b6-4696-49eb-8979-72ce2c5908cb tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "DELETE /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9" status: 204 len: 0 microversion: 2.1 time: 0.179610 Jul 20 19:48:59.918897 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1581/2212] 10.222.0.69 () {58 vars in 1238 bytes} [Wed Jul 20 19:48:59 2022] DELETE /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 19:48:59.926266 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4c96fb7e-0683-4edf-ba5e-edc7c8241d0f tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:48:59.926836 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-4c96fb7e-0683-4edf-ba5e-edc7c8241d0f tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] [instance: 43fe56ab-bf09-4ec0-84d5-306f16cb9d5a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:48:59.932496 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4c96fb7e-0683-4edf-ba5e-edc7c8241d0f tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:48:59.932938 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4c96fb7e-0683-4edf-ba5e-edc7c8241d0f tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:48:59.933714 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4c96fb7e-0683-4edf-ba5e-edc7c8241d0f tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:48:59.934143 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4c96fb7e-0683-4edf-ba5e-edc7c8241d0f tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:49:09.930293 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:49:09.952849 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=25,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:49:10.978430 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.objects.instance [None req-4c96fb7e-0683-4edf-ba5e-edc7c8241d0f tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lazy-loading 'services' on Instance uuid 43fe56ab-bf09-4ec0-84d5-306f16cb9d5a {{(pid=117761) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:49:11.047878 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.wsgi [None req-4c96fb7e-0683-4edf-ba5e-edc7c8241d0f tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e66aded2-50aa-45ec-814d-b61c2acab1ad) Jul 20 19:49:11.050483 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4c96fb7e-0683-4edf-ba5e-edc7c8241d0f tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Request method failure captured: Jul 20 19:49:11.050483 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: DELETE /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a/os-volume_attachments/314fa7fd-d882-4be3-a319-c7a44c9d8bba HTTP/1.1 Jul 20 19:49:11.050483 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 19:49:11.050483 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 19:49:11.050483 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 19:49:11.050483 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 0 Jul 20 19:49:11.050483 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 19:49:11.050483 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 19:49:11.050483 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 19:49:11.050483 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 19:49:11.050483 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2FbvraeCBRrPE4O7lrRb8qOLZk5VEOCVBOl4zMC1gg8XMd7uuHid9RioGTRX_JruGVyWJZ88XS9h66QDLJKZqWWE0MjOusG0phS1nTYkPwx2OHkqAGkCtP2OLBH1bnn2QsTgDuvA_AZ-0_Frr--F8Gf2qGtpGL5jfce4gMVrg4Ozv-Y Jul 20 19:49:11.050483 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 19:49:11.050483 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 19:49:11.050483 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 19:49:11.050483 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 19:49:11.050483 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 19:49:11.050483 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 19:49:11.050483 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: e0bb4af78c1d4589b1d3cc90d5e6be63 Jul 20 19:49:11.050483 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1199788649 Jul 20 19:49:11.050483 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 19:49:11.050483 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 19:49:11.052197 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e0bb4af78c1d4589b1d3cc90d5e6be63"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e0bb4af78c1d4589b1d3cc90d5e6be63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_e0bb4af78c1d4589b1d3cc90d5e6be63", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/e0bb4af78c1d4589b1d3cc90d5e6be63"}]}] Jul 20 19:49:11.052197 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-VolumesSnapshotTestJSON-1199788649 Jul 20 19:49:11.052197 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: e0bb4af78c1d4589b1d3cc90d5e6be63 Jul 20 19:49:11.052197 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1199788649 Jul 20 19:49:11.052197 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-VolumesSnapshotTestJSON-1199788649-project Jul 20 19:49:11.052197 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 19:49:11.052197 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 19:49:11.052197 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: 78ae826a812b44328c48b82e9498ad8b Jul 20 19:49:11.052197 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-VolumesSnapshotTestJSON-1199788649-project Jul 20 19:49:11.052197 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: > Jul 20 19:49:11.052993 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e66aded2-50aa-45ec-814d-b61c2acab1ad) Jul 20 19:49:11.052993 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'server_id': '43fe56ab-bf09-4ec0-84d5-306f16cb9d5a', 'id': '314fa7fd-d882-4be3-a319-c7a44c9d8bba'} Jul 20 19:49:11.052993 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:49:11.052993 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:49:11.052993 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 19:49:11.052993 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 19:49:11.052993 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 19:49:11.052993 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 19:49:11.052993 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 20 19:49:11.052993 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 20 19:49:11.052993 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 20 19:49:11.052993 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 20 19:49:11.052993 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 20 19:49:11.052993 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 20 19:49:11.052993 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 20 19:49:11.052993 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 20 19:49:11.052993 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 19:49:11.054494 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 19:49:11.054494 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 19:49:11.054494 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 19:49:11.054494 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e66aded2-50aa-45ec-814d-b61c2acab1ad) Jul 20 19:49:11.054494 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:49:11.054494 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:49:11.054494 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:49:11.054494 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:49:11.054494 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 20 19:49:11.054494 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 20 19:49:11.054494 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 20 19:49:11.054494 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 20 19:49:11.054494 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 19:49:11.054494 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 19:49:11.054494 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 19:49:11.054494 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 19:49:11.054494 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 19:49:11.054494 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 19:49:11.054494 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 20 19:49:11.055955 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 20 19:49:11.055955 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 20 19:49:11.055955 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 20 19:49:11.055955 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 20 19:49:11.055955 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 20 19:49:11.055955 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 20 19:49:11.055955 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 20 19:49:11.055955 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 19:49:11.055955 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 19:49:11.055955 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 19:49:11.055955 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 19:49:11.055955 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e66aded2-50aa-45ec-814d-b61c2acab1ad) Jul 20 19:49:11.055955 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:49:11.055955 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:49:11.055955 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:49:11.055955 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:49:11.055955 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 20 19:49:11.057257 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 20 19:49:11.057257 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 19:49:11.057257 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 19:49:11.057257 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 20 19:49:11.057257 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 19:49:11.057257 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 20 19:49:11.057257 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 20 19:49:11.057257 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 20 19:49:11.057257 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 19:49:11.057257 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 20 19:49:11.057257 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 20 19:49:11.057257 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e66aded2-50aa-45ec-814d-b61c2acab1ad) Jul 20 19:49:11.057257 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:49:11.057257 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:49:11.057257 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:49:11.057257 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:49:11.057257 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:49:11.057257 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:49:11.058848 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:49:11.058848 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:49:11.058848 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:49:11.058848 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:49:11.058848 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 20 19:49:11.058848 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 20 19:49:11.058848 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e66aded2-50aa-45ec-814d-b61c2acab1ad) Jul 20 19:49:11.058848 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:49:11.058848 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:49:11.058848 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:49:11.058848 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:49:11.058848 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:49:11.058848 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:49:11.058848 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:49:11.058848 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:49:11.058848 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e66aded2-50aa-45ec-814d-b61c2acab1ad) Jul 20 19:49:11.058848 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:49:11.060656 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4c96fb7e-0683-4edf-ba5e-edc7c8241d0f tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e66aded2-50aa-45ec-814d-b61c2acab1ad) {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:49:11.060656 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-4c96fb7e-0683-4edf-ba5e-edc7c8241d0f tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] 10.222.0.69 "DELETE /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a/os-volume_attachments/314fa7fd-d882-4be3-a319-c7a44c9d8bba" status: 400 len: 269 microversion: 2.1 time: 11.131572 Jul 20 19:49:11.060656 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1582/2213] 10.222.0.69 () {58 vars in 1415 bytes} [Wed Jul 20 19:48:59 2022] DELETE /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a/os-volume_attachments/314fa7fd-d882-4be3-a319-c7a44c9d8bba => generated 269 bytes in 11133 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 19:49:11.185017 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-7fb95ad6-8d0b-420f-b6c3-4ce0ed07e85d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:49:11.185661 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-7fb95ad6-8d0b-420f-b6c3-4ce0ed07e85d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:49:11.192305 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7fb95ad6-8d0b-420f-b6c3-4ce0ed07e85d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:49:11.192756 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7fb95ad6-8d0b-420f-b6c3-4ce0ed07e85d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:49:11.193519 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7fb95ad6-8d0b-420f-b6c3-4ce0ed07e85d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:49:11.193965 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7fb95ad6-8d0b-420f-b6c3-4ce0ed07e85d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:49:11.256129 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-7fb95ad6-8d0b-420f-b6c3-4ce0ed07e85d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:49:11.263675 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-7fb95ad6-8d0b-420f-b6c3-4ce0ed07e85d tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1214 microversion: 2.1 time: 0.210126 Jul 20 19:49:11.264226 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1583/2214] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:49:11 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1214 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:49:11.269736 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-71356e70-292b-4039-bd71-096f358ee9bb tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:49:11.270163 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-71356e70-292b-4039-bd71-096f358ee9bb tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 2b8da868-71d1-49ad-be95-25d0a41393e9] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:49:11.276146 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-71356e70-292b-4039-bd71-096f358ee9bb tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:49:11.276588 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-71356e70-292b-4039-bd71-096f358ee9bb tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:49:11.277348 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-71356e70-292b-4039-bd71-096f358ee9bb tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:49:11.277819 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-71356e70-292b-4039-bd71-096f358ee9bb tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:49:11.291256 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.wsgi [None req-71356e70-292b-4039-bd71-096f358ee9bb tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] HTTP exception thrown: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. Jul 20 19:49:11.292790 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-71356e70-292b-4039-bd71-096f358ee9bb tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Request method failure captured: Jul 20 19:49:11.292790 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: DELETE /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9 HTTP/1.1 Jul 20 19:49:11.292790 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 19:49:11.292790 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 19:49:11.292790 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 19:49:11.292790 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 0 Jul 20 19:49:11.292790 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 19:49:11.292790 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 19:49:11.292790 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 19:49:11.292790 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 19:49:11.292790 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2FZGdJT3PjrXOalhxF4cK7yFRY_rdKs7nWDyfOnHDqihLmSc76hrlTVi8pwFl4fc0_PdYOdKi8ehCojNmpTfeHu0z7420hnbFU_7tQyUQZJWpu7NkYJxMVzpGVG2-8TAgdTN19E5_16lQGWKKWKpZnKtS08L9dJthhYfMLyISTLj6Mc Jul 20 19:49:11.292790 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 19:49:11.292790 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 19:49:11.292790 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 19:49:11.292790 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 19:49:11.292790 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 19:49:11.292790 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 19:49:11.292790 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: 8821facab6ed48588d9d484b5e3d98ba Jul 20 19:49:11.292790 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1121196344 Jul 20 19:49:11.292790 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 19:49:11.292790 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 19:49:11.294372 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8821facab6ed48588d9d484b5e3d98ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8821facab6ed48588d9d484b5e3d98ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8821facab6ed48588d9d484b5e3d98ba", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8821facab6ed48588d9d484b5e3d98ba"}]}] Jul 20 19:49:11.294372 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1121196344 Jul 20 19:49:11.294372 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: 8821facab6ed48588d9d484b5e3d98ba Jul 20 19:49:11.294372 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1121196344 Jul 20 19:49:11.294372 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-ServerRescueNegativeTestJSON-1121196344-project Jul 20 19:49:11.294372 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 19:49:11.294372 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 19:49:11.294372 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: 9192f2842ca044f08e5f95f98f2e1b88 Jul 20 19:49:11.294372 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1121196344-project Jul 20 19:49:11.294372 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: > Jul 20 19:49:11.294372 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. Jul 20 19:49:11.294372 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'id': '2b8da868-71d1-49ad-be95-25d0a41393e9'} Jul 20 19:49:11.295229 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:49:11.295229 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:49:11.295229 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:49:11.295229 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:49:11.295229 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:49:11.295229 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:49:11.295229 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:49:11.295229 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:49:11.295229 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:49:11.295229 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:49:11.295229 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. Jul 20 19:49:11.295229 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:49:11.295229 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:49:11.295229 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:49:11.295229 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:49:11.295229 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:49:11.295229 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:49:11.295229 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:49:11.295229 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:49:11.295229 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:49:11.297047 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:49:11.297047 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 19:49:11.297047 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 19:49:11.297047 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 19:49:11.297047 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 19:49:11.297047 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:49:11.297047 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:49:11.297047 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:49:11.297047 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:49:11.297047 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. Jul 20 19:49:11.297047 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:49:11.297047 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:49:11.297047 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:49:11.297047 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:49:11.297047 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:49:11.297047 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:49:11.297047 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:49:11.297047 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:49:11.297047 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. Jul 20 19:49:11.297047 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:49:11.298367 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-71356e70-292b-4039-bd71-096f358ee9bb tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Returning 404 to user: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:49:11.298367 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-71356e70-292b-4039-bd71-096f358ee9bb tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "DELETE /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9" status: 404 len: 111 microversion: 2.1 time: 0.028295 Jul 20 19:49:11.298367 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1584/2215] 10.222.0.69 () {58 vars in 1238 bytes} [Wed Jul 20 19:49:11 2022] DELETE /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:49:11.299190 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-aba90571-8b16-457b-a48b-3ce44b6e8f81 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:49:11.300166 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-aba90571-8b16-457b-a48b-3ce44b6e8f81 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:49:11.305713 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aba90571-8b16-457b-a48b-3ce44b6e8f81 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:49:11.306159 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aba90571-8b16-457b-a48b-3ce44b6e8f81 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:49:11.306901 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aba90571-8b16-457b-a48b-3ce44b6e8f81 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:49:11.307332 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aba90571-8b16-457b-a48b-3ce44b6e8f81 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:49:11.339607 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-aba90571-8b16-457b-a48b-3ce44b6e8f81 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043926 Jul 20 19:49:11.340154 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1585/2216] 10.222.0.69 () {60 vars in 1342 bytes} [Wed Jul 20 19:49:11 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 19:49:11.344965 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-0eef5aaf-8b85-4aba-b64d-4f3d41541e12 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:49:11.345444 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-0eef5aaf-8b85-4aba-b64d-4f3d41541e12 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] [instance: 43fe56ab-bf09-4ec0-84d5-306f16cb9d5a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:49:11.351269 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0eef5aaf-8b85-4aba-b64d-4f3d41541e12 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:49:11.351748 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0eef5aaf-8b85-4aba-b64d-4f3d41541e12 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:49:11.352544 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0eef5aaf-8b85-4aba-b64d-4f3d41541e12 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:49:11.353006 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0eef5aaf-8b85-4aba-b64d-4f3d41541e12 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:49:11.431582 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.objects.instance [None req-0eef5aaf-8b85-4aba-b64d-4f3d41541e12 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lazy-loading 'services' on Instance uuid 43fe56ab-bf09-4ec0-84d5-306f16cb9d5a {{(pid=117761) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:49:11.488778 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.wsgi [None req-0eef5aaf-8b85-4aba-b64d-4f3d41541e12 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bbcb19f9-4190-4fd1-a756-fed0a1f2c0fd) Jul 20 19:49:11.490939 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-0eef5aaf-8b85-4aba-b64d-4f3d41541e12 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Request method failure captured: Jul 20 19:49:11.490939 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: DELETE /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a/os-volume_attachments/314fa7fd-d882-4be3-a319-c7a44c9d8bba HTTP/1.1 Jul 20 19:49:11.490939 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 19:49:11.490939 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 19:49:11.490939 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 19:49:11.490939 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 0 Jul 20 19:49:11.490939 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 19:49:11.490939 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 19:49:11.490939 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 19:49:11.490939 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 19:49:11.490939 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2FbvraeCBRrPE4O7lrRb8qOLZk5VEOCVBOl4zMC1gg8XMd7uuHid9RioGTRX_JruGVyWJZ88XS9h66QDLJKZqWWE0MjOusG0phS1nTYkPwx2OHkqAGkCtP2OLBH1bnn2QsTgDuvA_AZ-0_Frr--F8Gf2qGtpGL5jfce4gMVrg4Ozv-Y Jul 20 19:49:11.490939 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 19:49:11.490939 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 19:49:11.490939 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 19:49:11.490939 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 19:49:11.490939 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 19:49:11.490939 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 19:49:11.490939 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: e0bb4af78c1d4589b1d3cc90d5e6be63 Jul 20 19:49:11.490939 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1199788649 Jul 20 19:49:11.490939 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 19:49:11.490939 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 19:49:11.492518 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e0bb4af78c1d4589b1d3cc90d5e6be63"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e0bb4af78c1d4589b1d3cc90d5e6be63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_e0bb4af78c1d4589b1d3cc90d5e6be63", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/e0bb4af78c1d4589b1d3cc90d5e6be63"}]}] Jul 20 19:49:11.492518 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-VolumesSnapshotTestJSON-1199788649 Jul 20 19:49:11.492518 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: e0bb4af78c1d4589b1d3cc90d5e6be63 Jul 20 19:49:11.492518 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1199788649 Jul 20 19:49:11.492518 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-VolumesSnapshotTestJSON-1199788649-project Jul 20 19:49:11.492518 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 19:49:11.492518 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 19:49:11.492518 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: 78ae826a812b44328c48b82e9498ad8b Jul 20 19:49:11.492518 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-VolumesSnapshotTestJSON-1199788649-project Jul 20 19:49:11.492518 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: > Jul 20 19:49:11.493148 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bbcb19f9-4190-4fd1-a756-fed0a1f2c0fd) Jul 20 19:49:11.493148 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'server_id': '43fe56ab-bf09-4ec0-84d5-306f16cb9d5a', 'id': '314fa7fd-d882-4be3-a319-c7a44c9d8bba'} Jul 20 19:49:11.493148 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:49:11.493148 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:49:11.493148 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 19:49:11.493148 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 19:49:11.493148 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 19:49:11.493148 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 19:49:11.493148 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 20 19:49:11.493148 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 20 19:49:11.493148 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 20 19:49:11.493148 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 20 19:49:11.493148 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 20 19:49:11.493148 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 20 19:49:11.493148 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 20 19:49:11.493148 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 20 19:49:11.493148 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 19:49:11.494569 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 19:49:11.494569 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 19:49:11.494569 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 19:49:11.494569 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bbcb19f9-4190-4fd1-a756-fed0a1f2c0fd) Jul 20 19:49:11.494569 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:49:11.494569 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:49:11.494569 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:49:11.494569 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:49:11.494569 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 20 19:49:11.494569 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 20 19:49:11.494569 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 20 19:49:11.494569 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 20 19:49:11.494569 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 19:49:11.494569 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 19:49:11.494569 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 19:49:11.494569 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 19:49:11.494569 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 19:49:11.494569 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 19:49:11.494569 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 20 19:49:11.495810 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 20 19:49:11.495810 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 20 19:49:11.495810 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 20 19:49:11.495810 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 20 19:49:11.495810 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 20 19:49:11.495810 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 20 19:49:11.495810 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 20 19:49:11.495810 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 19:49:11.495810 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 19:49:11.495810 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 19:49:11.495810 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 19:49:11.495810 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bbcb19f9-4190-4fd1-a756-fed0a1f2c0fd) Jul 20 19:49:11.495810 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:49:11.495810 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:49:11.495810 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:49:11.495810 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:49:11.495810 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 20 19:49:11.498894 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 20 19:49:11.498894 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 19:49:11.498894 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 19:49:11.498894 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 20 19:49:11.498894 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 19:49:11.498894 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 20 19:49:11.498894 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 20 19:49:11.498894 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 20 19:49:11.498894 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 19:49:11.498894 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 20 19:49:11.498894 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 20 19:49:11.498894 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bbcb19f9-4190-4fd1-a756-fed0a1f2c0fd) Jul 20 19:49:11.498894 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:49:11.498894 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:49:11.498894 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:49:11.498894 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:49:11.498894 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:49:11.498894 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:49:11.501149 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:49:11.501149 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:49:11.501149 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:49:11.501149 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:49:11.501149 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 20 19:49:11.501149 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 20 19:49:11.501149 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bbcb19f9-4190-4fd1-a756-fed0a1f2c0fd) Jul 20 19:49:11.501149 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:49:11.501149 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:49:11.501149 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:49:11.501149 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:49:11.501149 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:49:11.501149 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:49:11.501149 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:49:11.501149 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:49:11.501149 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bbcb19f9-4190-4fd1-a756-fed0a1f2c0fd) Jul 20 19:49:11.501149 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:49:11.502857 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-0eef5aaf-8b85-4aba-b64d-4f3d41541e12 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bbcb19f9-4190-4fd1-a756-fed0a1f2c0fd) {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:49:11.502857 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-0eef5aaf-8b85-4aba-b64d-4f3d41541e12 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] 10.222.0.69 "DELETE /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a/os-volume_attachments/314fa7fd-d882-4be3-a319-c7a44c9d8bba" status: 400 len: 269 microversion: 2.1 time: 0.151254 Jul 20 19:49:11.502857 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1586/2217] 10.222.0.69 () {58 vars in 1415 bytes} [Wed Jul 20 19:49:11 2022] DELETE /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a/os-volume_attachments/314fa7fd-d882-4be3-a319-c7a44c9d8bba => generated 269 bytes in 152 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 19:49:11.502857 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-5f787a77-196a-46b7-b131-2ee1e2a5962c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:49:11.503441 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-5f787a77-196a-46b7-b131-2ee1e2a5962c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:49:11.505264 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5f787a77-196a-46b7-b131-2ee1e2a5962c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:49:11.505754 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5f787a77-196a-46b7-b131-2ee1e2a5962c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:49:11.506513 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5f787a77-196a-46b7-b131-2ee1e2a5962c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:49:11.507560 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5f787a77-196a-46b7-b131-2ee1e2a5962c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:49:11.570027 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-5f787a77-196a-46b7-b131-2ee1e2a5962c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:49:11.577796 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-5f787a77-196a-46b7-b131-2ee1e2a5962c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1214 microversion: 2.1 time: 0.083747 Jul 20 19:49:11.578358 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1587/2218] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:49:11 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:49:11.582700 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-470026f8-4ac1-4948-b35b-f0ce58a7e962 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:49:11.583180 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-470026f8-4ac1-4948-b35b-f0ce58a7e962 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 2b8da868-71d1-49ad-be95-25d0a41393e9] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:49:11.588587 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-470026f8-4ac1-4948-b35b-f0ce58a7e962 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:49:11.589023 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-470026f8-4ac1-4948-b35b-f0ce58a7e962 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:49:11.589790 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-470026f8-4ac1-4948-b35b-f0ce58a7e962 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:49:11.590219 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-470026f8-4ac1-4948-b35b-f0ce58a7e962 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:49:11.604012 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.wsgi [None req-470026f8-4ac1-4948-b35b-f0ce58a7e962 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] HTTP exception thrown: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. Jul 20 19:49:11.605681 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-470026f8-4ac1-4948-b35b-f0ce58a7e962 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Request method failure captured: Jul 20 19:49:11.605681 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: DELETE /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9 HTTP/1.1 Jul 20 19:49:11.605681 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 19:49:11.605681 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 19:49:11.605681 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 19:49:11.605681 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 0 Jul 20 19:49:11.605681 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 19:49:11.605681 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 19:49:11.605681 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 19:49:11.605681 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 19:49:11.605681 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2FZGdJT3PjrXOalhxF4cK7yFRY_rdKs7nWDyfOnHDqihLmSc76hrlTVi8pwFl4fc0_PdYOdKi8ehCojNmpTfeHu0z7420hnbFU_7tQyUQZJWpu7NkYJxMVzpGVG2-8TAgdTN19E5_16lQGWKKWKpZnKtS08L9dJthhYfMLyISTLj6Mc Jul 20 19:49:11.605681 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 19:49:11.605681 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 19:49:11.605681 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 19:49:11.605681 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 19:49:11.605681 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 19:49:11.605681 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 19:49:11.605681 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: 8821facab6ed48588d9d484b5e3d98ba Jul 20 19:49:11.605681 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1121196344 Jul 20 19:49:11.605681 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 19:49:11.605681 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 19:49:11.607311 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8821facab6ed48588d9d484b5e3d98ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8821facab6ed48588d9d484b5e3d98ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8821facab6ed48588d9d484b5e3d98ba", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8821facab6ed48588d9d484b5e3d98ba"}]}] Jul 20 19:49:11.607311 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1121196344 Jul 20 19:49:11.607311 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: 8821facab6ed48588d9d484b5e3d98ba Jul 20 19:49:11.607311 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1121196344 Jul 20 19:49:11.607311 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-ServerRescueNegativeTestJSON-1121196344-project Jul 20 19:49:11.607311 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 19:49:11.607311 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 19:49:11.607311 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: 9192f2842ca044f08e5f95f98f2e1b88 Jul 20 19:49:11.607311 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1121196344-project Jul 20 19:49:11.607311 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: > Jul 20 19:49:11.607311 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. Jul 20 19:49:11.607311 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'id': '2b8da868-71d1-49ad-be95-25d0a41393e9'} Jul 20 19:49:11.608669 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:49:11.608669 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:49:11.608669 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:49:11.608669 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:49:11.608669 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:49:11.608669 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:49:11.608669 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:49:11.608669 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:49:11.608669 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:49:11.608669 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:49:11.608669 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. Jul 20 19:49:11.608669 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:49:11.608669 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:49:11.608669 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:49:11.608669 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:49:11.608669 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:49:11.608669 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:49:11.608669 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:49:11.608669 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:49:11.608669 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:49:11.610188 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:49:11.610188 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 19:49:11.610188 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 19:49:11.610188 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 19:49:11.610188 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 19:49:11.610188 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:49:11.610188 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:49:11.610188 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:49:11.610188 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:49:11.610188 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. Jul 20 19:49:11.610188 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:49:11.610188 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:49:11.610188 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:49:11.610188 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:49:11.610188 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:49:11.610188 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:49:11.610188 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:49:11.610188 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:49:11.610188 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. Jul 20 19:49:11.610188 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:49:11.611420 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-470026f8-4ac1-4948-b35b-f0ce58a7e962 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Returning 404 to user: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:49:11.611420 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-470026f8-4ac1-4948-b35b-f0ce58a7e962 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "DELETE /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9" status: 404 len: 111 microversion: 2.1 time: 0.027775 Jul 20 19:49:11.611420 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1588/2219] 10.222.0.69 () {58 vars in 1238 bytes} [Wed Jul 20 19:49:11 2022] DELETE /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:49:11.612852 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-67e01fcd-a287-4f08-9e84-5ebb819f1c49 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:49:11.613827 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-67e01fcd-a287-4f08-9e84-5ebb819f1c49 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:49:11.619516 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-67e01fcd-a287-4f08-9e84-5ebb819f1c49 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:49:11.619964 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-67e01fcd-a287-4f08-9e84-5ebb819f1c49 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:49:11.620717 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-67e01fcd-a287-4f08-9e84-5ebb819f1c49 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:49:11.621149 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-67e01fcd-a287-4f08-9e84-5ebb819f1c49 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:49:11.650852 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-67e01fcd-a287-4f08-9e84-5ebb819f1c49 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041790 Jul 20 19:49:11.651397 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1589/2220] 10.222.0.69 () {60 vars in 1342 bytes} [Wed Jul 20 19:49:11 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 19:49:11.656392 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4cede0e5-5ee9-40af-8803-2b9429e2ca1a tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:49:11.656872 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-4cede0e5-5ee9-40af-8803-2b9429e2ca1a tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] [instance: 43fe56ab-bf09-4ec0-84d5-306f16cb9d5a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:49:11.662379 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4cede0e5-5ee9-40af-8803-2b9429e2ca1a tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:49:11.662828 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4cede0e5-5ee9-40af-8803-2b9429e2ca1a tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:49:11.663577 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4cede0e5-5ee9-40af-8803-2b9429e2ca1a tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:49:11.664012 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4cede0e5-5ee9-40af-8803-2b9429e2ca1a tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:49:21.660180 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_api:SELECT=16 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:49:21.681575 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=44 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:50:59.118405 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.objects.instance [None req-4cede0e5-5ee9-40af-8803-2b9429e2ca1a tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lazy-loading 'services' on Instance uuid 43fe56ab-bf09-4ec0-84d5-306f16cb9d5a {{(pid=117761) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:51:09.123197 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=4 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:51:11.581109 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.wsgi [None req-4cede0e5-5ee9-40af-8803-2b9429e2ca1a tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e8d64e47-a2be-476e-8668-879a68c1e14e) Jul 20 19:51:11.583561 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4cede0e5-5ee9-40af-8803-2b9429e2ca1a tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Request method failure captured: Jul 20 19:51:11.583561 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: DELETE /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a/os-volume_attachments/314fa7fd-d882-4be3-a319-c7a44c9d8bba HTTP/1.1 Jul 20 19:51:11.583561 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 19:51:11.583561 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 19:51:11.583561 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 19:51:11.583561 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 0 Jul 20 19:51:11.583561 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 19:51:11.583561 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 19:51:11.583561 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 19:51:11.583561 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 19:51:11.583561 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2FbvraeCBRrPE4O7lrRb8qOLZk5VEOCVBOl4zMC1gg8XMd7uuHid9RioGTRX_JruGVyWJZ88XS9h66QDLJKZqWWE0MjOusG0phS1nTYkPwx2OHkqAGkCtP2OLBH1bnn2QsTgDuvA_AZ-0_Frr--F8Gf2qGtpGL5jfce4gMVrg4Ozv-Y Jul 20 19:51:11.583561 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 19:51:11.583561 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 19:51:11.583561 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 19:51:11.583561 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 19:51:11.583561 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 19:51:11.583561 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 19:51:11.583561 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: e0bb4af78c1d4589b1d3cc90d5e6be63 Jul 20 19:51:11.583561 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1199788649 Jul 20 19:51:11.583561 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 19:51:11.583561 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 19:51:11.585932 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e0bb4af78c1d4589b1d3cc90d5e6be63"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e0bb4af78c1d4589b1d3cc90d5e6be63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_e0bb4af78c1d4589b1d3cc90d5e6be63", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/e0bb4af78c1d4589b1d3cc90d5e6be63"}]}] Jul 20 19:51:11.585932 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-VolumesSnapshotTestJSON-1199788649 Jul 20 19:51:11.585932 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: e0bb4af78c1d4589b1d3cc90d5e6be63 Jul 20 19:51:11.585932 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1199788649 Jul 20 19:51:11.585932 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-VolumesSnapshotTestJSON-1199788649-project Jul 20 19:51:11.585932 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 19:51:11.585932 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 19:51:11.585932 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: 78ae826a812b44328c48b82e9498ad8b Jul 20 19:51:11.585932 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-VolumesSnapshotTestJSON-1199788649-project Jul 20 19:51:11.585932 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: > Jul 20 19:51:11.586886 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e8d64e47-a2be-476e-8668-879a68c1e14e) Jul 20 19:51:11.586886 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'server_id': '43fe56ab-bf09-4ec0-84d5-306f16cb9d5a', 'id': '314fa7fd-d882-4be3-a319-c7a44c9d8bba'} Jul 20 19:51:11.586886 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:51:11.586886 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:51:11.586886 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 19:51:11.586886 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 19:51:11.586886 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 19:51:11.586886 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 19:51:11.586886 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 20 19:51:11.586886 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 20 19:51:11.586886 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 20 19:51:11.586886 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 20 19:51:11.586886 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 20 19:51:11.586886 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 20 19:51:11.586886 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 20 19:51:11.586886 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 20 19:51:11.586886 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 19:51:11.589021 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 19:51:11.589021 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 19:51:11.589021 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 19:51:11.589021 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e8d64e47-a2be-476e-8668-879a68c1e14e) Jul 20 19:51:11.589021 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:51:11.589021 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:51:11.589021 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:51:11.589021 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:51:11.589021 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 20 19:51:11.589021 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 20 19:51:11.589021 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 20 19:51:11.589021 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 20 19:51:11.589021 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 19:51:11.589021 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 19:51:11.589021 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 19:51:11.589021 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 19:51:11.589021 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 19:51:11.589021 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 19:51:11.589021 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 20 19:51:11.590594 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 20 19:51:11.590594 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 20 19:51:11.590594 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 20 19:51:11.590594 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 20 19:51:11.590594 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 20 19:51:11.590594 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 20 19:51:11.590594 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 20 19:51:11.590594 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 19:51:11.590594 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 19:51:11.590594 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 19:51:11.590594 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 19:51:11.590594 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e8d64e47-a2be-476e-8668-879a68c1e14e) Jul 20 19:51:11.590594 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:51:11.590594 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:51:11.590594 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:51:11.590594 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:51:11.590594 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 20 19:51:11.591968 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 20 19:51:11.591968 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 19:51:11.591968 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 19:51:11.591968 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 20 19:51:11.591968 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 19:51:11.591968 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 20 19:51:11.591968 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 20 19:51:11.591968 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 20 19:51:11.591968 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 19:51:11.591968 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 20 19:51:11.591968 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 20 19:51:11.591968 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e8d64e47-a2be-476e-8668-879a68c1e14e) Jul 20 19:51:11.591968 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:51:11.591968 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:51:11.591968 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:51:11.591968 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:51:11.591968 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:51:11.591968 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:51:11.593385 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:51:11.593385 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:51:11.593385 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:51:11.593385 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:51:11.593385 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 20 19:51:11.593385 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 20 19:51:11.593385 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e8d64e47-a2be-476e-8668-879a68c1e14e) Jul 20 19:51:11.593385 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:51:11.593385 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:51:11.593385 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:51:11.593385 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:51:11.593385 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:51:11.593385 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:51:11.593385 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:51:11.593385 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:51:11.593385 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e8d64e47-a2be-476e-8668-879a68c1e14e) Jul 20 19:51:11.593385 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:51:11.594757 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4cede0e5-5ee9-40af-8803-2b9429e2ca1a tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e8d64e47-a2be-476e-8668-879a68c1e14e) {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:51:11.594757 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-4cede0e5-5ee9-40af-8803-2b9429e2ca1a tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] 10.222.0.69 "DELETE /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a/os-volume_attachments/314fa7fd-d882-4be3-a319-c7a44c9d8bba" status: 400 len: 269 microversion: 2.1 time: 119.933309 Jul 20 19:51:11.594757 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1590/2221] 10.222.0.69 () {58 vars in 1415 bytes} [Wed Jul 20 19:49:11 2022] DELETE /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a/os-volume_attachments/314fa7fd-d882-4be3-a319-c7a44c9d8bba => generated 269 bytes in 119934 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 19:51:11.594757 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-01ea2255-791e-4a85-b120-177c1e0bacfe tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:51:11.595128 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-01ea2255-791e-4a85-b120-177c1e0bacfe tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:51:11.600413 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-01ea2255-791e-4a85-b120-177c1e0bacfe tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:51:11.601026 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-01ea2255-791e-4a85-b120-177c1e0bacfe tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:51:11.601830 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-01ea2255-791e-4a85-b120-177c1e0bacfe tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:51:11.602271 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-01ea2255-791e-4a85-b120-177c1e0bacfe tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:51:11.678647 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-01ea2255-791e-4a85-b120-177c1e0bacfe tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:51:11.686237 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-01ea2255-791e-4a85-b120-177c1e0bacfe tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1214 microversion: 2.1 time: 0.098986 Jul 20 19:51:11.686782 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1591/2222] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:51:11 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1214 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:51:11.691186 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-2f9cf596-be44-4dd8-ba02-31043d8b1c20 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:51:11.691658 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-2f9cf596-be44-4dd8-ba02-31043d8b1c20 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 2b8da868-71d1-49ad-be95-25d0a41393e9] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:51:11.697702 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2f9cf596-be44-4dd8-ba02-31043d8b1c20 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:51:11.698143 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2f9cf596-be44-4dd8-ba02-31043d8b1c20 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:51:11.698887 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2f9cf596-be44-4dd8-ba02-31043d8b1c20 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:51:11.699314 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2f9cf596-be44-4dd8-ba02-31043d8b1c20 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:51:11.712783 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.wsgi [None req-2f9cf596-be44-4dd8-ba02-31043d8b1c20 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] HTTP exception thrown: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. Jul 20 19:51:11.714323 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-2f9cf596-be44-4dd8-ba02-31043d8b1c20 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Request method failure captured: Jul 20 19:51:11.714323 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: DELETE /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9 HTTP/1.1 Jul 20 19:51:11.714323 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 19:51:11.714323 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 19:51:11.714323 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 19:51:11.714323 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 0 Jul 20 19:51:11.714323 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 19:51:11.714323 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 19:51:11.714323 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 19:51:11.714323 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 19:51:11.714323 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2FZGdJT3PjrXOalhxF4cK7yFRY_rdKs7nWDyfOnHDqihLmSc76hrlTVi8pwFl4fc0_PdYOdKi8ehCojNmpTfeHu0z7420hnbFU_7tQyUQZJWpu7NkYJxMVzpGVG2-8TAgdTN19E5_16lQGWKKWKpZnKtS08L9dJthhYfMLyISTLj6Mc Jul 20 19:51:11.714323 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 19:51:11.714323 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 19:51:11.714323 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 19:51:11.714323 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 19:51:11.714323 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 19:51:11.714323 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 19:51:11.714323 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: 8821facab6ed48588d9d484b5e3d98ba Jul 20 19:51:11.714323 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1121196344 Jul 20 19:51:11.714323 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 19:51:11.714323 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 19:51:11.716011 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8821facab6ed48588d9d484b5e3d98ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8821facab6ed48588d9d484b5e3d98ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8821facab6ed48588d9d484b5e3d98ba", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8821facab6ed48588d9d484b5e3d98ba"}]}] Jul 20 19:51:11.716011 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1121196344 Jul 20 19:51:11.716011 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: 8821facab6ed48588d9d484b5e3d98ba Jul 20 19:51:11.716011 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1121196344 Jul 20 19:51:11.716011 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-ServerRescueNegativeTestJSON-1121196344-project Jul 20 19:51:11.716011 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 19:51:11.716011 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 19:51:11.716011 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: 9192f2842ca044f08e5f95f98f2e1b88 Jul 20 19:51:11.716011 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1121196344-project Jul 20 19:51:11.716011 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: > Jul 20 19:51:11.716011 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. Jul 20 19:51:11.716011 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'id': '2b8da868-71d1-49ad-be95-25d0a41393e9'} Jul 20 19:51:11.716990 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:51:11.716990 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:51:11.716990 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:51:11.716990 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:51:11.716990 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:51:11.716990 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:51:11.716990 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:51:11.716990 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:51:11.716990 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:51:11.716990 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:51:11.716990 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. Jul 20 19:51:11.716990 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:51:11.716990 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:51:11.716990 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:51:11.716990 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:51:11.716990 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:51:11.716990 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:51:11.716990 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:51:11.716990 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:51:11.716990 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:51:11.718574 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:51:11.718574 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 19:51:11.718574 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 19:51:11.718574 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 19:51:11.718574 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 19:51:11.718574 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:51:11.718574 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:51:11.718574 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:51:11.718574 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:51:11.718574 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. Jul 20 19:51:11.718574 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:51:11.718574 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:51:11.718574 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:51:11.718574 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:51:11.718574 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:51:11.718574 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:51:11.718574 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:51:11.718574 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:51:11.718574 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. Jul 20 19:51:11.718574 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:51:11.720299 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-2f9cf596-be44-4dd8-ba02-31043d8b1c20 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Returning 404 to user: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:51:11.720299 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-2f9cf596-be44-4dd8-ba02-31043d8b1c20 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "DELETE /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9" status: 404 len: 111 microversion: 2.1 time: 0.027858 Jul 20 19:51:11.720299 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1592/2223] 10.222.0.69 () {58 vars in 1238 bytes} [Wed Jul 20 19:51:11 2022] DELETE /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:51:11.720940 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-7309cf05-8a55-4ee1-9bd0-fa6c5f076a40 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:51:11.722123 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-7309cf05-8a55-4ee1-9bd0-fa6c5f076a40 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:51:11.727709 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7309cf05-8a55-4ee1-9bd0-fa6c5f076a40 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:51:11.728151 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7309cf05-8a55-4ee1-9bd0-fa6c5f076a40 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:51:11.728884 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7309cf05-8a55-4ee1-9bd0-fa6c5f076a40 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:51:11.729308 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7309cf05-8a55-4ee1-9bd0-fa6c5f076a40 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:51:11.757728 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-7309cf05-8a55-4ee1-9bd0-fa6c5f076a40 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040194 Jul 20 19:51:11.758261 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1593/2224] 10.222.0.69 () {58 vars in 1301 bytes} [Wed Jul 20 19:51:11 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:51:11.876844 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [req-b4add6ae-5c85-4c29-8925-61a2a303cb5d req-b453e0ed-2bd4-455f-b047-60a762fb71a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "239cb0b6-54d7-4cc2-945a-1f026a015992", "name": "network-vif-deleted", "tag": "761fbace-90da-4e61-bc51-77b19745762a"}]} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:51:11.885749 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-b4add6ae-5c85-4c29-8925-61a2a303cb5d req-b453e0ed-2bd4-455f-b047-60a762fb71a6 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:51:11.886190 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-b4add6ae-5c85-4c29-8925-61a2a303cb5d req-b453e0ed-2bd4-455f-b047-60a762fb71a6 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:51:11.896734 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.compute.server_external_events [req-b4add6ae-5c85-4c29-8925-61a2a303cb5d req-b453e0ed-2bd4-455f-b047-60a762fb71a6 service nova] Creating event network-vif-deleted:761fbace-90da-4e61-bc51-77b19745762a for instance 239cb0b6-54d7-4cc2-945a-1f026a015992 on hv-cinder-83538 Jul 20 19:51:11.901744 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [req-b4add6ae-5c85-4c29-8925-61a2a303cb5d req-b453e0ed-2bd4-455f-b047-60a762fb71a6 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142181 Jul 20 19:51:11.902329 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1594/2225] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 19:51:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:51:12.019502 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-16a5d1a3-0f9b-4846-b3d2-a2479deae77f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:51:12.020509 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-16a5d1a3-0f9b-4846-b3d2-a2479deae77f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:51:12.026663 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-16a5d1a3-0f9b-4846-b3d2-a2479deae77f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:51:12.027106 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-16a5d1a3-0f9b-4846-b3d2-a2479deae77f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:51:12.027858 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-16a5d1a3-0f9b-4846-b3d2-a2479deae77f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:51:12.028287 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-16a5d1a3-0f9b-4846-b3d2-a2479deae77f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:51:12.057836 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-16a5d1a3-0f9b-4846-b3d2-a2479deae77f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.153472 Jul 20 19:51:12.058398 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1595/2226] 10.222.0.69 () {60 vars in 1342 bytes} [Wed Jul 20 19:51:11 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55/os-volume_attachments => generated 197 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 19:51:12.062975 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-9ea738cf-50cd-42e1-810b-ca7cfd330cec tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:51:12.063453 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-9ea738cf-50cd-42e1-810b-ca7cfd330cec tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] [instance: 43fe56ab-bf09-4ec0-84d5-306f16cb9d5a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:51:12.069422 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9ea738cf-50cd-42e1-810b-ca7cfd330cec tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:51:12.069896 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9ea738cf-50cd-42e1-810b-ca7cfd330cec tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:51:12.070643 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9ea738cf-50cd-42e1-810b-ca7cfd330cec tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:51:12.071103 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9ea738cf-50cd-42e1-810b-ca7cfd330cec tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:51:22.067220 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_api:SELECT=12 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:51:22.088462 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=26 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:52:05.100804 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 19:52:05.101562 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Wed Jul 20 19:52:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a/os-volume_attachments/314fa7fd-d882-4be3-a319-c7a44c9d8bba (ip 10.222.0.69) !!! Jul 20 19:52:07.193730 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 19:52:07.194315 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Wed Jul 20 19:52:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a/os-volume_attachments/314fa7fd-d882-4be3-a319-c7a44c9d8bba (ip 10.222.0.69) !!! Jul 20 19:52:59.273560 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.objects.instance [None req-9ea738cf-50cd-42e1-810b-ca7cfd330cec tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lazy-loading 'services' on Instance uuid 43fe56ab-bf09-4ec0-84d5-306f16cb9d5a {{(pid=117761) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:53:09.278427 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=4 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:53:11.692301 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.wsgi [None req-9ea738cf-50cd-42e1-810b-ca7cfd330cec tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4dfdaed8-2ce7-4899-855f-c9e6f20cbe30) Jul 20 19:53:11.694716 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-9ea738cf-50cd-42e1-810b-ca7cfd330cec tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Request method failure captured: Jul 20 19:53:11.694716 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: DELETE /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a/os-volume_attachments/314fa7fd-d882-4be3-a319-c7a44c9d8bba HTTP/1.1 Jul 20 19:53:11.694716 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 19:53:11.694716 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 19:53:11.694716 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 19:53:11.694716 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 0 Jul 20 19:53:11.694716 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 19:53:11.694716 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 19:53:11.694716 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 19:53:11.694716 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 19:53:11.694716 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2FbvraeCBRrPE4O7lrRb8qOLZk5VEOCVBOl4zMC1gg8XMd7uuHid9RioGTRX_JruGVyWJZ88XS9h66QDLJKZqWWE0MjOusG0phS1nTYkPwx2OHkqAGkCtP2OLBH1bnn2QsTgDuvA_AZ-0_Frr--F8Gf2qGtpGL5jfce4gMVrg4Ozv-Y Jul 20 19:53:11.694716 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 19:53:11.694716 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 19:53:11.694716 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 19:53:11.694716 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 19:53:11.694716 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 19:53:11.694716 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 19:53:11.694716 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: e0bb4af78c1d4589b1d3cc90d5e6be63 Jul 20 19:53:11.694716 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1199788649 Jul 20 19:53:11.694716 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 19:53:11.694716 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 19:53:11.696216 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e0bb4af78c1d4589b1d3cc90d5e6be63"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e0bb4af78c1d4589b1d3cc90d5e6be63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_e0bb4af78c1d4589b1d3cc90d5e6be63", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/e0bb4af78c1d4589b1d3cc90d5e6be63"}]}] Jul 20 19:53:11.696216 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-VolumesSnapshotTestJSON-1199788649 Jul 20 19:53:11.696216 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: e0bb4af78c1d4589b1d3cc90d5e6be63 Jul 20 19:53:11.696216 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1199788649 Jul 20 19:53:11.696216 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-VolumesSnapshotTestJSON-1199788649-project Jul 20 19:53:11.696216 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 19:53:11.696216 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 19:53:11.696216 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: 78ae826a812b44328c48b82e9498ad8b Jul 20 19:53:11.696216 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-VolumesSnapshotTestJSON-1199788649-project Jul 20 19:53:11.696216 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: > Jul 20 19:53:11.697128 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4dfdaed8-2ce7-4899-855f-c9e6f20cbe30) Jul 20 19:53:11.697128 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'server_id': '43fe56ab-bf09-4ec0-84d5-306f16cb9d5a', 'id': '314fa7fd-d882-4be3-a319-c7a44c9d8bba'} Jul 20 19:53:11.697128 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:53:11.697128 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:53:11.697128 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 19:53:11.697128 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 19:53:11.697128 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 19:53:11.697128 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 19:53:11.697128 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 20 19:53:11.697128 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 20 19:53:11.697128 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 20 19:53:11.697128 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 20 19:53:11.697128 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 20 19:53:11.697128 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 20 19:53:11.697128 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 20 19:53:11.697128 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 20 19:53:11.697128 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 19:53:11.698329 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 19:53:11.698329 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 19:53:11.698329 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 19:53:11.698329 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4dfdaed8-2ce7-4899-855f-c9e6f20cbe30) Jul 20 19:53:11.698329 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:53:11.698329 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:53:11.698329 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:53:11.698329 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:53:11.698329 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 20 19:53:11.698329 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 20 19:53:11.698329 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 20 19:53:11.698329 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 20 19:53:11.698329 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 19:53:11.698329 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 19:53:11.698329 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 19:53:11.698329 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 19:53:11.698329 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 19:53:11.698329 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 19:53:11.698329 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 20 19:53:11.700612 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 20 19:53:11.700612 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 20 19:53:11.700612 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 20 19:53:11.700612 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 20 19:53:11.700612 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 20 19:53:11.700612 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 20 19:53:11.700612 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 20 19:53:11.700612 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 19:53:11.700612 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 19:53:11.700612 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 19:53:11.700612 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 19:53:11.700612 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4dfdaed8-2ce7-4899-855f-c9e6f20cbe30) Jul 20 19:53:11.700612 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:53:11.700612 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:53:11.700612 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:53:11.700612 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:53:11.700612 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 20 19:53:11.701818 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 20 19:53:11.701818 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 19:53:11.701818 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 19:53:11.701818 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 20 19:53:11.701818 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 19:53:11.701818 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 20 19:53:11.701818 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 20 19:53:11.701818 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 20 19:53:11.701818 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 19:53:11.701818 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 20 19:53:11.701818 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 20 19:53:11.701818 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4dfdaed8-2ce7-4899-855f-c9e6f20cbe30) Jul 20 19:53:11.701818 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:53:11.701818 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:53:11.701818 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:53:11.701818 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:53:11.701818 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:53:11.701818 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:53:11.703343 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:53:11.703343 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:53:11.703343 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:53:11.703343 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:53:11.703343 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 20 19:53:11.703343 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 20 19:53:11.703343 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4dfdaed8-2ce7-4899-855f-c9e6f20cbe30) Jul 20 19:53:11.703343 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:53:11.703343 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:53:11.703343 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:53:11.703343 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:53:11.703343 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:53:11.703343 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:53:11.703343 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:53:11.703343 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:53:11.703343 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4dfdaed8-2ce7-4899-855f-c9e6f20cbe30) Jul 20 19:53:11.703343 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:53:11.704693 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-9ea738cf-50cd-42e1-810b-ca7cfd330cec tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4dfdaed8-2ce7-4899-855f-c9e6f20cbe30) {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:53:11.704693 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-9ea738cf-50cd-42e1-810b-ca7cfd330cec tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] 10.222.0.69 "DELETE /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a/os-volume_attachments/314fa7fd-d882-4be3-a319-c7a44c9d8bba" status: 400 len: 269 microversion: 2.1 time: 119.636659 Jul 20 19:53:11.704693 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1596/2227] 10.222.0.69 () {58 vars in 1415 bytes} [Wed Jul 20 19:51:12 2022] DELETE /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a/os-volume_attachments/314fa7fd-d882-4be3-a319-c7a44c9d8bba => generated 269 bytes in 119638 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 19:53:11.704693 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c5ceadee-72cd-4f42-81ed-3fd263dc8ddb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:53:11.705068 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c5ceadee-72cd-4f42-81ed-3fd263dc8ddb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:53:11.709634 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c5ceadee-72cd-4f42-81ed-3fd263dc8ddb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:53:11.710092 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c5ceadee-72cd-4f42-81ed-3fd263dc8ddb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:53:11.710835 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c5ceadee-72cd-4f42-81ed-3fd263dc8ddb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:53:11.711261 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c5ceadee-72cd-4f42-81ed-3fd263dc8ddb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:53:11.778455 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c5ceadee-72cd-4f42-81ed-3fd263dc8ddb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:53:11.785801 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c5ceadee-72cd-4f42-81ed-3fd263dc8ddb tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1214 microversion: 2.1 time: 0.088169 Jul 20 19:53:11.786364 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1597/2228] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:53:11 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 1214 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:53:11.790633 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-1323f58c-20fe-482f-b687-8faad735cc04 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:53:11.791115 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-1323f58c-20fe-482f-b687-8faad735cc04 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 2b8da868-71d1-49ad-be95-25d0a41393e9] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:53:11.796622 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1323f58c-20fe-482f-b687-8faad735cc04 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:53:11.797056 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1323f58c-20fe-482f-b687-8faad735cc04 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:53:11.797931 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1323f58c-20fe-482f-b687-8faad735cc04 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:53:11.798359 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1323f58c-20fe-482f-b687-8faad735cc04 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:53:11.811196 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.wsgi [None req-1323f58c-20fe-482f-b687-8faad735cc04 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] HTTP exception thrown: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. Jul 20 19:53:11.812707 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-1323f58c-20fe-482f-b687-8faad735cc04 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Request method failure captured: Jul 20 19:53:11.812707 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: DELETE /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9 HTTP/1.1 Jul 20 19:53:11.812707 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 19:53:11.812707 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 19:53:11.812707 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 19:53:11.812707 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 0 Jul 20 19:53:11.812707 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 19:53:11.812707 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 19:53:11.812707 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 19:53:11.812707 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 19:53:11.812707 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2FZGdJT3PjrXOalhxF4cK7yFRY_rdKs7nWDyfOnHDqihLmSc76hrlTVi8pwFl4fc0_PdYOdKi8ehCojNmpTfeHu0z7420hnbFU_7tQyUQZJWpu7NkYJxMVzpGVG2-8TAgdTN19E5_16lQGWKKWKpZnKtS08L9dJthhYfMLyISTLj6Mc Jul 20 19:53:11.812707 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 19:53:11.812707 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 19:53:11.812707 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 19:53:11.812707 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 19:53:11.812707 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 19:53:11.812707 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 19:53:11.812707 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: 8821facab6ed48588d9d484b5e3d98ba Jul 20 19:53:11.812707 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1121196344 Jul 20 19:53:11.812707 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 19:53:11.812707 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 19:53:11.814406 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8821facab6ed48588d9d484b5e3d98ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8821facab6ed48588d9d484b5e3d98ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8821facab6ed48588d9d484b5e3d98ba", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8821facab6ed48588d9d484b5e3d98ba"}]}] Jul 20 19:53:11.814406 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1121196344 Jul 20 19:53:11.814406 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: 8821facab6ed48588d9d484b5e3d98ba Jul 20 19:53:11.814406 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1121196344 Jul 20 19:53:11.814406 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-ServerRescueNegativeTestJSON-1121196344-project Jul 20 19:53:11.814406 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 19:53:11.814406 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 19:53:11.814406 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: 9192f2842ca044f08e5f95f98f2e1b88 Jul 20 19:53:11.814406 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1121196344-project Jul 20 19:53:11.814406 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: > Jul 20 19:53:11.814406 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. Jul 20 19:53:11.814406 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'id': '2b8da868-71d1-49ad-be95-25d0a41393e9'} Jul 20 19:53:11.815212 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:53:11.815212 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:53:11.815212 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:53:11.815212 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:53:11.815212 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:53:11.815212 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:53:11.815212 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:53:11.815212 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:53:11.815212 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:53:11.815212 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:53:11.815212 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. Jul 20 19:53:11.815212 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:53:11.815212 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:53:11.815212 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:53:11.815212 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:53:11.815212 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:53:11.815212 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:53:11.815212 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:53:11.815212 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:53:11.815212 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:53:11.816693 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:53:11.816693 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 19:53:11.816693 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 19:53:11.816693 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 19:53:11.816693 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 19:53:11.816693 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:53:11.816693 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:53:11.816693 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:53:11.816693 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:53:11.816693 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. Jul 20 19:53:11.816693 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:53:11.816693 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:53:11.816693 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:53:11.816693 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:53:11.816693 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:53:11.816693 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:53:11.816693 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:53:11.816693 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:53:11.816693 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. Jul 20 19:53:11.816693 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:53:11.818329 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-1323f58c-20fe-482f-b687-8faad735cc04 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Returning 404 to user: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:53:11.818329 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-1323f58c-20fe-482f-b687-8faad735cc04 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "DELETE /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9" status: 404 len: 111 microversion: 2.1 time: 0.026888 Jul 20 19:53:11.818329 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1598/2229] 10.222.0.69 () {58 vars in 1238 bytes} [Wed Jul 20 19:53:11 2022] DELETE /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:53:11.958056 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-61ce00e6-78f1-4d89-9c8c-d9bcd691521a tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:53:11.959070 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-61ce00e6-78f1-4d89-9c8c-d9bcd691521a tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:53:11.965251 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-61ce00e6-78f1-4d89-9c8c-d9bcd691521a tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:53:11.965784 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-61ce00e6-78f1-4d89-9c8c-d9bcd691521a tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:53:11.966549 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-61ce00e6-78f1-4d89-9c8c-d9bcd691521a tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:53:11.966989 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-61ce00e6-78f1-4d89-9c8c-d9bcd691521a tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:53:11.995478 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-61ce00e6-78f1-4d89-9c8c-d9bcd691521a tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.179908 Jul 20 19:53:11.996827 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1599/2230] 10.222.0.69 () {58 vars in 1301 bytes} [Wed Jul 20 19:53:11 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a/os-volume_attachments => generated 197 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:53:12.001788 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-fda2cace-087e-45ae-b2b1-4e8dd9e016de tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:53:12.002670 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-fda2cace-087e-45ae-b2b1-4e8dd9e016de tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:53:12.008111 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fda2cace-087e-45ae-b2b1-4e8dd9e016de tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:53:12.008588 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fda2cace-087e-45ae-b2b1-4e8dd9e016de tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:53:12.009335 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fda2cace-087e-45ae-b2b1-4e8dd9e016de tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:53:12.009798 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fda2cace-087e-45ae-b2b1-4e8dd9e016de tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:53:12.038450 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-fda2cace-087e-45ae-b2b1-4e8dd9e016de tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040622 Jul 20 19:53:12.039002 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1600/2231] 10.222.0.69 () {60 vars in 1342 bytes} [Wed Jul 20 19:53:11 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 19:53:12.043693 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-287573b8-6069-40d9-b96c-9faa283ef4ef tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:53:12.044177 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-287573b8-6069-40d9-b96c-9faa283ef4ef tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] [instance: 43fe56ab-bf09-4ec0-84d5-306f16cb9d5a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:53:12.049624 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-287573b8-6069-40d9-b96c-9faa283ef4ef tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:53:12.050075 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-287573b8-6069-40d9-b96c-9faa283ef4ef tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:53:12.050825 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-287573b8-6069-40d9-b96c-9faa283ef4ef tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:53:12.051263 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-287573b8-6069-40d9-b96c-9faa283ef4ef tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:53:22.047104 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_api:SELECT=10 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:53:22.069317 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=24 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:54:03.151029 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 19:54:03.151869 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Wed Jul 20 19:54:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a/os-volume_attachments/314fa7fd-d882-4be3-a319-c7a44c9d8bba (ip 10.222.0.69) !!! Jul 20 19:54:59.663727 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.objects.instance [None req-287573b8-6069-40d9-b96c-9faa283ef4ef tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lazy-loading 'services' on Instance uuid 43fe56ab-bf09-4ec0-84d5-306f16cb9d5a {{(pid=117761) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:55:09.668145 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=4 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:55:11.800094 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.wsgi [None req-287573b8-6069-40d9-b96c-9faa283ef4ef tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7f5929b6-2fcf-4e70-a758-448c567f7a6d) Jul 20 19:55:11.802951 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-287573b8-6069-40d9-b96c-9faa283ef4ef tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Request method failure captured: Jul 20 19:55:11.802951 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: DELETE /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a/os-volume_attachments/314fa7fd-d882-4be3-a319-c7a44c9d8bba HTTP/1.1 Jul 20 19:55:11.802951 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 19:55:11.802951 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 19:55:11.802951 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 19:55:11.802951 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 0 Jul 20 19:55:11.802951 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 19:55:11.802951 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 19:55:11.802951 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 19:55:11.802951 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 19:55:11.802951 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2FbvraeCBRrPE4O7lrRb8qOLZk5VEOCVBOl4zMC1gg8XMd7uuHid9RioGTRX_JruGVyWJZ88XS9h66QDLJKZqWWE0MjOusG0phS1nTYkPwx2OHkqAGkCtP2OLBH1bnn2QsTgDuvA_AZ-0_Frr--F8Gf2qGtpGL5jfce4gMVrg4Ozv-Y Jul 20 19:55:11.802951 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 19:55:11.802951 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 19:55:11.802951 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 19:55:11.802951 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 19:55:11.802951 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 19:55:11.802951 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 19:55:11.802951 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: e0bb4af78c1d4589b1d3cc90d5e6be63 Jul 20 19:55:11.802951 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1199788649 Jul 20 19:55:11.802951 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 19:55:11.802951 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 19:55:11.804423 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e0bb4af78c1d4589b1d3cc90d5e6be63"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e0bb4af78c1d4589b1d3cc90d5e6be63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_e0bb4af78c1d4589b1d3cc90d5e6be63", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/e0bb4af78c1d4589b1d3cc90d5e6be63"}]}] Jul 20 19:55:11.804423 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-VolumesSnapshotTestJSON-1199788649 Jul 20 19:55:11.804423 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: e0bb4af78c1d4589b1d3cc90d5e6be63 Jul 20 19:55:11.804423 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1199788649 Jul 20 19:55:11.804423 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-VolumesSnapshotTestJSON-1199788649-project Jul 20 19:55:11.804423 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 19:55:11.804423 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 19:55:11.804423 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: 78ae826a812b44328c48b82e9498ad8b Jul 20 19:55:11.804423 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-VolumesSnapshotTestJSON-1199788649-project Jul 20 19:55:11.804423 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: > Jul 20 19:55:11.805442 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7f5929b6-2fcf-4e70-a758-448c567f7a6d) Jul 20 19:55:11.805442 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'server_id': '43fe56ab-bf09-4ec0-84d5-306f16cb9d5a', 'id': '314fa7fd-d882-4be3-a319-c7a44c9d8bba'} Jul 20 19:55:11.805442 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:55:11.805442 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:55:11.805442 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 19:55:11.805442 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 19:55:11.805442 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 19:55:11.805442 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 19:55:11.805442 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 20 19:55:11.805442 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 20 19:55:11.805442 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 20 19:55:11.805442 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 20 19:55:11.805442 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 20 19:55:11.805442 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 20 19:55:11.805442 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 20 19:55:11.805442 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 20 19:55:11.805442 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 19:55:11.806635 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 19:55:11.806635 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 19:55:11.806635 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 19:55:11.806635 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7f5929b6-2fcf-4e70-a758-448c567f7a6d) Jul 20 19:55:11.806635 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:55:11.806635 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:55:11.806635 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:55:11.806635 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:55:11.806635 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 20 19:55:11.806635 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 20 19:55:11.806635 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 20 19:55:11.806635 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 20 19:55:11.806635 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 19:55:11.806635 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 19:55:11.806635 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 19:55:11.806635 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 19:55:11.806635 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 19:55:11.806635 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 19:55:11.806635 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 20 19:55:11.808936 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 20 19:55:11.808936 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 20 19:55:11.808936 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 20 19:55:11.808936 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 20 19:55:11.808936 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 20 19:55:11.808936 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 20 19:55:11.808936 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 20 19:55:11.808936 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 19:55:11.808936 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 19:55:11.808936 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 19:55:11.808936 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 19:55:11.808936 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7f5929b6-2fcf-4e70-a758-448c567f7a6d) Jul 20 19:55:11.808936 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:55:11.808936 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:55:11.808936 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:55:11.808936 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:55:11.808936 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 20 19:55:11.810316 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 20 19:55:11.810316 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 19:55:11.810316 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 19:55:11.810316 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 20 19:55:11.810316 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 19:55:11.810316 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 20 19:55:11.810316 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 20 19:55:11.810316 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 20 19:55:11.810316 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 19:55:11.810316 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 20 19:55:11.810316 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 20 19:55:11.810316 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7f5929b6-2fcf-4e70-a758-448c567f7a6d) Jul 20 19:55:11.810316 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:55:11.810316 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:55:11.810316 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:55:11.810316 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:55:11.810316 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:55:11.810316 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:55:11.812994 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:55:11.812994 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:55:11.812994 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:55:11.812994 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:55:11.812994 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 20 19:55:11.812994 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 20 19:55:11.812994 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7f5929b6-2fcf-4e70-a758-448c567f7a6d) Jul 20 19:55:11.812994 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:55:11.812994 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:55:11.812994 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:55:11.812994 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:55:11.812994 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:55:11.812994 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:55:11.812994 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:55:11.812994 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:55:11.812994 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7f5929b6-2fcf-4e70-a758-448c567f7a6d) Jul 20 19:55:11.812994 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:55:11.814635 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-287573b8-6069-40d9-b96c-9faa283ef4ef tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7f5929b6-2fcf-4e70-a758-448c567f7a6d) {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:55:11.814635 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-287573b8-6069-40d9-b96c-9faa283ef4ef tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] 10.222.0.69 "DELETE /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a/os-volume_attachments/314fa7fd-d882-4be3-a319-c7a44c9d8bba" status: 400 len: 269 microversion: 2.1 time: 119.764345 Jul 20 19:55:11.814635 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Wed Jul 20 19:55:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a/os-volume_attachments/314fa7fd-d882-4be3-a319-c7a44c9d8bba (ip 10.222.0.69) !!! Jul 20 19:55:11.814635 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Wed Jul 20 19:55:11 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a/os-volume_attachments/314fa7fd-d882-4be3-a319-c7a44c9d8bba (10.222.0.69) Jul 20 19:55:11.814635 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: CRITICAL nova [None req-287573b8-6069-40d9-b96c-9faa283ef4ef tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Unhandled error: OSError: write error Jul 20 19:55:11.814635 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova OSError: write error Jul 20 19:55:11.814635 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova Jul 20 19:55:11.815274 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1601/2232] 10.222.0.69 () {58 vars in 1415 bytes} [Wed Jul 20 19:53:12 2022] DELETE /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a/os-volume_attachments/314fa7fd-d882-4be3-a319-c7a44c9d8bba => generated 0 bytes in 119766 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Jul 20 19:55:11.815274 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-81c22482-de35-4bca-8191-1bccbda451e7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:55:11.815274 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-81c22482-de35-4bca-8191-1bccbda451e7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:55:11.818613 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-81c22482-de35-4bca-8191-1bccbda451e7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:55:11.819060 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-81c22482-de35-4bca-8191-1bccbda451e7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:55:11.819852 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-81c22482-de35-4bca-8191-1bccbda451e7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:55:11.820281 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-81c22482-de35-4bca-8191-1bccbda451e7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:55:11.887462 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-81c22482-de35-4bca-8191-1bccbda451e7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:55:11.895743 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-81c22482-de35-4bca-8191-1bccbda451e7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1214 microversion: 2.1 time: 0.089074 Jul 20 19:55:11.896254 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Wed Jul 20 19:55:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 (ip 10.222.0.69) !!! Jul 20 19:55:11.896254 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Wed Jul 20 19:55:11 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 (10.222.0.69) Jul 20 19:55:11.896831 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: CRITICAL nova [None req-81c22482-de35-4bca-8191-1bccbda451e7 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Unhandled error: OSError: write error Jul 20 19:55:11.896831 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova OSError: write error Jul 20 19:55:11.896831 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova Jul 20 19:55:11.897092 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1602/2233] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:55:11 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 0 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jul 20 19:55:12.013786 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a7bd4f40-c6b0-442b-8884-11334537a836 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:55:12.014416 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a7bd4f40-c6b0-442b-8884-11334537a836 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 2b8da868-71d1-49ad-be95-25d0a41393e9] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:55:12.021613 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a7bd4f40-c6b0-442b-8884-11334537a836 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:55:12.022065 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a7bd4f40-c6b0-442b-8884-11334537a836 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:55:12.022821 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a7bd4f40-c6b0-442b-8884-11334537a836 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:55:12.023255 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a7bd4f40-c6b0-442b-8884-11334537a836 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:55:12.036339 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.wsgi [None req-a7bd4f40-c6b0-442b-8884-11334537a836 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] HTTP exception thrown: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. Jul 20 19:55:12.037887 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a7bd4f40-c6b0-442b-8884-11334537a836 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Request method failure captured: Jul 20 19:55:12.037887 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: DELETE /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9 HTTP/1.1 Jul 20 19:55:12.037887 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 19:55:12.037887 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 19:55:12.037887 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 19:55:12.037887 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 0 Jul 20 19:55:12.037887 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 19:55:12.037887 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 19:55:12.037887 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 19:55:12.037887 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 19:55:12.037887 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2FZGdJT3PjrXOalhxF4cK7yFRY_rdKs7nWDyfOnHDqihLmSc76hrlTVi8pwFl4fc0_PdYOdKi8ehCojNmpTfeHu0z7420hnbFU_7tQyUQZJWpu7NkYJxMVzpGVG2-8TAgdTN19E5_16lQGWKKWKpZnKtS08L9dJthhYfMLyISTLj6Mc Jul 20 19:55:12.037887 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 19:55:12.037887 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 19:55:12.037887 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 19:55:12.037887 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 19:55:12.037887 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 19:55:12.037887 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 19:55:12.037887 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: 8821facab6ed48588d9d484b5e3d98ba Jul 20 19:55:12.037887 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1121196344 Jul 20 19:55:12.037887 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 19:55:12.037887 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 19:55:12.039624 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8821facab6ed48588d9d484b5e3d98ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8821facab6ed48588d9d484b5e3d98ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8821facab6ed48588d9d484b5e3d98ba", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8821facab6ed48588d9d484b5e3d98ba"}]}] Jul 20 19:55:12.039624 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1121196344 Jul 20 19:55:12.039624 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: 8821facab6ed48588d9d484b5e3d98ba Jul 20 19:55:12.039624 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1121196344 Jul 20 19:55:12.039624 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-ServerRescueNegativeTestJSON-1121196344-project Jul 20 19:55:12.039624 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 19:55:12.039624 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 19:55:12.039624 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: 9192f2842ca044f08e5f95f98f2e1b88 Jul 20 19:55:12.039624 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1121196344-project Jul 20 19:55:12.039624 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: > Jul 20 19:55:12.039624 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. Jul 20 19:55:12.039624 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'id': '2b8da868-71d1-49ad-be95-25d0a41393e9'} Jul 20 19:55:12.040587 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:55:12.040587 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:55:12.040587 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:55:12.040587 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:55:12.040587 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:55:12.040587 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:55:12.040587 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:55:12.040587 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:55:12.040587 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:55:12.040587 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:55:12.040587 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. Jul 20 19:55:12.040587 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:55:12.040587 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:55:12.040587 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:55:12.040587 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:55:12.040587 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:55:12.040587 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:55:12.040587 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:55:12.040587 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:55:12.040587 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:55:12.042198 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:55:12.042198 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 19:55:12.042198 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 19:55:12.042198 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 19:55:12.042198 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 19:55:12.042198 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:55:12.042198 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:55:12.042198 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:55:12.042198 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:55:12.042198 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. Jul 20 19:55:12.042198 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:55:12.042198 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:55:12.042198 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:55:12.042198 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:55:12.042198 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:55:12.042198 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:55:12.042198 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:55:12.042198 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:55:12.042198 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. Jul 20 19:55:12.042198 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:55:12.043784 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a7bd4f40-c6b0-442b-8884-11334537a836 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Returning 404 to user: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:55:12.043784 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a7bd4f40-c6b0-442b-8884-11334537a836 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "DELETE /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9" status: 404 len: 111 microversion: 2.1 time: 0.141401 Jul 20 19:55:12.043784 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Wed Jul 20 19:55:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9 (ip 10.222.0.69) !!! Jul 20 19:55:12.043784 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Wed Jul 20 19:55:12 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9 (10.222.0.69) Jul 20 19:55:12.043784 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: CRITICAL nova [None req-a7bd4f40-c6b0-442b-8884-11334537a836 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Unhandled error: OSError: write error Jul 20 19:55:12.043784 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova OSError: write error Jul 20 19:55:12.043784 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova Jul 20 19:55:12.043784 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1603/2234] 10.222.0.69 () {58 vars in 1238 bytes} [Wed Jul 20 19:55:11 2022] DELETE /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9 => generated 0 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Jul 20 19:55:12.044676 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4014a9cd-19f3-4074-8bdc-67294c593526 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:55:12.045680 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-4014a9cd-19f3-4074-8bdc-67294c593526 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:55:12.051304 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4014a9cd-19f3-4074-8bdc-67294c593526 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:55:12.051747 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4014a9cd-19f3-4074-8bdc-67294c593526 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:55:12.052499 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4014a9cd-19f3-4074-8bdc-67294c593526 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:55:12.052930 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4014a9cd-19f3-4074-8bdc-67294c593526 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:55:12.082582 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-4014a9cd-19f3-4074-8bdc-67294c593526 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041259 Jul 20 19:55:12.083189 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1604/2235] 10.222.0.69 () {58 vars in 1301 bytes} [Wed Jul 20 19:55:12 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:55:12.087922 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-0ed9ff57-418b-4250-a2e8-64884e030445 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:55:12.088808 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-0ed9ff57-418b-4250-a2e8-64884e030445 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:55:12.094360 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0ed9ff57-418b-4250-a2e8-64884e030445 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:55:12.094809 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0ed9ff57-418b-4250-a2e8-64884e030445 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:55:12.095819 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0ed9ff57-418b-4250-a2e8-64884e030445 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:55:12.096254 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0ed9ff57-418b-4250-a2e8-64884e030445 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:55:12.124749 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-0ed9ff57-418b-4250-a2e8-64884e030445 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040380 Jul 20 19:55:12.125288 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1605/2236] 10.222.0.69 () {60 vars in 1342 bytes} [Wed Jul 20 19:55:12 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 19:55:12.129834 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-79091475-59a6-4681-b825-e01af5d20558 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:55:12.130320 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-79091475-59a6-4681-b825-e01af5d20558 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] [instance: 43fe56ab-bf09-4ec0-84d5-306f16cb9d5a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:55:12.135686 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-79091475-59a6-4681-b825-e01af5d20558 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:55:12.136132 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-79091475-59a6-4681-b825-e01af5d20558 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:55:12.136888 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-79091475-59a6-4681-b825-e01af5d20558 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:55:12.137321 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-79091475-59a6-4681-b825-e01af5d20558 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:55:22.133932 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_api:SELECT=10 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:55:22.156654 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=24 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:55:25.109160 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 19:55:25.109800 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Wed Jul 20 19:55:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a/os-volume_attachments/314fa7fd-d882-4be3-a319-c7a44c9d8bba (ip 10.222.0.69) !!! Jul 20 19:55:27.204887 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 19:55:27.205605 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Wed Jul 20 19:55:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a/os-volume_attachments/314fa7fd-d882-4be3-a319-c7a44c9d8bba (ip 10.222.0.69) !!! Jul 20 19:56:59.948540 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.objects.instance [None req-79091475-59a6-4681-b825-e01af5d20558 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lazy-loading 'services' on Instance uuid 43fe56ab-bf09-4ec0-84d5-306f16cb9d5a {{(pid=117761) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:57:09.955043 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=4 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:57:11.864774 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.wsgi [None req-79091475-59a6-4681-b825-e01af5d20558 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6973183a-fbc8-47ee-9350-5b1dbadcb85f) Jul 20 19:57:11.867675 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-79091475-59a6-4681-b825-e01af5d20558 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Request method failure captured: Jul 20 19:57:11.867675 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: DELETE /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a/os-volume_attachments/314fa7fd-d882-4be3-a319-c7a44c9d8bba HTTP/1.1 Jul 20 19:57:11.867675 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 19:57:11.867675 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 19:57:11.867675 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 19:57:11.867675 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 0 Jul 20 19:57:11.867675 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 19:57:11.867675 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 19:57:11.867675 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 19:57:11.867675 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 19:57:11.867675 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2FbvraeCBRrPE4O7lrRb8qOLZk5VEOCVBOl4zMC1gg8XMd7uuHid9RioGTRX_JruGVyWJZ88XS9h66QDLJKZqWWE0MjOusG0phS1nTYkPwx2OHkqAGkCtP2OLBH1bnn2QsTgDuvA_AZ-0_Frr--F8Gf2qGtpGL5jfce4gMVrg4Ozv-Y Jul 20 19:57:11.867675 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 19:57:11.867675 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 19:57:11.867675 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 19:57:11.867675 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 19:57:11.867675 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 19:57:11.867675 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 19:57:11.867675 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: e0bb4af78c1d4589b1d3cc90d5e6be63 Jul 20 19:57:11.867675 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1199788649 Jul 20 19:57:11.867675 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 19:57:11.867675 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 19:57:11.869413 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e0bb4af78c1d4589b1d3cc90d5e6be63"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e0bb4af78c1d4589b1d3cc90d5e6be63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_e0bb4af78c1d4589b1d3cc90d5e6be63", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/e0bb4af78c1d4589b1d3cc90d5e6be63"}]}] Jul 20 19:57:11.869413 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-VolumesSnapshotTestJSON-1199788649 Jul 20 19:57:11.869413 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: e0bb4af78c1d4589b1d3cc90d5e6be63 Jul 20 19:57:11.869413 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1199788649 Jul 20 19:57:11.869413 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-VolumesSnapshotTestJSON-1199788649-project Jul 20 19:57:11.869413 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 19:57:11.869413 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 19:57:11.869413 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: 78ae826a812b44328c48b82e9498ad8b Jul 20 19:57:11.869413 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-VolumesSnapshotTestJSON-1199788649-project Jul 20 19:57:11.869413 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: > Jul 20 19:57:11.870474 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6973183a-fbc8-47ee-9350-5b1dbadcb85f) Jul 20 19:57:11.870474 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'server_id': '43fe56ab-bf09-4ec0-84d5-306f16cb9d5a', 'id': '314fa7fd-d882-4be3-a319-c7a44c9d8bba'} Jul 20 19:57:11.870474 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:57:11.870474 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:57:11.870474 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 19:57:11.870474 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 19:57:11.870474 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 19:57:11.870474 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 19:57:11.870474 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 20 19:57:11.870474 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 20 19:57:11.870474 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 20 19:57:11.870474 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 20 19:57:11.870474 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 20 19:57:11.870474 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 20 19:57:11.870474 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 20 19:57:11.870474 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 20 19:57:11.870474 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 19:57:11.871696 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 19:57:11.871696 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 19:57:11.871696 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 19:57:11.871696 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6973183a-fbc8-47ee-9350-5b1dbadcb85f) Jul 20 19:57:11.871696 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:57:11.871696 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:57:11.871696 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:57:11.871696 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:57:11.871696 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 20 19:57:11.871696 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 20 19:57:11.871696 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 20 19:57:11.871696 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 20 19:57:11.871696 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 19:57:11.871696 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 19:57:11.871696 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 19:57:11.871696 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 19:57:11.871696 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 19:57:11.871696 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 19:57:11.871696 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 20 19:57:11.872966 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 20 19:57:11.872966 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 20 19:57:11.872966 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 20 19:57:11.872966 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 20 19:57:11.872966 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 20 19:57:11.872966 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 20 19:57:11.872966 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 20 19:57:11.872966 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 19:57:11.872966 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 19:57:11.872966 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 19:57:11.872966 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 19:57:11.872966 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6973183a-fbc8-47ee-9350-5b1dbadcb85f) Jul 20 19:57:11.872966 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:57:11.872966 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:57:11.872966 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:57:11.872966 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:57:11.872966 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 20 19:57:11.874408 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 20 19:57:11.874408 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 19:57:11.874408 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 19:57:11.874408 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 20 19:57:11.874408 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 19:57:11.874408 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 20 19:57:11.874408 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 20 19:57:11.874408 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 20 19:57:11.874408 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 19:57:11.874408 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 20 19:57:11.874408 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 20 19:57:11.874408 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6973183a-fbc8-47ee-9350-5b1dbadcb85f) Jul 20 19:57:11.874408 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:57:11.874408 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:57:11.874408 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:57:11.874408 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:57:11.874408 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:57:11.874408 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:57:11.875571 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:57:11.875571 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:57:11.875571 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:57:11.875571 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:57:11.875571 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 20 19:57:11.875571 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 20 19:57:11.875571 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6973183a-fbc8-47ee-9350-5b1dbadcb85f) Jul 20 19:57:11.875571 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:57:11.875571 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:57:11.875571 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:57:11.875571 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:57:11.875571 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:57:11.875571 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:57:11.875571 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:57:11.875571 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:57:11.875571 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6973183a-fbc8-47ee-9350-5b1dbadcb85f) Jul 20 19:57:11.875571 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:57:11.876681 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-79091475-59a6-4681-b825-e01af5d20558 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6973183a-fbc8-47ee-9350-5b1dbadcb85f) {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:57:11.876681 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-79091475-59a6-4681-b825-e01af5d20558 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] 10.222.0.69 "DELETE /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a/os-volume_attachments/314fa7fd-d882-4be3-a319-c7a44c9d8bba" status: 400 len: 269 microversion: 2.1 time: 119.742747 Jul 20 19:57:11.876681 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Wed Jul 20 19:57:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a/os-volume_attachments/314fa7fd-d882-4be3-a319-c7a44c9d8bba (ip 10.222.0.69) !!! Jul 20 19:57:11.876681 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Wed Jul 20 19:57:11 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a/os-volume_attachments/314fa7fd-d882-4be3-a319-c7a44c9d8bba (10.222.0.69) Jul 20 19:57:11.876681 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: CRITICAL nova [None req-79091475-59a6-4681-b825-e01af5d20558 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Unhandled error: OSError: write error Jul 20 19:57:11.876681 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova OSError: write error Jul 20 19:57:11.876681 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova Jul 20 19:57:11.877211 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1606/2237] 10.222.0.69 () {58 vars in 1415 bytes} [Wed Jul 20 19:55:12 2022] DELETE /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a/os-volume_attachments/314fa7fd-d882-4be3-a319-c7a44c9d8bba => generated 0 bytes in 119744 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Jul 20 19:57:11.877666 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d91c00e8-6263-4496-abfc-1aacdfbbca9c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:57:11.878278 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d91c00e8-6263-4496-abfc-1aacdfbbca9c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:57:11.886090 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d91c00e8-6263-4496-abfc-1aacdfbbca9c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:57:11.886604 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d91c00e8-6263-4496-abfc-1aacdfbbca9c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:57:11.887376 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d91c00e8-6263-4496-abfc-1aacdfbbca9c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:57:11.887820 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d91c00e8-6263-4496-abfc-1aacdfbbca9c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:57:11.955757 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d91c00e8-6263-4496-abfc-1aacdfbbca9c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:57:11.963457 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d91c00e8-6263-4496-abfc-1aacdfbbca9c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1214 microversion: 2.1 time: 0.092054 Jul 20 19:57:11.963978 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Wed Jul 20 19:57:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 (ip 10.222.0.69) !!! Jul 20 19:57:11.963978 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Wed Jul 20 19:57:11 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 (10.222.0.69) Jul 20 19:57:11.964555 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: CRITICAL nova [None req-d91c00e8-6263-4496-abfc-1aacdfbbca9c tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Unhandled error: OSError: write error Jul 20 19:57:11.964555 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova OSError: write error Jul 20 19:57:11.964555 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova Jul 20 19:57:11.964878 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1607/2238] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:57:11 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 0 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jul 20 19:57:11.969008 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-7a5a6aff-969f-406f-9674-8f6b3bfe53aa tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:57:11.969774 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-7a5a6aff-969f-406f-9674-8f6b3bfe53aa tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 2b8da868-71d1-49ad-be95-25d0a41393e9] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:57:11.976008 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7a5a6aff-969f-406f-9674-8f6b3bfe53aa tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:57:11.976452 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7a5a6aff-969f-406f-9674-8f6b3bfe53aa tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:57:11.977244 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7a5a6aff-969f-406f-9674-8f6b3bfe53aa tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:57:11.977706 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7a5a6aff-969f-406f-9674-8f6b3bfe53aa tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:57:11.991360 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.wsgi [None req-7a5a6aff-969f-406f-9674-8f6b3bfe53aa tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] HTTP exception thrown: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. Jul 20 19:57:11.992898 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-7a5a6aff-969f-406f-9674-8f6b3bfe53aa tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Request method failure captured: Jul 20 19:57:11.992898 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: DELETE /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9 HTTP/1.1 Jul 20 19:57:11.992898 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 19:57:11.992898 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 19:57:11.992898 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 19:57:11.992898 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 0 Jul 20 19:57:11.992898 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 19:57:11.992898 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 19:57:11.992898 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 19:57:11.992898 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 19:57:11.992898 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2FZGdJT3PjrXOalhxF4cK7yFRY_rdKs7nWDyfOnHDqihLmSc76hrlTVi8pwFl4fc0_PdYOdKi8ehCojNmpTfeHu0z7420hnbFU_7tQyUQZJWpu7NkYJxMVzpGVG2-8TAgdTN19E5_16lQGWKKWKpZnKtS08L9dJthhYfMLyISTLj6Mc Jul 20 19:57:11.992898 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 19:57:11.992898 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 19:57:11.992898 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 19:57:11.992898 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 19:57:11.992898 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 19:57:11.992898 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 19:57:11.992898 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: 8821facab6ed48588d9d484b5e3d98ba Jul 20 19:57:11.992898 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1121196344 Jul 20 19:57:11.992898 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 19:57:11.992898 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 19:57:11.994605 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8821facab6ed48588d9d484b5e3d98ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8821facab6ed48588d9d484b5e3d98ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8821facab6ed48588d9d484b5e3d98ba", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8821facab6ed48588d9d484b5e3d98ba"}]}] Jul 20 19:57:11.994605 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1121196344 Jul 20 19:57:11.994605 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: 8821facab6ed48588d9d484b5e3d98ba Jul 20 19:57:11.994605 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1121196344 Jul 20 19:57:11.994605 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-ServerRescueNegativeTestJSON-1121196344-project Jul 20 19:57:11.994605 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 19:57:11.994605 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 19:57:11.994605 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: 9192f2842ca044f08e5f95f98f2e1b88 Jul 20 19:57:11.994605 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1121196344-project Jul 20 19:57:11.994605 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: > Jul 20 19:57:11.994605 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. Jul 20 19:57:11.994605 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'id': '2b8da868-71d1-49ad-be95-25d0a41393e9'} Jul 20 19:57:11.995585 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:57:11.995585 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:57:11.995585 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:57:11.995585 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:57:11.995585 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:57:11.995585 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:57:11.995585 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:57:11.995585 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:57:11.995585 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:57:11.995585 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:57:11.995585 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. Jul 20 19:57:11.995585 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:57:11.995585 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:57:11.995585 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:57:11.995585 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:57:11.995585 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:57:11.995585 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:57:11.995585 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:57:11.995585 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:57:11.995585 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:57:11.997157 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:57:11.997157 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 19:57:11.997157 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 19:57:11.997157 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 19:57:11.997157 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 19:57:11.997157 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:57:11.997157 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:57:11.997157 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:57:11.997157 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:57:11.997157 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. Jul 20 19:57:11.997157 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:57:11.997157 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:57:11.997157 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:57:11.997157 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:57:11.997157 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:57:11.997157 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:57:11.997157 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:57:11.997157 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:57:11.997157 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. Jul 20 19:57:11.997157 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:57:11.998768 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-7a5a6aff-969f-406f-9674-8f6b3bfe53aa tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Returning 404 to user: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:57:11.998768 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-7a5a6aff-969f-406f-9674-8f6b3bfe53aa tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "DELETE /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9" status: 404 len: 111 microversion: 2.1 time: 0.028752 Jul 20 19:57:11.998768 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Wed Jul 20 19:57:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9 (ip 10.222.0.69) !!! Jul 20 19:57:11.998768 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Wed Jul 20 19:57:11 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9 (10.222.0.69) Jul 20 19:57:11.998768 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: CRITICAL nova [None req-7a5a6aff-969f-406f-9674-8f6b3bfe53aa tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Unhandled error: OSError: write error Jul 20 19:57:11.998768 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova OSError: write error Jul 20 19:57:11.998768 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova Jul 20 19:57:11.998768 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1608/2239] 10.222.0.69 () {58 vars in 1238 bytes} [Wed Jul 20 19:57:11 2022] DELETE /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9 => generated 0 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Jul 20 19:57:12.076316 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [req-ed7260a5-3c97-4a0d-a477-9e0247e10e8b req-78cbea94-9d6b-4c09-803c-833cee2fdac0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b8da868-71d1-49ad-be95-25d0a41393e9", "name": "network-vif-deleted", "tag": "e1440571-e796-4c28-8091-6adb4bfa88b0"}]} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:57:12.085385 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-ed7260a5-3c97-4a0d-a477-9e0247e10e8b req-78cbea94-9d6b-4c09-803c-833cee2fdac0 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:57:12.085385 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-ed7260a5-3c97-4a0d-a477-9e0247e10e8b req-78cbea94-9d6b-4c09-803c-833cee2fdac0 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:57:12.097285 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.compute.server_external_events [req-ed7260a5-3c97-4a0d-a477-9e0247e10e8b req-78cbea94-9d6b-4c09-803c-833cee2fdac0 service nova] Creating event network-vif-deleted:e1440571-e796-4c28-8091-6adb4bfa88b0 for instance 2b8da868-71d1-49ad-be95-25d0a41393e9 on hv-cinder-83538 Jul 20 19:57:12.101681 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR oslo.messaging._drivers.impl_rabbit [req-ed7260a5-3c97-4a0d-a477-9e0247e10e8b req-78cbea94-9d6b-4c09-803c-833cee2fdac0 service nova] [5eabb59e-c424-4ee1-a3ee-3043cb1dbd04] AMQP server on 10.222.0.69:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 20 19:57:13.110061 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO oslo.messaging._drivers.impl_rabbit [req-ed7260a5-3c97-4a0d-a477-9e0247e10e8b req-78cbea94-9d6b-4c09-803c-833cee2fdac0 service nova] [5eabb59e-c424-4ee1-a3ee-3043cb1dbd04] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 44172. Jul 20 19:57:13.113838 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [req-ed7260a5-3c97-4a0d-a477-9e0247e10e8b req-78cbea94-9d6b-4c09-803c-833cee2fdac0 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.117479 Jul 20 19:57:13.114376 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Wed Jul 20 19:57:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.69) !!! Jul 20 19:57:13.114376 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Wed Jul 20 19:57:13 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during POST /compute/v2.1/os-server-external-events (10.222.0.69) Jul 20 19:57:13.115078 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: CRITICAL nova [req-ed7260a5-3c97-4a0d-a477-9e0247e10e8b req-78cbea94-9d6b-4c09-803c-833cee2fdac0 service nova] Unhandled error: OSError: write error Jul 20 19:57:13.115078 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova OSError: write error Jul 20 19:57:13.115078 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova Jul 20 19:57:13.115508 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1609/2240] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 19:57:11 2022] POST /compute/v2.1/os-server-external-events => generated 0 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jul 20 19:57:13.120860 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d7d8c011-2059-4b48-8daf-a03d8aeb6359 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:57:13.121946 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d7d8c011-2059-4b48-8daf-a03d8aeb6359 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:57:13.128210 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d7d8c011-2059-4b48-8daf-a03d8aeb6359 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:57:13.128659 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d7d8c011-2059-4b48-8daf-a03d8aeb6359 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:57:13.129420 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d7d8c011-2059-4b48-8daf-a03d8aeb6359 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:57:13.129886 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d7d8c011-2059-4b48-8daf-a03d8aeb6359 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:57:13.160020 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d7d8c011-2059-4b48-8daf-a03d8aeb6359 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043635 Jul 20 19:57:13.160531 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Wed Jul 20 19:57:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a/os-volume_attachments (ip 10.222.0.69) !!! Jul 20 19:57:13.160531 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Wed Jul 20 19:57:13 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a/os-volume_attachments (10.222.0.69) Jul 20 19:57:13.161108 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: CRITICAL nova [None req-d7d8c011-2059-4b48-8daf-a03d8aeb6359 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Unhandled error: OSError: write error Jul 20 19:57:13.161108 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova OSError: write error Jul 20 19:57:13.161108 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova Jul 20 19:57:13.161398 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1610/2241] 10.222.0.69 () {58 vars in 1301 bytes} [Wed Jul 20 19:57:13 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a/os-volume_attachments => generated 0 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jul 20 19:57:13.232872 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-9ce44d01-a7a3-46b1-95f3-887f192b35d2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:57:13.233826 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-9ce44d01-a7a3-46b1-95f3-887f192b35d2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:57:13.239758 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9ce44d01-a7a3-46b1-95f3-887f192b35d2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:57:13.240204 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9ce44d01-a7a3-46b1-95f3-887f192b35d2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:57:13.241833 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9ce44d01-a7a3-46b1-95f3-887f192b35d2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:57:13.242593 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9ce44d01-a7a3-46b1-95f3-887f192b35d2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:57:13.271692 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-9ce44d01-a7a3-46b1-95f3-887f192b35d2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.109417 Jul 20 19:57:13.274293 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Wed Jul 20 19:57:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55/os-volume_attachments (ip 10.222.0.69) !!! Jul 20 19:57:13.274293 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Wed Jul 20 19:57:13 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55/os-volume_attachments (10.222.0.69) Jul 20 19:57:13.274293 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: CRITICAL nova [None req-9ce44d01-a7a3-46b1-95f3-887f192b35d2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Unhandled error: OSError: write error Jul 20 19:57:13.274293 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova OSError: write error Jul 20 19:57:13.274293 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova Jul 20 19:57:13.274293 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1611/2242] 10.222.0.69 () {60 vars in 1342 bytes} [Wed Jul 20 19:57:13 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55/os-volume_attachments => generated 0 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jul 20 19:57:13.277778 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-3d31f83e-607a-472f-a82f-a0b2337df903 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:57:13.278257 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-3d31f83e-607a-472f-a82f-a0b2337df903 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] [instance: 43fe56ab-bf09-4ec0-84d5-306f16cb9d5a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:57:13.284271 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3d31f83e-607a-472f-a82f-a0b2337df903 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:57:13.284712 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3d31f83e-607a-472f-a82f-a0b2337df903 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:57:13.285457 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3d31f83e-607a-472f-a82f-a0b2337df903 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:57:13.286209 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3d31f83e-607a-472f-a82f-a0b2337df903 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:57:23.282486 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_api:SELECT=12 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:57:23.305370 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=26 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:58:45.117823 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 19:58:45.118559 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Wed Jul 20 19:58:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a/os-volume_attachments/314fa7fd-d882-4be3-a319-c7a44c9d8bba (ip 10.222.0.69) !!! Jul 20 19:58:47.213295 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 19:58:47.213975 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Wed Jul 20 19:58:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a/os-volume_attachments/314fa7fd-d882-4be3-a319-c7a44c9d8bba (ip 10.222.0.69) !!! Jul 20 19:59:00.100047 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.objects.instance [None req-3d31f83e-607a-472f-a82f-a0b2337df903 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lazy-loading 'services' on Instance uuid 43fe56ab-bf09-4ec0-84d5-306f16cb9d5a {{(pid=117761) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:59:00.254324 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.wsgi [None req-3d31f83e-607a-472f-a82f-a0b2337df903 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b9a47199-cf1d-4864-bb22-2c4aa6f3bbe9) Jul 20 19:59:00.257094 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-3d31f83e-607a-472f-a82f-a0b2337df903 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Request method failure captured: Jul 20 19:59:00.257094 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: DELETE /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a/os-volume_attachments/314fa7fd-d882-4be3-a319-c7a44c9d8bba HTTP/1.1 Jul 20 19:59:00.257094 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 19:59:00.257094 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 19:59:00.257094 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 19:59:00.257094 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 0 Jul 20 19:59:00.257094 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 19:59:00.257094 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 19:59:00.257094 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 19:59:00.257094 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 19:59:00.257094 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2FbvraeCBRrPE4O7lrRb8qOLZk5VEOCVBOl4zMC1gg8XMd7uuHid9RioGTRX_JruGVyWJZ88XS9h66QDLJKZqWWE0MjOusG0phS1nTYkPwx2OHkqAGkCtP2OLBH1bnn2QsTgDuvA_AZ-0_Frr--F8Gf2qGtpGL5jfce4gMVrg4Ozv-Y Jul 20 19:59:00.257094 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 19:59:00.257094 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 19:59:00.257094 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 19:59:00.257094 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 19:59:00.257094 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 19:59:00.257094 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 19:59:00.257094 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: e0bb4af78c1d4589b1d3cc90d5e6be63 Jul 20 19:59:00.257094 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1199788649 Jul 20 19:59:00.257094 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 19:59:00.257094 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 19:59:00.258818 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e0bb4af78c1d4589b1d3cc90d5e6be63"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e0bb4af78c1d4589b1d3cc90d5e6be63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_e0bb4af78c1d4589b1d3cc90d5e6be63", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/e0bb4af78c1d4589b1d3cc90d5e6be63"}]}] Jul 20 19:59:00.258818 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-VolumesSnapshotTestJSON-1199788649 Jul 20 19:59:00.258818 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: e0bb4af78c1d4589b1d3cc90d5e6be63 Jul 20 19:59:00.258818 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1199788649 Jul 20 19:59:00.258818 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-VolumesSnapshotTestJSON-1199788649-project Jul 20 19:59:00.258818 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 19:59:00.258818 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 19:59:00.258818 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: 78ae826a812b44328c48b82e9498ad8b Jul 20 19:59:00.258818 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-VolumesSnapshotTestJSON-1199788649-project Jul 20 19:59:00.258818 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: > Jul 20 19:59:00.259621 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b9a47199-cf1d-4864-bb22-2c4aa6f3bbe9) Jul 20 19:59:00.259621 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'server_id': '43fe56ab-bf09-4ec0-84d5-306f16cb9d5a', 'id': '314fa7fd-d882-4be3-a319-c7a44c9d8bba'} Jul 20 19:59:00.259621 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:59:00.259621 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:59:00.259621 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 19:59:00.259621 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 19:59:00.259621 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 19:59:00.259621 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 19:59:00.259621 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 20 19:59:00.259621 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 20 19:59:00.259621 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 20 19:59:00.259621 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 20 19:59:00.259621 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 20 19:59:00.259621 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 20 19:59:00.259621 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 20 19:59:00.259621 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 20 19:59:00.259621 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 19:59:00.261019 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 19:59:00.261019 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 19:59:00.261019 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 19:59:00.261019 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b9a47199-cf1d-4864-bb22-2c4aa6f3bbe9) Jul 20 19:59:00.261019 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:00.261019 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:59:00.261019 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:00.261019 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:59:00.261019 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 20 19:59:00.261019 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 20 19:59:00.261019 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 20 19:59:00.261019 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 20 19:59:00.261019 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 19:59:00.261019 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 19:59:00.261019 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 19:59:00.261019 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 19:59:00.261019 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 19:59:00.261019 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 19:59:00.261019 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 20 19:59:00.262819 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 20 19:59:00.262819 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 20 19:59:00.262819 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 20 19:59:00.262819 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 20 19:59:00.262819 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 20 19:59:00.262819 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 20 19:59:00.262819 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 20 19:59:00.262819 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 19:59:00.262819 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 19:59:00.262819 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 19:59:00.262819 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 19:59:00.262819 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b9a47199-cf1d-4864-bb22-2c4aa6f3bbe9) Jul 20 19:59:00.262819 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:00.262819 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:59:00.262819 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:00.262819 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:59:00.262819 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 20 19:59:00.264135 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 20 19:59:00.264135 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 19:59:00.264135 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 19:59:00.264135 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 20 19:59:00.264135 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 19:59:00.264135 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 20 19:59:00.264135 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 20 19:59:00.264135 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 20 19:59:00.264135 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 19:59:00.264135 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 20 19:59:00.264135 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 20 19:59:00.264135 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b9a47199-cf1d-4864-bb22-2c4aa6f3bbe9) Jul 20 19:59:00.264135 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:00.264135 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:59:00.264135 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:00.264135 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:59:00.264135 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:59:00.264135 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:59:00.265556 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:59:00.265556 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:59:00.265556 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:59:00.265556 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:59:00.265556 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 20 19:59:00.265556 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 20 19:59:00.265556 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b9a47199-cf1d-4864-bb22-2c4aa6f3bbe9) Jul 20 19:59:00.265556 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:00.265556 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:59:00.265556 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:00.265556 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:59:00.265556 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:59:00.265556 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:59:00.265556 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:59:00.265556 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:59:00.265556 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b9a47199-cf1d-4864-bb22-2c4aa6f3bbe9) Jul 20 19:59:00.265556 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:00.266914 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-3d31f83e-607a-472f-a82f-a0b2337df903 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b9a47199-cf1d-4864-bb22-2c4aa6f3bbe9) {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:59:00.266914 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-3d31f83e-607a-472f-a82f-a0b2337df903 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] 10.222.0.69 "DELETE /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a/os-volume_attachments/314fa7fd-d882-4be3-a319-c7a44c9d8bba" status: 400 len: 269 microversion: 2.1 time: 106.984858 Jul 20 19:59:00.266914 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Wed Jul 20 19:59:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a/os-volume_attachments/314fa7fd-d882-4be3-a319-c7a44c9d8bba (ip 10.222.0.69) !!! Jul 20 19:59:00.266914 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Wed Jul 20 19:59:00 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a/os-volume_attachments/314fa7fd-d882-4be3-a319-c7a44c9d8bba (10.222.0.69) Jul 20 19:59:00.266914 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: CRITICAL nova [None req-3d31f83e-607a-472f-a82f-a0b2337df903 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Unhandled error: OSError: write error Jul 20 19:59:00.266914 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova OSError: write error Jul 20 19:59:00.266914 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova Jul 20 19:59:00.267548 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1612/2243] 10.222.0.69 () {58 vars in 1415 bytes} [Wed Jul 20 19:57:13 2022] DELETE /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a/os-volume_attachments/314fa7fd-d882-4be3-a319-c7a44c9d8bba => generated 0 bytes in 106986 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Jul 20 19:59:00.267548 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-7895b10d-d4c0-47db-9706-be0c19b6922a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:59:00.267548 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-7895b10d-d4c0-47db-9706-be0c19b6922a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:59:00.273106 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7895b10d-d4c0-47db-9706-be0c19b6922a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:59:00.273533 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7895b10d-d4c0-47db-9706-be0c19b6922a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:59:00.274533 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7895b10d-d4c0-47db-9706-be0c19b6922a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:59:00.274963 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7895b10d-d4c0-47db-9706-be0c19b6922a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:59:00.309996 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7895b10d-d4c0-47db-9706-be0c19b6922a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:59:00.310437 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7895b10d-d4c0-47db-9706-be0c19b6922a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:59:00.310883 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.objects.instance [None req-7895b10d-d4c0-47db-9706-be0c19b6922a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lazy-loading 'fault' on Instance uuid 239cb0b6-54d7-4cc2-945a-1f026a015992 {{(pid=117761) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:59:00.355569 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-7895b10d-d4c0-47db-9706-be0c19b6922a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7204f863c64eeeb7dab59a30c447b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da296fe635c84b99b1645ceaf0138b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:59:00.363005 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-7895b10d-d4c0-47db-9706-be0c19b6922a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 200 len: 1314 microversion: 2.1 time: 0.101995 Jul 20 19:59:00.363510 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Wed Jul 20 19:59:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 (ip 10.222.0.69) !!! Jul 20 19:59:00.363510 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Wed Jul 20 19:59:00 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 (10.222.0.69) Jul 20 19:59:00.364083 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: CRITICAL nova [None req-7895b10d-d4c0-47db-9706-be0c19b6922a tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Unhandled error: OSError: write error Jul 20 19:59:00.364083 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova OSError: write error Jul 20 19:59:00.364083 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova Jul 20 19:59:00.364361 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1613/2244] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:59:00 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 0 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jul 20 19:59:00.368713 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-5f4ca929-bfdf-4301-a503-44edb5f8f722 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:59:00.369202 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-5f4ca929-bfdf-4301-a503-44edb5f8f722 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 2b8da868-71d1-49ad-be95-25d0a41393e9] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:59:00.374779 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5f4ca929-bfdf-4301-a503-44edb5f8f722 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:59:00.375231 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5f4ca929-bfdf-4301-a503-44edb5f8f722 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:59:00.375989 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5f4ca929-bfdf-4301-a503-44edb5f8f722 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:59:00.376427 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5f4ca929-bfdf-4301-a503-44edb5f8f722 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:59:00.389494 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.wsgi [None req-5f4ca929-bfdf-4301-a503-44edb5f8f722 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] HTTP exception thrown: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. Jul 20 19:59:00.391052 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-5f4ca929-bfdf-4301-a503-44edb5f8f722 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Request method failure captured: Jul 20 19:59:00.391052 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: DELETE /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9 HTTP/1.1 Jul 20 19:59:00.391052 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 19:59:00.391052 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 19:59:00.391052 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 19:59:00.391052 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 0 Jul 20 19:59:00.391052 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 19:59:00.391052 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 19:59:00.391052 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 19:59:00.391052 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 19:59:00.391052 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2FZGdJT3PjrXOalhxF4cK7yFRY_rdKs7nWDyfOnHDqihLmSc76hrlTVi8pwFl4fc0_PdYOdKi8ehCojNmpTfeHu0z7420hnbFU_7tQyUQZJWpu7NkYJxMVzpGVG2-8TAgdTN19E5_16lQGWKKWKpZnKtS08L9dJthhYfMLyISTLj6Mc Jul 20 19:59:00.391052 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 19:59:00.391052 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 19:59:00.391052 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 19:59:00.391052 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 19:59:00.391052 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 19:59:00.391052 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 19:59:00.391052 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: 8821facab6ed48588d9d484b5e3d98ba Jul 20 19:59:00.391052 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1121196344 Jul 20 19:59:00.391052 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 19:59:00.391052 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 19:59:00.392678 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8821facab6ed48588d9d484b5e3d98ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8821facab6ed48588d9d484b5e3d98ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8821facab6ed48588d9d484b5e3d98ba", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8821facab6ed48588d9d484b5e3d98ba"}]}] Jul 20 19:59:00.392678 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1121196344 Jul 20 19:59:00.392678 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: 8821facab6ed48588d9d484b5e3d98ba Jul 20 19:59:00.392678 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1121196344 Jul 20 19:59:00.392678 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-ServerRescueNegativeTestJSON-1121196344-project Jul 20 19:59:00.392678 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 19:59:00.392678 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 19:59:00.392678 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: 9192f2842ca044f08e5f95f98f2e1b88 Jul 20 19:59:00.392678 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1121196344-project Jul 20 19:59:00.392678 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: > Jul 20 19:59:00.392678 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. Jul 20 19:59:00.392678 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'id': '2b8da868-71d1-49ad-be95-25d0a41393e9'} Jul 20 19:59:00.393712 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:59:00.393712 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:59:00.393712 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:59:00.393712 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:59:00.393712 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:59:00.393712 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:59:00.393712 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:59:00.393712 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:59:00.393712 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:59:00.393712 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:59:00.393712 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. Jul 20 19:59:00.393712 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:00.393712 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:59:00.393712 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:00.393712 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:59:00.393712 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:59:00.393712 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:59:00.393712 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:59:00.393712 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:59:00.393712 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:59:00.395283 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:59:00.395283 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 19:59:00.395283 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 19:59:00.395283 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 19:59:00.395283 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 19:59:00.395283 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:59:00.395283 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:59:00.395283 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:59:00.395283 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:59:00.395283 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. Jul 20 19:59:00.395283 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:00.395283 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:59:00.395283 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:00.395283 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:59:00.395283 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:59:00.395283 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:59:00.395283 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:59:00.395283 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:59:00.395283 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. Jul 20 19:59:00.395283 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:00.397498 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-5f4ca929-bfdf-4301-a503-44edb5f8f722 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Returning 404 to user: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:59:00.397498 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-5f4ca929-bfdf-4301-a503-44edb5f8f722 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "DELETE /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9" status: 404 len: 111 microversion: 2.1 time: 0.027202 Jul 20 19:59:00.397498 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Wed Jul 20 19:59:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9 (ip 10.222.0.69) !!! Jul 20 19:59:00.397498 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Wed Jul 20 19:59:00 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9 (10.222.0.69) Jul 20 19:59:00.397498 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: CRITICAL nova [None req-5f4ca929-bfdf-4301-a503-44edb5f8f722 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Unhandled error: OSError: write error Jul 20 19:59:00.397498 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova OSError: write error Jul 20 19:59:00.397498 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova Jul 20 19:59:00.397498 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1614/2245] 10.222.0.69 () {58 vars in 1238 bytes} [Wed Jul 20 19:59:00 2022] DELETE /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9 => generated 0 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Jul 20 19:59:00.461206 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-3181f969-be51-4923-adf5-f6cf8ab680ad tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:59:00.462219 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-3181f969-be51-4923-adf5-f6cf8ab680ad tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:59:00.468178 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3181f969-be51-4923-adf5-f6cf8ab680ad tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:59:00.468880 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3181f969-be51-4923-adf5-f6cf8ab680ad tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:59:00.469695 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3181f969-be51-4923-adf5-f6cf8ab680ad tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:59:00.470131 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3181f969-be51-4923-adf5-f6cf8ab680ad tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:59:00.499527 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-3181f969-be51-4923-adf5-f6cf8ab680ad tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105059 Jul 20 19:59:00.500016 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Wed Jul 20 19:59:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a/os-volume_attachments (ip 10.222.0.69) !!! Jul 20 19:59:00.500016 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Wed Jul 20 19:59:00 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a/os-volume_attachments (10.222.0.69) Jul 20 19:59:00.500593 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: CRITICAL nova [None req-3181f969-be51-4923-adf5-f6cf8ab680ad tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Unhandled error: OSError: write error Jul 20 19:59:00.500593 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova OSError: write error Jul 20 19:59:00.500593 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova Jul 20 19:59:00.500854 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1615/2246] 10.222.0.69 () {58 vars in 1301 bytes} [Wed Jul 20 19:59:00 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a/os-volume_attachments => generated 0 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jul 20 19:59:00.505637 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d8cfbfb5-1714-47da-a80e-6a03c4da083a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:59:00.506520 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d8cfbfb5-1714-47da-a80e-6a03c4da083a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:59:00.512041 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d8cfbfb5-1714-47da-a80e-6a03c4da083a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:59:00.512425 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d8cfbfb5-1714-47da-a80e-6a03c4da083a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:59:00.513172 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d8cfbfb5-1714-47da-a80e-6a03c4da083a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:59:00.513636 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d8cfbfb5-1714-47da-a80e-6a03c4da083a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:59:00.543087 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d8cfbfb5-1714-47da-a80e-6a03c4da083a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041363 Jul 20 19:59:00.543619 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Wed Jul 20 19:59:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55/os-volume_attachments (ip 10.222.0.69) !!! Jul 20 19:59:00.543619 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Wed Jul 20 19:59:00 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55/os-volume_attachments (10.222.0.69) Jul 20 19:59:00.544200 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: CRITICAL nova [None req-d8cfbfb5-1714-47da-a80e-6a03c4da083a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Unhandled error: OSError: write error Jul 20 19:59:00.544200 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova OSError: write error Jul 20 19:59:00.544200 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova Jul 20 19:59:00.544582 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1616/2247] 10.222.0.69 () {60 vars in 1342 bytes} [Wed Jul 20 19:59:00 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55/os-volume_attachments => generated 0 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jul 20 19:59:00.549151 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-190fa956-6883-444c-9da9-3295f8076a73 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:59:00.549665 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-190fa956-6883-444c-9da9-3295f8076a73 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] [instance: 43fe56ab-bf09-4ec0-84d5-306f16cb9d5a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:59:00.556052 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-190fa956-6883-444c-9da9-3295f8076a73 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:59:00.556503 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-190fa956-6883-444c-9da9-3295f8076a73 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:59:00.557266 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-190fa956-6883-444c-9da9-3295f8076a73 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:59:00.557730 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-190fa956-6883-444c-9da9-3295f8076a73 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:59:00.647048 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.objects.instance [None req-190fa956-6883-444c-9da9-3295f8076a73 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lazy-loading 'services' on Instance uuid 43fe56ab-bf09-4ec0-84d5-306f16cb9d5a {{(pid=117761) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:59:00.707632 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.wsgi [None req-190fa956-6883-444c-9da9-3295f8076a73 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-dd67ca8e-86d6-4ff8-ac80-631263bf63e5) Jul 20 19:59:00.710839 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-190fa956-6883-444c-9da9-3295f8076a73 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Request method failure captured: Jul 20 19:59:00.710839 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: DELETE /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a/os-volume_attachments/314fa7fd-d882-4be3-a319-c7a44c9d8bba HTTP/1.1 Jul 20 19:59:00.710839 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 19:59:00.710839 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 19:59:00.710839 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 19:59:00.710839 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 0 Jul 20 19:59:00.710839 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 19:59:00.710839 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 19:59:00.710839 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 19:59:00.710839 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 19:59:00.710839 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2FbvraeCBRrPE4O7lrRb8qOLZk5VEOCVBOl4zMC1gg8XMd7uuHid9RioGTRX_JruGVyWJZ88XS9h66QDLJKZqWWE0MjOusG0phS1nTYkPwx2OHkqAGkCtP2OLBH1bnn2QsTgDuvA_AZ-0_Frr--F8Gf2qGtpGL5jfce4gMVrg4Ozv-Y Jul 20 19:59:00.710839 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 19:59:00.710839 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 19:59:00.710839 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 19:59:00.710839 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 19:59:00.710839 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 19:59:00.710839 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 19:59:00.710839 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: e0bb4af78c1d4589b1d3cc90d5e6be63 Jul 20 19:59:00.710839 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1199788649 Jul 20 19:59:00.710839 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 19:59:00.710839 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 19:59:00.712530 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e0bb4af78c1d4589b1d3cc90d5e6be63"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e0bb4af78c1d4589b1d3cc90d5e6be63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_e0bb4af78c1d4589b1d3cc90d5e6be63", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/e0bb4af78c1d4589b1d3cc90d5e6be63"}]}] Jul 20 19:59:00.712530 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-VolumesSnapshotTestJSON-1199788649 Jul 20 19:59:00.712530 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: e0bb4af78c1d4589b1d3cc90d5e6be63 Jul 20 19:59:00.712530 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1199788649 Jul 20 19:59:00.712530 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-VolumesSnapshotTestJSON-1199788649-project Jul 20 19:59:00.712530 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 19:59:00.712530 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 19:59:00.712530 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: 78ae826a812b44328c48b82e9498ad8b Jul 20 19:59:00.712530 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-VolumesSnapshotTestJSON-1199788649-project Jul 20 19:59:00.712530 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: > Jul 20 19:59:00.713313 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-dd67ca8e-86d6-4ff8-ac80-631263bf63e5) Jul 20 19:59:00.713313 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'server_id': '43fe56ab-bf09-4ec0-84d5-306f16cb9d5a', 'id': '314fa7fd-d882-4be3-a319-c7a44c9d8bba'} Jul 20 19:59:00.713313 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:59:00.713313 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:59:00.713313 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 19:59:00.713313 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 19:59:00.713313 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 19:59:00.713313 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 19:59:00.713313 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 20 19:59:00.713313 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 20 19:59:00.713313 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 20 19:59:00.713313 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 20 19:59:00.713313 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 20 19:59:00.713313 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 20 19:59:00.713313 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 20 19:59:00.713313 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 20 19:59:00.713313 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 19:59:00.714733 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 19:59:00.714733 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 19:59:00.714733 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 19:59:00.714733 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-dd67ca8e-86d6-4ff8-ac80-631263bf63e5) Jul 20 19:59:00.714733 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:00.714733 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:59:00.714733 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:00.714733 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:59:00.714733 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 20 19:59:00.714733 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 20 19:59:00.714733 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 20 19:59:00.714733 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 20 19:59:00.714733 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 19:59:00.714733 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 19:59:00.714733 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 19:59:00.714733 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 19:59:00.714733 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 19:59:00.714733 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 19:59:00.714733 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 20 19:59:00.716169 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 20 19:59:00.716169 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 20 19:59:00.716169 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 20 19:59:00.716169 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 20 19:59:00.716169 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 20 19:59:00.716169 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 20 19:59:00.716169 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 20 19:59:00.716169 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 19:59:00.716169 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 19:59:00.716169 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 19:59:00.716169 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 19:59:00.716169 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-dd67ca8e-86d6-4ff8-ac80-631263bf63e5) Jul 20 19:59:00.716169 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:00.716169 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:59:00.716169 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:00.716169 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:59:00.716169 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 20 19:59:00.717472 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 20 19:59:00.717472 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 19:59:00.717472 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 19:59:00.717472 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 20 19:59:00.717472 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 19:59:00.717472 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 20 19:59:00.717472 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 20 19:59:00.717472 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 20 19:59:00.717472 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 19:59:00.717472 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 20 19:59:00.717472 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 20 19:59:00.717472 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-dd67ca8e-86d6-4ff8-ac80-631263bf63e5) Jul 20 19:59:00.717472 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:00.717472 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:59:00.717472 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:00.717472 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:59:00.717472 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:59:00.717472 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:59:00.719238 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:59:00.719238 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:59:00.719238 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:59:00.719238 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:59:00.719238 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 20 19:59:00.719238 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 20 19:59:00.719238 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-dd67ca8e-86d6-4ff8-ac80-631263bf63e5) Jul 20 19:59:00.719238 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:00.719238 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:59:00.719238 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:00.719238 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:59:00.719238 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:59:00.719238 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:59:00.719238 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:59:00.719238 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:59:00.719238 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-dd67ca8e-86d6-4ff8-ac80-631263bf63e5) Jul 20 19:59:00.719238 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:00.720686 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-190fa956-6883-444c-9da9-3295f8076a73 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-dd67ca8e-86d6-4ff8-ac80-631263bf63e5) {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:59:00.720686 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-190fa956-6883-444c-9da9-3295f8076a73 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] 10.222.0.69 "DELETE /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a/os-volume_attachments/314fa7fd-d882-4be3-a319-c7a44c9d8bba" status: 400 len: 269 microversion: 2.1 time: 0.167104 Jul 20 19:59:00.720686 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Wed Jul 20 19:59:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a/os-volume_attachments/314fa7fd-d882-4be3-a319-c7a44c9d8bba (ip 10.222.0.69) !!! Jul 20 19:59:00.720686 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Wed Jul 20 19:59:00 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a/os-volume_attachments/314fa7fd-d882-4be3-a319-c7a44c9d8bba (10.222.0.69) Jul 20 19:59:00.720686 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: CRITICAL nova [None req-190fa956-6883-444c-9da9-3295f8076a73 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Unhandled error: OSError: write error Jul 20 19:59:00.720686 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova OSError: write error Jul 20 19:59:00.720686 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova Jul 20 19:59:00.721270 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1617/2248] 10.222.0.69 () {58 vars in 1415 bytes} [Wed Jul 20 19:59:00 2022] DELETE /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a/os-volume_attachments/314fa7fd-d882-4be3-a319-c7a44c9d8bba => generated 0 bytes in 169 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Jul 20 19:59:00.721270 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-011190e6-4c54-47c7-a003-c9cd2310c277 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:59:00.721270 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-011190e6-4c54-47c7-a003-c9cd2310c277 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:59:00.725000 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-011190e6-4c54-47c7-a003-c9cd2310c277 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:59:00.725446 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-011190e6-4c54-47c7-a003-c9cd2310c277 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:59:00.726332 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-011190e6-4c54-47c7-a003-c9cd2310c277 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:59:00.726760 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-011190e6-4c54-47c7-a003-c9cd2310c277 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:59:00.741584 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.wsgi [None req-011190e6-4c54-47c7-a003-c9cd2310c277 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] HTTP exception thrown: Instance 239cb0b6-54d7-4cc2-945a-1f026a015992 could not be found. Jul 20 19:59:00.743087 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-011190e6-4c54-47c7-a003-c9cd2310c277 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Request method failure captured: Jul 20 19:59:00.743087 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 HTTP/1.1 Jul 20 19:59:00.743087 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 19:59:00.743087 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 19:59:00.743087 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 19:59:00.743087 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 0 Jul 20 19:59:00.743087 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 19:59:00.743087 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 19:59:00.743087 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 19:59:00.743087 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 19:59:00.743087 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2Fdu0HiuH5KQppzr_EuhJcsw9wvAUMfmlXaunNxDv05d6CEWWJ64B3V4ShLvbdBjxBPFtwG1oeqUfcHYUP34DQduKIQwbY6I9S59QgvQ8ZJLUpq98bIrTZuBAQUBv5ehnSZY1v9pstAy2JtOPlBPa5cN1SAjn2UADZCDuAa7ElZDaMc Jul 20 19:59:00.743087 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 19:59:00.743087 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 19:59:00.743087 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 19:59:00.743087 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 19:59:00.743087 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 19:59:00.743087 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 19:59:00.743087 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: da296fe635c84b99b1645ceaf0138b83 Jul 20 19:59:00.743087 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-TestShelveInstance-1788616897 Jul 20 19:59:00.743087 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 19:59:00.743087 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 19:59:00.745551 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/da296fe635c84b99b1645ceaf0138b83"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/da296fe635c84b99b1645ceaf0138b83"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_da296fe635c84b99b1645ceaf0138b83", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/da296fe635c84b99b1645ceaf0138b83"}]}] Jul 20 19:59:00.745551 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-TestShelveInstance-1788616897 Jul 20 19:59:00.745551 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: da296fe635c84b99b1645ceaf0138b83 Jul 20 19:59:00.745551 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-TestShelveInstance-1788616897 Jul 20 19:59:00.745551 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-TestShelveInstance-1788616897-project Jul 20 19:59:00.745551 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 19:59:00.745551 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 19:59:00.745551 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: 4d7204f863c64eeeb7dab59a30c447b8 Jul 20 19:59:00.745551 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-TestShelveInstance-1788616897-project Jul 20 19:59:00.745551 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: > Jul 20 19:59:00.745551 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Instance 239cb0b6-54d7-4cc2-945a-1f026a015992 could not be found. Jul 20 19:59:00.745551 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'id': '239cb0b6-54d7-4cc2-945a-1f026a015992'} Jul 20 19:59:00.746580 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:59:00.746580 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:59:00.746580 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:59:00.746580 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:59:00.746580 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:59:00.746580 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:59:00.746580 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:59:00.746580 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:59:00.746580 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:59:00.746580 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:59:00.746580 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 239cb0b6-54d7-4cc2-945a-1f026a015992 could not be found. Jul 20 19:59:00.746580 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:00.746580 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:59:00.746580 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:00.746580 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:59:00.746580 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:59:00.746580 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:59:00.746580 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:59:00.746580 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:59:00.746580 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:59:00.748069 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:59:00.748069 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:59:00.748069 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:59:00.748069 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:59:00.748069 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:59:00.748069 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:59:00.748069 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:59:00.748069 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 239cb0b6-54d7-4cc2-945a-1f026a015992 could not be found. Jul 20 19:59:00.748069 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:00.748069 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:59:00.748069 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:00.748069 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:59:00.748069 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:59:00.748069 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:59:00.748069 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:59:00.748069 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:59:00.748069 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 239cb0b6-54d7-4cc2-945a-1f026a015992 could not be found. Jul 20 19:59:00.748069 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:00.749434 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-011190e6-4c54-47c7-a003-c9cd2310c277 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Returning 404 to user: Instance 239cb0b6-54d7-4cc2-945a-1f026a015992 could not be found. {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:59:00.749434 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-011190e6-4c54-47c7-a003-c9cd2310c277 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 404 len: 111 microversion: 2.1 time: 0.030120 Jul 20 19:59:00.749434 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Wed Jul 20 19:59:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 (ip 10.222.0.69) !!! Jul 20 19:59:00.749434 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Wed Jul 20 19:59:00 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 (10.222.0.69) Jul 20 19:59:00.749434 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: CRITICAL nova [None req-011190e6-4c54-47c7-a003-c9cd2310c277 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Unhandled error: OSError: write error Jul 20 19:59:00.749434 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova OSError: write error Jul 20 19:59:00.749434 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova Jul 20 19:59:00.749434 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1618/2249] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:59:00 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 0 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Jul 20 19:59:00.750174 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-44787bca-9c2c-4163-8640-01c75e5be670 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:59:00.750370 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-44787bca-9c2c-4163-8640-01c75e5be670 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 2b8da868-71d1-49ad-be95-25d0a41393e9] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:59:00.756990 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-44787bca-9c2c-4163-8640-01c75e5be670 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:59:00.757433 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-44787bca-9c2c-4163-8640-01c75e5be670 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:59:00.758277 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-44787bca-9c2c-4163-8640-01c75e5be670 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:59:00.758709 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-44787bca-9c2c-4163-8640-01c75e5be670 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:59:00.772455 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.wsgi [None req-44787bca-9c2c-4163-8640-01c75e5be670 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] HTTP exception thrown: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. Jul 20 19:59:00.773909 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-44787bca-9c2c-4163-8640-01c75e5be670 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Request method failure captured: Jul 20 19:59:00.773909 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: DELETE /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9 HTTP/1.1 Jul 20 19:59:00.773909 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 19:59:00.773909 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 19:59:00.773909 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 19:59:00.773909 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 0 Jul 20 19:59:00.773909 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 19:59:00.773909 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 19:59:00.773909 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 19:59:00.773909 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 19:59:00.773909 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2FZGdJT3PjrXOalhxF4cK7yFRY_rdKs7nWDyfOnHDqihLmSc76hrlTVi8pwFl4fc0_PdYOdKi8ehCojNmpTfeHu0z7420hnbFU_7tQyUQZJWpu7NkYJxMVzpGVG2-8TAgdTN19E5_16lQGWKKWKpZnKtS08L9dJthhYfMLyISTLj6Mc Jul 20 19:59:00.773909 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 19:59:00.773909 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 19:59:00.773909 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 19:59:00.773909 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 19:59:00.773909 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 19:59:00.773909 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 19:59:00.773909 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: 8821facab6ed48588d9d484b5e3d98ba Jul 20 19:59:00.773909 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1121196344 Jul 20 19:59:00.773909 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 19:59:00.773909 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 19:59:00.775546 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8821facab6ed48588d9d484b5e3d98ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8821facab6ed48588d9d484b5e3d98ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8821facab6ed48588d9d484b5e3d98ba", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8821facab6ed48588d9d484b5e3d98ba"}]}] Jul 20 19:59:00.775546 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1121196344 Jul 20 19:59:00.775546 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: 8821facab6ed48588d9d484b5e3d98ba Jul 20 19:59:00.775546 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1121196344 Jul 20 19:59:00.775546 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-ServerRescueNegativeTestJSON-1121196344-project Jul 20 19:59:00.775546 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 19:59:00.775546 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 19:59:00.775546 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: 9192f2842ca044f08e5f95f98f2e1b88 Jul 20 19:59:00.775546 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1121196344-project Jul 20 19:59:00.775546 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: > Jul 20 19:59:00.775546 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. Jul 20 19:59:00.775546 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'id': '2b8da868-71d1-49ad-be95-25d0a41393e9'} Jul 20 19:59:00.776496 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:59:00.776496 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:59:00.776496 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:59:00.776496 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:59:00.776496 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:59:00.776496 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:59:00.776496 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:59:00.776496 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:59:00.776496 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:59:00.776496 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:59:00.776496 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. Jul 20 19:59:00.776496 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:00.776496 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:59:00.776496 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:00.776496 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:59:00.776496 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:59:00.776496 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:59:00.776496 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:59:00.776496 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:59:00.776496 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:59:00.778022 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:59:00.778022 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 19:59:00.778022 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 19:59:00.778022 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 19:59:00.778022 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 19:59:00.778022 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:59:00.778022 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:59:00.778022 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:59:00.778022 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:59:00.778022 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. Jul 20 19:59:00.778022 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:00.778022 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:59:00.778022 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:00.778022 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:59:00.778022 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:59:00.778022 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:59:00.778022 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:59:00.778022 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:59:00.778022 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. Jul 20 19:59:00.778022 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:00.779545 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-44787bca-9c2c-4163-8640-01c75e5be670 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Returning 404 to user: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:59:00.779545 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-44787bca-9c2c-4163-8640-01c75e5be670 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "DELETE /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9" status: 404 len: 111 microversion: 2.1 time: 0.028809 Jul 20 19:59:00.779545 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Wed Jul 20 19:59:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9 (ip 10.222.0.69) !!! Jul 20 19:59:00.779545 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Wed Jul 20 19:59:00 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9 (10.222.0.69) Jul 20 19:59:00.779545 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: CRITICAL nova [None req-44787bca-9c2c-4163-8640-01c75e5be670 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Unhandled error: OSError: write error Jul 20 19:59:00.779545 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova OSError: write error Jul 20 19:59:00.779545 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova Jul 20 19:59:00.779545 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1619/2250] 10.222.0.69 () {58 vars in 1238 bytes} [Wed Jul 20 19:59:00 2022] DELETE /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9 => generated 0 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Jul 20 19:59:00.780771 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-3956367a-1268-4a37-8444-18deef59f55e tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:59:00.781783 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-3956367a-1268-4a37-8444-18deef59f55e tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:59:00.787432 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3956367a-1268-4a37-8444-18deef59f55e tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:59:00.787875 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3956367a-1268-4a37-8444-18deef59f55e tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:59:00.788621 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3956367a-1268-4a37-8444-18deef59f55e tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:59:00.789044 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3956367a-1268-4a37-8444-18deef59f55e tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:59:00.818114 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-3956367a-1268-4a37-8444-18deef59f55e tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040186 Jul 20 19:59:00.818902 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Wed Jul 20 19:59:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a/os-volume_attachments (ip 10.222.0.69) !!! Jul 20 19:59:00.818902 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Wed Jul 20 19:59:00 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a/os-volume_attachments (10.222.0.69) Jul 20 19:59:00.819487 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: CRITICAL nova [None req-3956367a-1268-4a37-8444-18deef59f55e tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Unhandled error: OSError: write error Jul 20 19:59:00.819487 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova OSError: write error Jul 20 19:59:00.819487 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova Jul 20 19:59:00.819765 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1620/2251] 10.222.0.69 () {58 vars in 1301 bytes} [Wed Jul 20 19:59:00 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a/os-volume_attachments => generated 0 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jul 20 19:59:00.824227 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-bbde5070-1f1d-4835-816f-75826005dbca tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:59:00.825113 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-bbde5070-1f1d-4835-816f-75826005dbca tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:59:00.830587 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bbde5070-1f1d-4835-816f-75826005dbca tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:59:00.831032 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bbde5070-1f1d-4835-816f-75826005dbca tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:59:00.831777 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bbde5070-1f1d-4835-816f-75826005dbca tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:59:00.832208 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bbde5070-1f1d-4835-816f-75826005dbca tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:59:00.867679 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-bbde5070-1f1d-4835-816f-75826005dbca tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047024 Jul 20 19:59:00.868246 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1621/2252] 10.222.0.69 () {60 vars in 1342 bytes} [Wed Jul 20 19:59:00 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 19:59:00.872894 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e1d0a9e0-5dbe-42a7-92d0-1ea4cab41b06 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:59:00.873371 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e1d0a9e0-5dbe-42a7-92d0-1ea4cab41b06 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] [instance: 43fe56ab-bf09-4ec0-84d5-306f16cb9d5a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:59:00.879168 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e1d0a9e0-5dbe-42a7-92d0-1ea4cab41b06 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:59:00.879608 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e1d0a9e0-5dbe-42a7-92d0-1ea4cab41b06 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:59:00.880909 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e1d0a9e0-5dbe-42a7-92d0-1ea4cab41b06 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:59:00.881335 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e1d0a9e0-5dbe-42a7-92d0-1ea4cab41b06 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:59:00.962279 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.objects.instance [None req-e1d0a9e0-5dbe-42a7-92d0-1ea4cab41b06 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lazy-loading 'services' on Instance uuid 43fe56ab-bf09-4ec0-84d5-306f16cb9d5a {{(pid=117761) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:59:01.017814 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.wsgi [None req-e1d0a9e0-5dbe-42a7-92d0-1ea4cab41b06 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fb64a10f-d985-4337-b542-9dc02b7d53bd) Jul 20 19:59:01.019968 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e1d0a9e0-5dbe-42a7-92d0-1ea4cab41b06 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Request method failure captured: Jul 20 19:59:01.019968 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: DELETE /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a/os-volume_attachments/314fa7fd-d882-4be3-a319-c7a44c9d8bba HTTP/1.1 Jul 20 19:59:01.019968 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 19:59:01.019968 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 19:59:01.019968 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 19:59:01.019968 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 0 Jul 20 19:59:01.019968 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 19:59:01.019968 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 19:59:01.019968 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 19:59:01.019968 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 19:59:01.019968 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2FbvraeCBRrPE4O7lrRb8qOLZk5VEOCVBOl4zMC1gg8XMd7uuHid9RioGTRX_JruGVyWJZ88XS9h66QDLJKZqWWE0MjOusG0phS1nTYkPwx2OHkqAGkCtP2OLBH1bnn2QsTgDuvA_AZ-0_Frr--F8Gf2qGtpGL5jfce4gMVrg4Ozv-Y Jul 20 19:59:01.019968 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 19:59:01.019968 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 19:59:01.019968 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 19:59:01.019968 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 19:59:01.019968 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 19:59:01.019968 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 19:59:01.019968 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: e0bb4af78c1d4589b1d3cc90d5e6be63 Jul 20 19:59:01.019968 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1199788649 Jul 20 19:59:01.019968 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 19:59:01.019968 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 19:59:01.023040 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e0bb4af78c1d4589b1d3cc90d5e6be63"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e0bb4af78c1d4589b1d3cc90d5e6be63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_e0bb4af78c1d4589b1d3cc90d5e6be63", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/e0bb4af78c1d4589b1d3cc90d5e6be63"}]}] Jul 20 19:59:01.023040 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-VolumesSnapshotTestJSON-1199788649 Jul 20 19:59:01.023040 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: e0bb4af78c1d4589b1d3cc90d5e6be63 Jul 20 19:59:01.023040 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1199788649 Jul 20 19:59:01.023040 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-VolumesSnapshotTestJSON-1199788649-project Jul 20 19:59:01.023040 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 19:59:01.023040 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 19:59:01.023040 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: 78ae826a812b44328c48b82e9498ad8b Jul 20 19:59:01.023040 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-VolumesSnapshotTestJSON-1199788649-project Jul 20 19:59:01.023040 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: > Jul 20 19:59:01.024570 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fb64a10f-d985-4337-b542-9dc02b7d53bd) Jul 20 19:59:01.024570 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'server_id': '43fe56ab-bf09-4ec0-84d5-306f16cb9d5a', 'id': '314fa7fd-d882-4be3-a319-c7a44c9d8bba'} Jul 20 19:59:01.024570 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:59:01.024570 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:59:01.024570 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 19:59:01.024570 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 19:59:01.024570 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 19:59:01.024570 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 19:59:01.024570 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 20 19:59:01.024570 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 20 19:59:01.024570 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 20 19:59:01.024570 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 20 19:59:01.024570 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 20 19:59:01.024570 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 20 19:59:01.024570 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 20 19:59:01.024570 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 20 19:59:01.024570 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 19:59:01.025976 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 19:59:01.025976 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 19:59:01.025976 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 19:59:01.025976 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fb64a10f-d985-4337-b542-9dc02b7d53bd) Jul 20 19:59:01.025976 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.025976 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:59:01.025976 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.025976 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:59:01.025976 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 20 19:59:01.025976 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 20 19:59:01.025976 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 20 19:59:01.025976 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 20 19:59:01.025976 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 19:59:01.025976 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 19:59:01.025976 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 19:59:01.025976 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 19:59:01.025976 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 19:59:01.025976 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 19:59:01.025976 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 20 19:59:01.027407 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 20 19:59:01.027407 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 20 19:59:01.027407 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 20 19:59:01.027407 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 20 19:59:01.027407 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 20 19:59:01.027407 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 20 19:59:01.027407 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 20 19:59:01.027407 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 19:59:01.027407 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 19:59:01.027407 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 19:59:01.027407 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 19:59:01.027407 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fb64a10f-d985-4337-b542-9dc02b7d53bd) Jul 20 19:59:01.027407 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.027407 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:59:01.027407 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.027407 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:59:01.027407 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 20 19:59:01.028677 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 20 19:59:01.028677 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 19:59:01.028677 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 19:59:01.028677 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 20 19:59:01.028677 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 19:59:01.028677 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 20 19:59:01.028677 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 20 19:59:01.028677 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 20 19:59:01.028677 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 19:59:01.028677 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 20 19:59:01.028677 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 20 19:59:01.028677 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fb64a10f-d985-4337-b542-9dc02b7d53bd) Jul 20 19:59:01.028677 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.028677 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:59:01.028677 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.028677 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:59:01.028677 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:59:01.028677 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:59:01.030078 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:59:01.030078 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:59:01.030078 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:59:01.030078 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:59:01.030078 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 20 19:59:01.030078 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 20 19:59:01.030078 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fb64a10f-d985-4337-b542-9dc02b7d53bd) Jul 20 19:59:01.030078 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.030078 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:59:01.030078 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.030078 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:59:01.030078 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:59:01.030078 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:59:01.030078 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:59:01.030078 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:59:01.030078 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fb64a10f-d985-4337-b542-9dc02b7d53bd) Jul 20 19:59:01.030078 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.031400 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e1d0a9e0-5dbe-42a7-92d0-1ea4cab41b06 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fb64a10f-d985-4337-b542-9dc02b7d53bd) {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:59:01.031400 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e1d0a9e0-5dbe-42a7-92d0-1ea4cab41b06 tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] 10.222.0.69 "DELETE /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a/os-volume_attachments/314fa7fd-d882-4be3-a319-c7a44c9d8bba" status: 400 len: 269 microversion: 2.1 time: 0.152859 Jul 20 19:59:01.031400 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1622/2253] 10.222.0.69 () {58 vars in 1415 bytes} [Wed Jul 20 19:59:00 2022] DELETE /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a/os-volume_attachments/314fa7fd-d882-4be3-a319-c7a44c9d8bba => generated 269 bytes in 154 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 19:59:01.031400 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ae45c3ae-5fcb-41ae-bdfc-278ddd065625 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:59:01.031761 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ae45c3ae-5fcb-41ae-bdfc-278ddd065625 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:59:01.033780 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ae45c3ae-5fcb-41ae-bdfc-278ddd065625 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:59:01.034220 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ae45c3ae-5fcb-41ae-bdfc-278ddd065625 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:59:01.034992 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ae45c3ae-5fcb-41ae-bdfc-278ddd065625 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:59:01.035416 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ae45c3ae-5fcb-41ae-bdfc-278ddd065625 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:59:01.049483 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.wsgi [None req-ae45c3ae-5fcb-41ae-bdfc-278ddd065625 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] HTTP exception thrown: Instance 239cb0b6-54d7-4cc2-945a-1f026a015992 could not be found. Jul 20 19:59:01.051017 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ae45c3ae-5fcb-41ae-bdfc-278ddd065625 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Request method failure captured: Jul 20 19:59:01.051017 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 HTTP/1.1 Jul 20 19:59:01.051017 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 19:59:01.051017 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 19:59:01.051017 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 19:59:01.051017 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 0 Jul 20 19:59:01.051017 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 19:59:01.051017 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 19:59:01.051017 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 19:59:01.051017 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 19:59:01.051017 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2Fdu0HiuH5KQppzr_EuhJcsw9wvAUMfmlXaunNxDv05d6CEWWJ64B3V4ShLvbdBjxBPFtwG1oeqUfcHYUP34DQduKIQwbY6I9S59QgvQ8ZJLUpq98bIrTZuBAQUBv5ehnSZY1v9pstAy2JtOPlBPa5cN1SAjn2UADZCDuAa7ElZDaMc Jul 20 19:59:01.051017 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 19:59:01.051017 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 19:59:01.051017 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 19:59:01.051017 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 19:59:01.051017 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 19:59:01.051017 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 19:59:01.051017 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: da296fe635c84b99b1645ceaf0138b83 Jul 20 19:59:01.051017 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-TestShelveInstance-1788616897 Jul 20 19:59:01.051017 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 19:59:01.051017 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 19:59:01.052948 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/da296fe635c84b99b1645ceaf0138b83"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/da296fe635c84b99b1645ceaf0138b83"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_da296fe635c84b99b1645ceaf0138b83", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/da296fe635c84b99b1645ceaf0138b83"}]}] Jul 20 19:59:01.052948 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-TestShelveInstance-1788616897 Jul 20 19:59:01.052948 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: da296fe635c84b99b1645ceaf0138b83 Jul 20 19:59:01.052948 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-TestShelveInstance-1788616897 Jul 20 19:59:01.052948 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-TestShelveInstance-1788616897-project Jul 20 19:59:01.052948 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 19:59:01.052948 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 19:59:01.052948 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: 4d7204f863c64eeeb7dab59a30c447b8 Jul 20 19:59:01.052948 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-TestShelveInstance-1788616897-project Jul 20 19:59:01.052948 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: > Jul 20 19:59:01.052948 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Instance 239cb0b6-54d7-4cc2-945a-1f026a015992 could not be found. Jul 20 19:59:01.052948 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'id': '239cb0b6-54d7-4cc2-945a-1f026a015992'} Jul 20 19:59:01.054172 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:59:01.054172 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:59:01.054172 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:59:01.054172 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:59:01.054172 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:59:01.054172 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:59:01.054172 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:59:01.054172 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:59:01.054172 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:59:01.054172 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:59:01.054172 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 239cb0b6-54d7-4cc2-945a-1f026a015992 could not be found. Jul 20 19:59:01.054172 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.054172 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:59:01.054172 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.054172 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:59:01.054172 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:59:01.054172 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:59:01.054172 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:59:01.054172 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:59:01.054172 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:59:01.055748 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:59:01.055748 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:59:01.055748 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:59:01.055748 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:59:01.055748 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:59:01.055748 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:59:01.055748 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:59:01.055748 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 239cb0b6-54d7-4cc2-945a-1f026a015992 could not be found. Jul 20 19:59:01.055748 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.055748 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:59:01.055748 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.055748 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:59:01.055748 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:59:01.055748 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:59:01.055748 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:59:01.055748 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:59:01.055748 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 239cb0b6-54d7-4cc2-945a-1f026a015992 could not be found. Jul 20 19:59:01.055748 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.057090 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ae45c3ae-5fcb-41ae-bdfc-278ddd065625 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Returning 404 to user: Instance 239cb0b6-54d7-4cc2-945a-1f026a015992 could not be found. {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:59:01.057090 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ae45c3ae-5fcb-41ae-bdfc-278ddd065625 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 404 len: 111 microversion: 2.1 time: 0.028731 Jul 20 19:59:01.057090 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1623/2254] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:59:01 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:59:01.057363 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-7c4beedf-add1-4c10-a312-bf0496d3a6d4 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:59:01.057799 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-7c4beedf-add1-4c10-a312-bf0496d3a6d4 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 2b8da868-71d1-49ad-be95-25d0a41393e9] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:59:01.063366 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7c4beedf-add1-4c10-a312-bf0496d3a6d4 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:59:01.063809 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7c4beedf-add1-4c10-a312-bf0496d3a6d4 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:59:01.064558 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7c4beedf-add1-4c10-a312-bf0496d3a6d4 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:59:01.064995 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7c4beedf-add1-4c10-a312-bf0496d3a6d4 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:59:01.078483 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.wsgi [None req-7c4beedf-add1-4c10-a312-bf0496d3a6d4 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] HTTP exception thrown: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. Jul 20 19:59:01.079995 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-7c4beedf-add1-4c10-a312-bf0496d3a6d4 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Request method failure captured: Jul 20 19:59:01.079995 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: DELETE /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9 HTTP/1.1 Jul 20 19:59:01.079995 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 19:59:01.079995 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 19:59:01.079995 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 19:59:01.079995 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 0 Jul 20 19:59:01.079995 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 19:59:01.079995 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 19:59:01.079995 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 19:59:01.079995 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 19:59:01.079995 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2FZGdJT3PjrXOalhxF4cK7yFRY_rdKs7nWDyfOnHDqihLmSc76hrlTVi8pwFl4fc0_PdYOdKi8ehCojNmpTfeHu0z7420hnbFU_7tQyUQZJWpu7NkYJxMVzpGVG2-8TAgdTN19E5_16lQGWKKWKpZnKtS08L9dJthhYfMLyISTLj6Mc Jul 20 19:59:01.079995 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 19:59:01.079995 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 19:59:01.079995 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 19:59:01.079995 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 19:59:01.079995 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 19:59:01.079995 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 19:59:01.079995 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: 8821facab6ed48588d9d484b5e3d98ba Jul 20 19:59:01.079995 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1121196344 Jul 20 19:59:01.079995 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 19:59:01.079995 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 19:59:01.081640 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8821facab6ed48588d9d484b5e3d98ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8821facab6ed48588d9d484b5e3d98ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8821facab6ed48588d9d484b5e3d98ba", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8821facab6ed48588d9d484b5e3d98ba"}]}] Jul 20 19:59:01.081640 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1121196344 Jul 20 19:59:01.081640 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: 8821facab6ed48588d9d484b5e3d98ba Jul 20 19:59:01.081640 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1121196344 Jul 20 19:59:01.081640 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-ServerRescueNegativeTestJSON-1121196344-project Jul 20 19:59:01.081640 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 19:59:01.081640 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 19:59:01.081640 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: 9192f2842ca044f08e5f95f98f2e1b88 Jul 20 19:59:01.081640 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1121196344-project Jul 20 19:59:01.081640 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: > Jul 20 19:59:01.081640 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. Jul 20 19:59:01.081640 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'id': '2b8da868-71d1-49ad-be95-25d0a41393e9'} Jul 20 19:59:01.082453 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:59:01.082453 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:59:01.082453 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:59:01.082453 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:59:01.082453 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:59:01.082453 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:59:01.082453 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:59:01.082453 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:59:01.082453 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:59:01.082453 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:59:01.082453 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. Jul 20 19:59:01.082453 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.082453 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:59:01.082453 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.082453 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:59:01.082453 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:59:01.082453 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:59:01.082453 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:59:01.082453 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:59:01.082453 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:59:01.084271 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:59:01.084271 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 19:59:01.084271 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 19:59:01.084271 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 19:59:01.084271 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 19:59:01.084271 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:59:01.084271 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:59:01.084271 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:59:01.084271 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:59:01.084271 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. Jul 20 19:59:01.084271 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.084271 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:59:01.084271 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.084271 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:59:01.084271 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:59:01.084271 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:59:01.084271 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:59:01.084271 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:59:01.084271 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. Jul 20 19:59:01.084271 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.085671 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-7c4beedf-add1-4c10-a312-bf0496d3a6d4 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Returning 404 to user: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:59:01.085671 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-7c4beedf-add1-4c10-a312-bf0496d3a6d4 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "DELETE /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9" status: 404 len: 111 microversion: 2.1 time: 0.027452 Jul 20 19:59:01.085671 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1624/2255] 10.222.0.69 () {58 vars in 1238 bytes} [Wed Jul 20 19:59:01 2022] DELETE /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:59:01.087502 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-f3991a7a-2729-45d4-a4c7-e323d7d0caa8 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:59:01.088420 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-f3991a7a-2729-45d4-a4c7-e323d7d0caa8 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:59:01.094479 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f3991a7a-2729-45d4-a4c7-e323d7d0caa8 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:59:01.094933 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f3991a7a-2729-45d4-a4c7-e323d7d0caa8 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:59:01.095686 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f3991a7a-2729-45d4-a4c7-e323d7d0caa8 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:59:01.096118 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f3991a7a-2729-45d4-a4c7-e323d7d0caa8 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:59:01.125571 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-f3991a7a-2729-45d4-a4c7-e323d7d0caa8 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042496 Jul 20 19:59:01.126207 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1625/2256] 10.222.0.69 () {58 vars in 1301 bytes} [Wed Jul 20 19:59:01 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:59:01.131511 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-827d6966-10c8-4ebe-b4bd-f67080ce25ad tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '.version_select at 0x7ff60a273310>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:59:01.153134 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-827d6966-10c8-4ebe-b4bd-f67080ce25ad tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-495469876" status: 202 len: 0 microversion: 2.1 time: 0.026006 Jul 20 19:59:01.153744 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1626/2257] 10.222.0.69 () {58 vars in 1259 bytes} [Wed Jul 20 19:59:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-495469876 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 19:59:01.158466 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-630cc697-7127-471c-a026-a43b468a7304 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:59:01.159366 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-630cc697-7127-471c-a026-a43b468a7304 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:59:01.166679 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-630cc697-7127-471c-a026-a43b468a7304 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:59:01.167126 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-630cc697-7127-471c-a026-a43b468a7304 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:59:01.167880 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-630cc697-7127-471c-a026-a43b468a7304 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:59:01.168309 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-630cc697-7127-471c-a026-a43b468a7304 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:59:01.204371 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-630cc697-7127-471c-a026-a43b468a7304 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049485 Jul 20 19:59:01.204948 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1627/2258] 10.222.0.69 () {60 vars in 1342 bytes} [Wed Jul 20 19:59:01 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 19:59:01.211661 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d57d8d19-d92b-4444-81d2-d8cb9f19053e tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:59:01.212143 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d57d8d19-d92b-4444-81d2-d8cb9f19053e tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] [instance: 43fe56ab-bf09-4ec0-84d5-306f16cb9d5a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:59:01.217932 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d57d8d19-d92b-4444-81d2-d8cb9f19053e tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:59:01.218371 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d57d8d19-d92b-4444-81d2-d8cb9f19053e tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:59:01.219387 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d57d8d19-d92b-4444-81d2-d8cb9f19053e tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:59:01.219813 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d57d8d19-d92b-4444-81d2-d8cb9f19053e tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:59:01.300877 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.objects.instance [None req-d57d8d19-d92b-4444-81d2-d8cb9f19053e tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lazy-loading 'services' on Instance uuid 43fe56ab-bf09-4ec0-84d5-306f16cb9d5a {{(pid=117761) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:59:01.359619 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.wsgi [None req-d57d8d19-d92b-4444-81d2-d8cb9f19053e tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7a8db855-e8f9-426a-8383-b0cb28188cc9) Jul 20 19:59:01.361833 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d57d8d19-d92b-4444-81d2-d8cb9f19053e tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Request method failure captured: Jul 20 19:59:01.361833 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: DELETE /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a/os-volume_attachments/314fa7fd-d882-4be3-a319-c7a44c9d8bba HTTP/1.1 Jul 20 19:59:01.361833 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 19:59:01.361833 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 19:59:01.361833 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 19:59:01.361833 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 0 Jul 20 19:59:01.361833 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 19:59:01.361833 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 19:59:01.361833 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 19:59:01.361833 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 19:59:01.361833 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2FbvraeCBRrPE4O7lrRb8qOLZk5VEOCVBOl4zMC1gg8XMd7uuHid9RioGTRX_JruGVyWJZ88XS9h66QDLJKZqWWE0MjOusG0phS1nTYkPwx2OHkqAGkCtP2OLBH1bnn2QsTgDuvA_AZ-0_Frr--F8Gf2qGtpGL5jfce4gMVrg4Ozv-Y Jul 20 19:59:01.361833 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 19:59:01.361833 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 19:59:01.361833 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 19:59:01.361833 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 19:59:01.361833 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 19:59:01.361833 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 19:59:01.361833 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: e0bb4af78c1d4589b1d3cc90d5e6be63 Jul 20 19:59:01.361833 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1199788649 Jul 20 19:59:01.361833 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 19:59:01.361833 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 19:59:01.363329 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e0bb4af78c1d4589b1d3cc90d5e6be63"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e0bb4af78c1d4589b1d3cc90d5e6be63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_e0bb4af78c1d4589b1d3cc90d5e6be63", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/e0bb4af78c1d4589b1d3cc90d5e6be63"}]}] Jul 20 19:59:01.363329 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-VolumesSnapshotTestJSON-1199788649 Jul 20 19:59:01.363329 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: e0bb4af78c1d4589b1d3cc90d5e6be63 Jul 20 19:59:01.363329 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1199788649 Jul 20 19:59:01.363329 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-VolumesSnapshotTestJSON-1199788649-project Jul 20 19:59:01.363329 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 19:59:01.363329 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 19:59:01.363329 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: 78ae826a812b44328c48b82e9498ad8b Jul 20 19:59:01.363329 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-VolumesSnapshotTestJSON-1199788649-project Jul 20 19:59:01.363329 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: > Jul 20 19:59:01.364150 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7a8db855-e8f9-426a-8383-b0cb28188cc9) Jul 20 19:59:01.364150 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'server_id': '43fe56ab-bf09-4ec0-84d5-306f16cb9d5a', 'id': '314fa7fd-d882-4be3-a319-c7a44c9d8bba'} Jul 20 19:59:01.364150 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:59:01.364150 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:59:01.364150 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 19:59:01.364150 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 19:59:01.364150 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 19:59:01.364150 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 19:59:01.364150 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 20 19:59:01.364150 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 20 19:59:01.364150 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 20 19:59:01.364150 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 20 19:59:01.364150 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 20 19:59:01.364150 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 20 19:59:01.364150 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 20 19:59:01.364150 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 20 19:59:01.364150 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 19:59:01.365772 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 19:59:01.365772 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 19:59:01.365772 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 19:59:01.365772 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7a8db855-e8f9-426a-8383-b0cb28188cc9) Jul 20 19:59:01.365772 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.365772 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:59:01.365772 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.365772 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:59:01.365772 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 20 19:59:01.365772 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 20 19:59:01.365772 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 20 19:59:01.365772 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 20 19:59:01.365772 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 19:59:01.365772 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 19:59:01.365772 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 19:59:01.365772 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 19:59:01.365772 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 19:59:01.365772 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 19:59:01.365772 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 20 19:59:01.366956 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 20 19:59:01.366956 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 20 19:59:01.366956 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 20 19:59:01.366956 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 20 19:59:01.366956 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 20 19:59:01.366956 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 20 19:59:01.366956 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 20 19:59:01.366956 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 19:59:01.366956 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 19:59:01.366956 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 19:59:01.366956 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 19:59:01.366956 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7a8db855-e8f9-426a-8383-b0cb28188cc9) Jul 20 19:59:01.366956 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.366956 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:59:01.366956 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.366956 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:59:01.366956 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 20 19:59:01.368045 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 20 19:59:01.368045 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 19:59:01.368045 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 19:59:01.368045 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 20 19:59:01.368045 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 19:59:01.368045 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 20 19:59:01.368045 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 20 19:59:01.368045 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 20 19:59:01.368045 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 19:59:01.368045 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 20 19:59:01.368045 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 20 19:59:01.368045 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7a8db855-e8f9-426a-8383-b0cb28188cc9) Jul 20 19:59:01.368045 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.368045 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:59:01.368045 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.368045 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:59:01.368045 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:59:01.368045 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:59:01.369199 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:59:01.369199 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:59:01.369199 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:59:01.369199 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:59:01.369199 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 20 19:59:01.369199 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 20 19:59:01.369199 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7a8db855-e8f9-426a-8383-b0cb28188cc9) Jul 20 19:59:01.369199 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.369199 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:59:01.369199 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.369199 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:59:01.369199 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:59:01.369199 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:59:01.369199 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:59:01.369199 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:59:01.369199 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7a8db855-e8f9-426a-8383-b0cb28188cc9) Jul 20 19:59:01.369199 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.370864 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d57d8d19-d92b-4444-81d2-d8cb9f19053e tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7a8db855-e8f9-426a-8383-b0cb28188cc9) {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:59:01.370864 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d57d8d19-d92b-4444-81d2-d8cb9f19053e tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] 10.222.0.69 "DELETE /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a/os-volume_attachments/314fa7fd-d882-4be3-a319-c7a44c9d8bba" status: 400 len: 269 microversion: 2.1 time: 0.156965 Jul 20 19:59:01.370864 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1628/2259] 10.222.0.69 () {58 vars in 1415 bytes} [Wed Jul 20 19:59:01 2022] DELETE /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a/os-volume_attachments/314fa7fd-d882-4be3-a319-c7a44c9d8bba => generated 269 bytes in 158 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 19:59:01.370864 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-630e6b52-c669-4853-b2ac-0f3fb1e8dd1f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:59:01.371378 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-630e6b52-c669-4853-b2ac-0f3fb1e8dd1f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] [instance: 239cb0b6-54d7-4cc2-945a-1f026a015992] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:59:01.375540 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-630e6b52-c669-4853-b2ac-0f3fb1e8dd1f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:59:01.375986 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-630e6b52-c669-4853-b2ac-0f3fb1e8dd1f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:59:01.376746 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-630e6b52-c669-4853-b2ac-0f3fb1e8dd1f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:59:01.377176 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-630e6b52-c669-4853-b2ac-0f3fb1e8dd1f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:59:01.391518 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.wsgi [None req-630e6b52-c669-4853-b2ac-0f3fb1e8dd1f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] HTTP exception thrown: Instance 239cb0b6-54d7-4cc2-945a-1f026a015992 could not be found. Jul 20 19:59:01.393080 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-630e6b52-c669-4853-b2ac-0f3fb1e8dd1f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Request method failure captured: Jul 20 19:59:01.393080 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 HTTP/1.1 Jul 20 19:59:01.393080 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 19:59:01.393080 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 19:59:01.393080 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 19:59:01.393080 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 0 Jul 20 19:59:01.393080 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 19:59:01.393080 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 19:59:01.393080 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 19:59:01.393080 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 19:59:01.393080 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2Fdu0HiuH5KQppzr_EuhJcsw9wvAUMfmlXaunNxDv05d6CEWWJ64B3V4ShLvbdBjxBPFtwG1oeqUfcHYUP34DQduKIQwbY6I9S59QgvQ8ZJLUpq98bIrTZuBAQUBv5ehnSZY1v9pstAy2JtOPlBPa5cN1SAjn2UADZCDuAa7ElZDaMc Jul 20 19:59:01.393080 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 19:59:01.393080 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 19:59:01.393080 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 19:59:01.393080 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 19:59:01.393080 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 19:59:01.393080 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 19:59:01.393080 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: da296fe635c84b99b1645ceaf0138b83 Jul 20 19:59:01.393080 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-TestShelveInstance-1788616897 Jul 20 19:59:01.393080 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 19:59:01.393080 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 19:59:01.394863 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/da296fe635c84b99b1645ceaf0138b83"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/da296fe635c84b99b1645ceaf0138b83"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_da296fe635c84b99b1645ceaf0138b83", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/da296fe635c84b99b1645ceaf0138b83"}]}] Jul 20 19:59:01.394863 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-TestShelveInstance-1788616897 Jul 20 19:59:01.394863 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: da296fe635c84b99b1645ceaf0138b83 Jul 20 19:59:01.394863 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-TestShelveInstance-1788616897 Jul 20 19:59:01.394863 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-TestShelveInstance-1788616897-project Jul 20 19:59:01.394863 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 19:59:01.394863 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 19:59:01.394863 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: 4d7204f863c64eeeb7dab59a30c447b8 Jul 20 19:59:01.394863 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-TestShelveInstance-1788616897-project Jul 20 19:59:01.394863 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: > Jul 20 19:59:01.394863 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Instance 239cb0b6-54d7-4cc2-945a-1f026a015992 could not be found. Jul 20 19:59:01.394863 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'id': '239cb0b6-54d7-4cc2-945a-1f026a015992'} Jul 20 19:59:01.396639 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:59:01.396639 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:59:01.396639 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:59:01.396639 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:59:01.396639 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:59:01.396639 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:59:01.396639 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:59:01.396639 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:59:01.396639 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:59:01.396639 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:59:01.396639 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 239cb0b6-54d7-4cc2-945a-1f026a015992 could not be found. Jul 20 19:59:01.396639 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.396639 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:59:01.396639 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.396639 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:59:01.396639 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:59:01.396639 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:59:01.396639 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:59:01.396639 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:59:01.396639 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:59:01.398573 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:59:01.398573 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:59:01.398573 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:59:01.398573 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:59:01.398573 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:59:01.398573 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:59:01.398573 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:59:01.398573 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 239cb0b6-54d7-4cc2-945a-1f026a015992 could not be found. Jul 20 19:59:01.398573 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.398573 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:59:01.398573 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.398573 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:59:01.398573 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:59:01.398573 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:59:01.398573 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:59:01.398573 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:59:01.398573 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 239cb0b6-54d7-4cc2-945a-1f026a015992 could not be found. Jul 20 19:59:01.398573 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.400143 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-630e6b52-c669-4853-b2ac-0f3fb1e8dd1f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Returning 404 to user: Instance 239cb0b6-54d7-4cc2-945a-1f026a015992 could not be found. {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:59:01.400143 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-630e6b52-c669-4853-b2ac-0f3fb1e8dd1f tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992" status: 404 len: 111 microversion: 2.1 time: 0.029665 Jul 20 19:59:01.400143 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1629/2260] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:59:01 2022] GET /compute/v2.1/servers/239cb0b6-54d7-4cc2-945a-1f026a015992 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:59:01.400609 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-dc9d211c-81a8-4af0-92a0-b226d0834de2 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:59:01.401095 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-dc9d211c-81a8-4af0-92a0-b226d0834de2 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 2b8da868-71d1-49ad-be95-25d0a41393e9] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:59:01.407130 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-dc9d211c-81a8-4af0-92a0-b226d0834de2 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:59:01.407571 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-dc9d211c-81a8-4af0-92a0-b226d0834de2 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:59:01.408330 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-dc9d211c-81a8-4af0-92a0-b226d0834de2 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:59:01.408753 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-dc9d211c-81a8-4af0-92a0-b226d0834de2 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:59:01.423504 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.wsgi [None req-dc9d211c-81a8-4af0-92a0-b226d0834de2 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] HTTP exception thrown: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. Jul 20 19:59:01.425662 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-dc9d211c-81a8-4af0-92a0-b226d0834de2 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Request method failure captured: Jul 20 19:59:01.425662 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: DELETE /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9 HTTP/1.1 Jul 20 19:59:01.425662 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 19:59:01.425662 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 19:59:01.425662 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 19:59:01.425662 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 0 Jul 20 19:59:01.425662 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 19:59:01.425662 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 19:59:01.425662 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 19:59:01.425662 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 19:59:01.425662 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2FZGdJT3PjrXOalhxF4cK7yFRY_rdKs7nWDyfOnHDqihLmSc76hrlTVi8pwFl4fc0_PdYOdKi8ehCojNmpTfeHu0z7420hnbFU_7tQyUQZJWpu7NkYJxMVzpGVG2-8TAgdTN19E5_16lQGWKKWKpZnKtS08L9dJthhYfMLyISTLj6Mc Jul 20 19:59:01.425662 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 19:59:01.425662 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 19:59:01.425662 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 19:59:01.425662 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 19:59:01.425662 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 19:59:01.425662 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 19:59:01.425662 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: 8821facab6ed48588d9d484b5e3d98ba Jul 20 19:59:01.425662 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1121196344 Jul 20 19:59:01.425662 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 19:59:01.425662 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 19:59:01.427145 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8821facab6ed48588d9d484b5e3d98ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8821facab6ed48588d9d484b5e3d98ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8821facab6ed48588d9d484b5e3d98ba", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8821facab6ed48588d9d484b5e3d98ba"}]}] Jul 20 19:59:01.427145 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1121196344 Jul 20 19:59:01.427145 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: 8821facab6ed48588d9d484b5e3d98ba Jul 20 19:59:01.427145 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1121196344 Jul 20 19:59:01.427145 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-ServerRescueNegativeTestJSON-1121196344-project Jul 20 19:59:01.427145 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 19:59:01.427145 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 19:59:01.427145 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: 9192f2842ca044f08e5f95f98f2e1b88 Jul 20 19:59:01.427145 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1121196344-project Jul 20 19:59:01.427145 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: > Jul 20 19:59:01.427145 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. Jul 20 19:59:01.427145 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'id': '2b8da868-71d1-49ad-be95-25d0a41393e9'} Jul 20 19:59:01.428127 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:59:01.428127 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:59:01.428127 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:59:01.428127 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:59:01.428127 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:59:01.428127 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:59:01.428127 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:59:01.428127 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:59:01.428127 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:59:01.428127 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:59:01.428127 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. Jul 20 19:59:01.428127 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.428127 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:59:01.428127 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.428127 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:59:01.428127 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:59:01.428127 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:59:01.428127 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:59:01.428127 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:59:01.428127 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:59:01.429377 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:59:01.429377 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 19:59:01.429377 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 19:59:01.429377 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 19:59:01.429377 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 19:59:01.429377 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:59:01.429377 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:59:01.429377 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:59:01.429377 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:59:01.429377 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. Jul 20 19:59:01.429377 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.429377 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:59:01.429377 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.429377 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:59:01.429377 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:59:01.429377 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:59:01.429377 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:59:01.429377 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:59:01.429377 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. Jul 20 19:59:01.429377 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.431032 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-dc9d211c-81a8-4af0-92a0-b226d0834de2 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Returning 404 to user: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:59:01.431032 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-dc9d211c-81a8-4af0-92a0-b226d0834de2 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "DELETE /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9" status: 404 len: 111 microversion: 2.1 time: 0.030206 Jul 20 19:59:01.431032 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1630/2261] 10.222.0.69 () {58 vars in 1238 bytes} [Wed Jul 20 19:59:01 2022] DELETE /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:59:01.432254 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-86e8972b-f4e2-4781-8026-846437e70444 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:59:01.433194 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-86e8972b-f4e2-4781-8026-846437e70444 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:59:01.439069 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-86e8972b-f4e2-4781-8026-846437e70444 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:59:01.439533 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-86e8972b-f4e2-4781-8026-846437e70444 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:59:01.440270 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-86e8972b-f4e2-4781-8026-846437e70444 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:59:01.440716 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-86e8972b-f4e2-4781-8026-846437e70444 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:59:01.471219 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-86e8972b-f4e2-4781-8026-846437e70444 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042582 Jul 20 19:59:01.471771 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1631/2262] 10.222.0.69 () {58 vars in 1301 bytes} [Wed Jul 20 19:59:01 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:59:01.476253 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-62874be9-6e62-4ed3-bfb1-aae7f8f94c74 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '.version_select at 0x7ff60a22f820>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:59:01.491732 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.wsgi [None req-62874be9-6e62-4ed3-bfb1-aae7f8f94c74 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] HTTP exception thrown: Keypair tempest-TestVolumeBootPattern-495469876 not found for user 8c67fe170c60476d88610d85f2528c52 Jul 20 19:59:01.495379 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-62874be9-6e62-4ed3-bfb1-aae7f8f94c74 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Request method failure captured: Jul 20 19:59:01.495379 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-495469876 HTTP/1.1 Jul 20 19:59:01.495379 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 19:59:01.495379 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 19:59:01.495379 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 19:59:01.495379 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 0 Jul 20 19:59:01.495379 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 19:59:01.495379 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 19:59:01.495379 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 19:59:01.495379 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 19:59:01.495379 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2FdVs7eM67G3Zazrj_GsNI3i4m-y-efJaSddI0Xv6CRjD4yd2s6wL8tBZ6J1lP1JcE-Z0KelK_x4rgOH83_SGm2Q_B0FQwtGNvnMavX0_Pu_FfJRr2tyHjewEt1Sj0gEQ1F4i50DsY9pQO0aod7uKcbHr0cFYew_ONOTFpjPqkoMjzM Jul 20 19:59:01.495379 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 19:59:01.495379 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 19:59:01.495379 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 19:59:01.495379 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 19:59:01.495379 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 19:59:01.495379 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 19:59:01.495379 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: 8064950f9a1942149aa8d6c08c206850 Jul 20 19:59:01.495379 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-TestVolumeBootPattern-439210935 Jul 20 19:59:01.495379 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 19:59:01.495379 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 19:59:01.497118 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8064950f9a1942149aa8d6c08c206850"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8064950f9a1942149aa8d6c08c206850"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8064950f9a1942149aa8d6c08c206850", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8064950f9a1942149aa8d6c08c206850"}]}] Jul 20 19:59:01.497118 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-TestVolumeBootPattern-439210935 Jul 20 19:59:01.497118 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: 8064950f9a1942149aa8d6c08c206850 Jul 20 19:59:01.497118 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-TestVolumeBootPattern-439210935 Jul 20 19:59:01.497118 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-TestVolumeBootPattern-439210935-project Jul 20 19:59:01.497118 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 19:59:01.497118 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 19:59:01.497118 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: 8c67fe170c60476d88610d85f2528c52 Jul 20 19:59:01.497118 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-TestVolumeBootPattern-439210935-project Jul 20 19:59:01.497118 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: Jul 20 19:59:01.497118 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Keypair tempest-TestVolumeBootPattern-495469876 not found for user 8c67fe170c60476d88610d85f2528c52 Jul 20 19:59:01.497118 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'id': 'tempest-TestVolumeBootPattern-495469876'} Jul 20 19:59:01.497118 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:59:01.498242 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:59:01.498242 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 164, in _delete Jul 20 19:59:01.498242 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Jul 20 19:59:01.498242 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 19:59:01.498242 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 19:59:01.498242 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 19:59:01.498242 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 19:59:01.498242 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 19:59:01.498242 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 19:59:01.498242 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 19:59:01.498242 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 19:59:01.498242 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6745, in delete_key_pair Jul 20 19:59:01.498242 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Jul 20 19:59:01.498242 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6766, in get_key_pair Jul 20 19:59:01.498242 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Jul 20 19:59:01.498242 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 19:59:01.498242 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 19:59:01.498242 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jul 20 19:59:01.498242 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jul 20 19:59:01.499854 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jul 20 19:59:01.499854 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jul 20 19:59:01.499854 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 19:59:01.499854 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 19:59:01.499854 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jul 20 19:59:01.499854 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jul 20 19:59:01.499854 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-TestVolumeBootPattern-495469876 not found for user 8c67fe170c60476d88610d85f2528c52 Jul 20 19:59:01.499854 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.499854 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:59:01.499854 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.499854 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:59:01.499854 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:59:01.499854 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:59:01.499854 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:59:01.499854 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:59:01.499854 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 19:59:01.499854 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 19:59:01.499854 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 19:59:01.499854 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 19:59:01.501408 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:59:01.501408 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:59:01.501408 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 137, in delete Jul 20 19:59:01.501408 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self._delete(req, id) Jul 20 19:59:01.501408 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 166, in _delete Jul 20 19:59:01.501408 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Jul 20 19:59:01.501408 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-TestVolumeBootPattern-495469876 not found for user 8c67fe170c60476d88610d85f2528c52 Jul 20 19:59:01.501408 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.501408 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:59:01.501408 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.501408 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:59:01.501408 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:59:01.501408 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:59:01.501408 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:59:01.501408 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:59:01.501408 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-TestVolumeBootPattern-495469876 not found for user 8c67fe170c60476d88610d85f2528c52 Jul 20 19:59:01.501408 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.502782 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-62874be9-6e62-4ed3-bfb1-aae7f8f94c74 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Returning 404 to user: Keypair tempest-TestVolumeBootPattern-495469876 not found for user 8c67fe170c60476d88610d85f2528c52 {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:59:01.502782 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-62874be9-6e62-4ed3-bfb1-aae7f8f94c74 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-495469876" status: 404 len: 145 microversion: 2.1 time: 0.024073 Jul 20 19:59:01.502782 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1632/2263] 10.222.0.69 () {58 vars in 1259 bytes} [Wed Jul 20 19:59:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-495469876 => generated 145 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:59:01.502782 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-67dd2e0a-73fa-4411-abfc-c617b6b39f4d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:59:01.503776 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-67dd2e0a-73fa-4411-abfc-c617b6b39f4d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:59:01.510558 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-67dd2e0a-73fa-4411-abfc-c617b6b39f4d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:59:01.511001 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-67dd2e0a-73fa-4411-abfc-c617b6b39f4d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:59:01.511752 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-67dd2e0a-73fa-4411-abfc-c617b6b39f4d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:59:01.512181 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-67dd2e0a-73fa-4411-abfc-c617b6b39f4d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:59:01.541155 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-67dd2e0a-73fa-4411-abfc-c617b6b39f4d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042656 Jul 20 19:59:01.541652 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1633/2264] 10.222.0.69 () {60 vars in 1342 bytes} [Wed Jul 20 19:59:01 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 19:59:01.546011 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-7f7468ca-e5d4-49b6-b3b5-7d63a7d560a5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '.version_select at 0x7ff60a40d550>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:59:01.562985 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-7f7468ca-e5d4-49b6-b3b5-7d63a7d560a5 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1245547191" status: 202 len: 0 microversion: 2.1 time: 0.020177 Jul 20 19:59:01.563545 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1634/2265] 10.222.0.69 () {58 vars in 1253 bytes} [Wed Jul 20 19:59:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1245547191 => generated 0 bytes in 21 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 19:59:01.568608 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-8d27b8ab-a8b1-4573-8de8-a4648dbfae3a tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:59:01.569222 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-8d27b8ab-a8b1-4573-8de8-a4648dbfae3a tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 2b8da868-71d1-49ad-be95-25d0a41393e9] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:59:01.575039 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8d27b8ab-a8b1-4573-8de8-a4648dbfae3a tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:59:01.575490 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8d27b8ab-a8b1-4573-8de8-a4648dbfae3a tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:59:01.576246 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8d27b8ab-a8b1-4573-8de8-a4648dbfae3a tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:59:01.576679 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8d27b8ab-a8b1-4573-8de8-a4648dbfae3a tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:59:01.580928 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:59:01.592601 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.wsgi [None req-8d27b8ab-a8b1-4573-8de8-a4648dbfae3a tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] HTTP exception thrown: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. Jul 20 19:59:01.594435 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-8d27b8ab-a8b1-4573-8de8-a4648dbfae3a tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Request method failure captured: Jul 20 19:59:01.594435 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: GET /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9 HTTP/1.1 Jul 20 19:59:01.594435 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 19:59:01.594435 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 19:59:01.594435 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 19:59:01.594435 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 0 Jul 20 19:59:01.594435 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 19:59:01.594435 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 19:59:01.594435 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 19:59:01.594435 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 19:59:01.594435 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2FZGdJT3PjrXOalhxF4cK7yFRY_rdKs7nWDyfOnHDqihLmSc76hrlTVi8pwFl4fc0_PdYOdKi8ehCojNmpTfeHu0z7420hnbFU_7tQyUQZJWpu7NkYJxMVzpGVG2-8TAgdTN19E5_16lQGWKKWKpZnKtS08L9dJthhYfMLyISTLj6Mc Jul 20 19:59:01.594435 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 19:59:01.594435 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 19:59:01.594435 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 19:59:01.594435 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 19:59:01.594435 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 19:59:01.594435 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 19:59:01.594435 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: 8821facab6ed48588d9d484b5e3d98ba Jul 20 19:59:01.594435 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1121196344 Jul 20 19:59:01.594435 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 19:59:01.594435 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 19:59:01.596095 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8821facab6ed48588d9d484b5e3d98ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8821facab6ed48588d9d484b5e3d98ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8821facab6ed48588d9d484b5e3d98ba", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8821facab6ed48588d9d484b5e3d98ba"}]}] Jul 20 19:59:01.596095 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1121196344 Jul 20 19:59:01.596095 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: 8821facab6ed48588d9d484b5e3d98ba Jul 20 19:59:01.596095 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1121196344 Jul 20 19:59:01.596095 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-ServerRescueNegativeTestJSON-1121196344-project Jul 20 19:59:01.596095 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 19:59:01.596095 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 19:59:01.596095 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: 9192f2842ca044f08e5f95f98f2e1b88 Jul 20 19:59:01.596095 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1121196344-project Jul 20 19:59:01.596095 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: > Jul 20 19:59:01.596095 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. Jul 20 19:59:01.596095 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'id': '2b8da868-71d1-49ad-be95-25d0a41393e9'} Jul 20 19:59:01.596972 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:59:01.596972 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:59:01.596972 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:59:01.596972 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:59:01.596972 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:59:01.596972 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:59:01.596972 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:59:01.596972 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:59:01.596972 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:59:01.596972 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:59:01.596972 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. Jul 20 19:59:01.596972 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.596972 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:59:01.596972 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.596972 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:59:01.596972 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:59:01.596972 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:59:01.596972 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:59:01.596972 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:59:01.596972 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:59:01.598260 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:59:01.598260 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:59:01.598260 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:59:01.598260 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:59:01.598260 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:59:01.598260 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:59:01.598260 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:59:01.598260 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. Jul 20 19:59:01.598260 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.598260 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:59:01.598260 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.598260 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:59:01.598260 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:59:01.598260 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:59:01.598260 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:59:01.598260 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:59:01.598260 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. Jul 20 19:59:01.598260 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.599384 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-8d27b8ab-a8b1-4573-8de8-a4648dbfae3a tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Returning 404 to user: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:59:01.599384 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-8d27b8ab-a8b1-4573-8de8-a4648dbfae3a tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9" status: 404 len: 111 microversion: 2.1 time: 0.031343 Jul 20 19:59:01.599384 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1635/2266] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:59:01 2022] GET /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:59:01.601257 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-76ea2912-2f35-4e19-8497-b2f4c6be3f73 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:59:01.602199 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-76ea2912-2f35-4e19-8497-b2f4c6be3f73 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:59:01.607807 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-76ea2912-2f35-4e19-8497-b2f4c6be3f73 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:59:01.608255 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-76ea2912-2f35-4e19-8497-b2f4c6be3f73 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:59:01.609009 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-76ea2912-2f35-4e19-8497-b2f4c6be3f73 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:59:01.609443 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-76ea2912-2f35-4e19-8497-b2f4c6be3f73 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:59:01.638262 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-76ea2912-2f35-4e19-8497-b2f4c6be3f73 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040741 Jul 20 19:59:01.638807 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1636/2267] 10.222.0.69 () {58 vars in 1301 bytes} [Wed Jul 20 19:59:01 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:59:01.643015 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-8d0cf733-b589-478e-9ec1-3daf79fffbcf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '.version_select at 0x7ff609fecf70>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:59:01.653299 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.wsgi [None req-8d0cf733-b589-478e-9ec1-3daf79fffbcf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] HTTP exception thrown: Keypair tempest-TestVolumeBootPattern-495469876 not found for user 8c67fe170c60476d88610d85f2528c52 Jul 20 19:59:01.655064 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-8d0cf733-b589-478e-9ec1-3daf79fffbcf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Request method failure captured: Jul 20 19:59:01.655064 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-495469876 HTTP/1.1 Jul 20 19:59:01.655064 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 19:59:01.655064 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 19:59:01.655064 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 19:59:01.655064 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 0 Jul 20 19:59:01.655064 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 19:59:01.655064 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 19:59:01.655064 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 19:59:01.655064 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 19:59:01.655064 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2FdVs7eM67G3Zazrj_GsNI3i4m-y-efJaSddI0Xv6CRjD4yd2s6wL8tBZ6J1lP1JcE-Z0KelK_x4rgOH83_SGm2Q_B0FQwtGNvnMavX0_Pu_FfJRr2tyHjewEt1Sj0gEQ1F4i50DsY9pQO0aod7uKcbHr0cFYew_ONOTFpjPqkoMjzM Jul 20 19:59:01.655064 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 19:59:01.655064 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 19:59:01.655064 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 19:59:01.655064 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 19:59:01.655064 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 19:59:01.655064 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 19:59:01.655064 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: 8064950f9a1942149aa8d6c08c206850 Jul 20 19:59:01.655064 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-TestVolumeBootPattern-439210935 Jul 20 19:59:01.655064 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 19:59:01.655064 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 19:59:01.656547 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8064950f9a1942149aa8d6c08c206850"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8064950f9a1942149aa8d6c08c206850"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8064950f9a1942149aa8d6c08c206850", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8064950f9a1942149aa8d6c08c206850"}]}] Jul 20 19:59:01.656547 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-TestVolumeBootPattern-439210935 Jul 20 19:59:01.656547 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: 8064950f9a1942149aa8d6c08c206850 Jul 20 19:59:01.656547 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-TestVolumeBootPattern-439210935 Jul 20 19:59:01.656547 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-TestVolumeBootPattern-439210935-project Jul 20 19:59:01.656547 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 19:59:01.656547 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 19:59:01.656547 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: 8c67fe170c60476d88610d85f2528c52 Jul 20 19:59:01.656547 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-TestVolumeBootPattern-439210935-project Jul 20 19:59:01.656547 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: Jul 20 19:59:01.656547 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Keypair tempest-TestVolumeBootPattern-495469876 not found for user 8c67fe170c60476d88610d85f2528c52 Jul 20 19:59:01.656547 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'id': 'tempest-TestVolumeBootPattern-495469876'} Jul 20 19:59:01.656547 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:59:01.658301 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:59:01.658301 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 164, in _delete Jul 20 19:59:01.658301 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Jul 20 19:59:01.658301 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 19:59:01.658301 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 19:59:01.658301 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 19:59:01.658301 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 19:59:01.658301 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 19:59:01.658301 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 19:59:01.658301 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 19:59:01.658301 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 19:59:01.658301 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6745, in delete_key_pair Jul 20 19:59:01.658301 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Jul 20 19:59:01.658301 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6766, in get_key_pair Jul 20 19:59:01.658301 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Jul 20 19:59:01.658301 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 19:59:01.658301 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 19:59:01.658301 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jul 20 19:59:01.658301 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jul 20 19:59:01.659533 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jul 20 19:59:01.659533 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jul 20 19:59:01.659533 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 19:59:01.659533 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 19:59:01.659533 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jul 20 19:59:01.659533 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jul 20 19:59:01.659533 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-TestVolumeBootPattern-495469876 not found for user 8c67fe170c60476d88610d85f2528c52 Jul 20 19:59:01.659533 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.659533 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:59:01.659533 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.659533 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:59:01.659533 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:59:01.659533 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:59:01.659533 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:59:01.659533 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:59:01.659533 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 19:59:01.659533 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 19:59:01.659533 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 19:59:01.659533 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 19:59:01.660805 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:59:01.660805 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:59:01.660805 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 137, in delete Jul 20 19:59:01.660805 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self._delete(req, id) Jul 20 19:59:01.660805 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 166, in _delete Jul 20 19:59:01.660805 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Jul 20 19:59:01.660805 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-TestVolumeBootPattern-495469876 not found for user 8c67fe170c60476d88610d85f2528c52 Jul 20 19:59:01.660805 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.660805 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:59:01.660805 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.660805 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:59:01.660805 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:59:01.660805 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:59:01.660805 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:59:01.660805 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:59:01.660805 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-TestVolumeBootPattern-495469876 not found for user 8c67fe170c60476d88610d85f2528c52 Jul 20 19:59:01.660805 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.662347 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-8d0cf733-b589-478e-9ec1-3daf79fffbcf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Returning 404 to user: Keypair tempest-TestVolumeBootPattern-495469876 not found for user 8c67fe170c60476d88610d85f2528c52 {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:59:01.662347 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-8d0cf733-b589-478e-9ec1-3daf79fffbcf tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-495469876" status: 404 len: 145 microversion: 2.1 time: 0.016695 Jul 20 19:59:01.662347 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1637/2268] 10.222.0.69 () {58 vars in 1259 bytes} [Wed Jul 20 19:59:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-495469876 => generated 145 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:59:01.662347 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-5fea0432-81fe-4ad6-b2fd-f41d49aaa914 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:59:01.662831 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-5fea0432-81fe-4ad6-b2fd-f41d49aaa914 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:59:01.669353 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5fea0432-81fe-4ad6-b2fd-f41d49aaa914 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:59:01.669832 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5fea0432-81fe-4ad6-b2fd-f41d49aaa914 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:59:01.670591 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5fea0432-81fe-4ad6-b2fd-f41d49aaa914 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:59:01.671023 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5fea0432-81fe-4ad6-b2fd-f41d49aaa914 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:59:01.700600 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-5fea0432-81fe-4ad6-b2fd-f41d49aaa914 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042739 Jul 20 19:59:01.701154 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1638/2269] 10.222.0.69 () {60 vars in 1342 bytes} [Wed Jul 20 19:59:01 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 19:59:01.705427 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-76652dd1-953c-4818-b208-0ce52b152938 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '.version_select at 0x7ff60a571ca0>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:59:01.715891 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.wsgi [None req-76652dd1-953c-4818-b208-0ce52b152938 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] HTTP exception thrown: Keypair tempest-TestShelveInstance-1245547191 not found for user 4d7204f863c64eeeb7dab59a30c447b8 Jul 20 19:59:01.717685 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-76652dd1-953c-4818-b208-0ce52b152938 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Request method failure captured: Jul 20 19:59:01.717685 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1245547191 HTTP/1.1 Jul 20 19:59:01.717685 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 19:59:01.717685 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 19:59:01.717685 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 19:59:01.717685 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 0 Jul 20 19:59:01.717685 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 19:59:01.717685 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 19:59:01.717685 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 19:59:01.717685 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 19:59:01.717685 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2Fdu0HiuH5KQppzr_EuhJcsw9wvAUMfmlXaunNxDv05d6CEWWJ64B3V4ShLvbdBjxBPFtwG1oeqUfcHYUP34DQduKIQwbY6I9S59QgvQ8ZJLUpq98bIrTZuBAQUBv5ehnSZY1v9pstAy2JtOPlBPa5cN1SAjn2UADZCDuAa7ElZDaMc Jul 20 19:59:01.717685 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 19:59:01.717685 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 19:59:01.717685 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 19:59:01.717685 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 19:59:01.717685 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 19:59:01.717685 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 19:59:01.717685 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: da296fe635c84b99b1645ceaf0138b83 Jul 20 19:59:01.717685 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-TestShelveInstance-1788616897 Jul 20 19:59:01.717685 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 19:59:01.717685 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 19:59:01.719798 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/da296fe635c84b99b1645ceaf0138b83"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/da296fe635c84b99b1645ceaf0138b83"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_da296fe635c84b99b1645ceaf0138b83", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/da296fe635c84b99b1645ceaf0138b83"}]}] Jul 20 19:59:01.719798 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-TestShelveInstance-1788616897 Jul 20 19:59:01.719798 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: da296fe635c84b99b1645ceaf0138b83 Jul 20 19:59:01.719798 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-TestShelveInstance-1788616897 Jul 20 19:59:01.719798 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-TestShelveInstance-1788616897-project Jul 20 19:59:01.719798 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 19:59:01.719798 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 19:59:01.719798 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: 4d7204f863c64eeeb7dab59a30c447b8 Jul 20 19:59:01.719798 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-TestShelveInstance-1788616897-project Jul 20 19:59:01.719798 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: Jul 20 19:59:01.719798 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Keypair tempest-TestShelveInstance-1245547191 not found for user 4d7204f863c64eeeb7dab59a30c447b8 Jul 20 19:59:01.719798 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'id': 'tempest-TestShelveInstance-1245547191'} Jul 20 19:59:01.719798 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:59:01.720979 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:59:01.720979 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 164, in _delete Jul 20 19:59:01.720979 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Jul 20 19:59:01.720979 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 19:59:01.720979 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 19:59:01.720979 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 19:59:01.720979 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 19:59:01.720979 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 19:59:01.720979 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 19:59:01.720979 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 19:59:01.720979 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 19:59:01.720979 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6745, in delete_key_pair Jul 20 19:59:01.720979 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Jul 20 19:59:01.720979 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6766, in get_key_pair Jul 20 19:59:01.720979 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Jul 20 19:59:01.720979 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 19:59:01.720979 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 19:59:01.720979 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jul 20 19:59:01.720979 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jul 20 19:59:01.722592 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jul 20 19:59:01.722592 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jul 20 19:59:01.722592 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 19:59:01.722592 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 19:59:01.722592 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jul 20 19:59:01.722592 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jul 20 19:59:01.722592 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-TestShelveInstance-1245547191 not found for user 4d7204f863c64eeeb7dab59a30c447b8 Jul 20 19:59:01.722592 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.722592 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:59:01.722592 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.722592 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:59:01.722592 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:59:01.722592 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:59:01.722592 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:59:01.722592 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:59:01.722592 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 19:59:01.722592 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 19:59:01.722592 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 19:59:01.722592 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 19:59:01.724145 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:59:01.724145 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:59:01.724145 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 137, in delete Jul 20 19:59:01.724145 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self._delete(req, id) Jul 20 19:59:01.724145 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 166, in _delete Jul 20 19:59:01.724145 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Jul 20 19:59:01.724145 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-TestShelveInstance-1245547191 not found for user 4d7204f863c64eeeb7dab59a30c447b8 Jul 20 19:59:01.724145 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.724145 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:59:01.724145 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.724145 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:59:01.724145 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:59:01.724145 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:59:01.724145 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:59:01.724145 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:59:01.724145 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-TestShelveInstance-1245547191 not found for user 4d7204f863c64eeeb7dab59a30c447b8 Jul 20 19:59:01.724145 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.725560 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-76652dd1-953c-4818-b208-0ce52b152938 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Returning 404 to user: Keypair tempest-TestShelveInstance-1245547191 not found for user 4d7204f863c64eeeb7dab59a30c447b8 {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:59:01.725560 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-76652dd1-953c-4818-b208-0ce52b152938 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1245547191" status: 404 len: 143 microversion: 2.1 time: 0.017217 Jul 20 19:59:01.725560 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1639/2270] 10.222.0.69 () {58 vars in 1253 bytes} [Wed Jul 20 19:59:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1245547191 => generated 143 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:59:01.725560 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-af39d45c-556c-4373-a3eb-467ccc45348b tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:59:01.725560 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-af39d45c-556c-4373-a3eb-467ccc45348b tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 2b8da868-71d1-49ad-be95-25d0a41393e9] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:59:01.731137 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-af39d45c-556c-4373-a3eb-467ccc45348b tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:59:01.731587 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-af39d45c-556c-4373-a3eb-467ccc45348b tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:59:01.732382 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-af39d45c-556c-4373-a3eb-467ccc45348b tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:59:01.732849 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-af39d45c-556c-4373-a3eb-467ccc45348b tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:59:01.746232 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.wsgi [None req-af39d45c-556c-4373-a3eb-467ccc45348b tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] HTTP exception thrown: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. Jul 20 19:59:01.747764 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-af39d45c-556c-4373-a3eb-467ccc45348b tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Request method failure captured: Jul 20 19:59:01.747764 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: GET /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9 HTTP/1.1 Jul 20 19:59:01.747764 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 19:59:01.747764 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 19:59:01.747764 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 19:59:01.747764 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 0 Jul 20 19:59:01.747764 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 19:59:01.747764 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 19:59:01.747764 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 19:59:01.747764 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 19:59:01.747764 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2FZGdJT3PjrXOalhxF4cK7yFRY_rdKs7nWDyfOnHDqihLmSc76hrlTVi8pwFl4fc0_PdYOdKi8ehCojNmpTfeHu0z7420hnbFU_7tQyUQZJWpu7NkYJxMVzpGVG2-8TAgdTN19E5_16lQGWKKWKpZnKtS08L9dJthhYfMLyISTLj6Mc Jul 20 19:59:01.747764 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 19:59:01.747764 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 19:59:01.747764 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 19:59:01.747764 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 19:59:01.747764 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 19:59:01.747764 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 19:59:01.747764 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: 8821facab6ed48588d9d484b5e3d98ba Jul 20 19:59:01.747764 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1121196344 Jul 20 19:59:01.747764 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 19:59:01.747764 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 19:59:01.749535 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8821facab6ed48588d9d484b5e3d98ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8821facab6ed48588d9d484b5e3d98ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8821facab6ed48588d9d484b5e3d98ba", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8821facab6ed48588d9d484b5e3d98ba"}]}] Jul 20 19:59:01.749535 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1121196344 Jul 20 19:59:01.749535 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: 8821facab6ed48588d9d484b5e3d98ba Jul 20 19:59:01.749535 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1121196344 Jul 20 19:59:01.749535 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-ServerRescueNegativeTestJSON-1121196344-project Jul 20 19:59:01.749535 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 19:59:01.749535 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 19:59:01.749535 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: 9192f2842ca044f08e5f95f98f2e1b88 Jul 20 19:59:01.749535 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1121196344-project Jul 20 19:59:01.749535 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: > Jul 20 19:59:01.749535 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. Jul 20 19:59:01.749535 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'id': '2b8da868-71d1-49ad-be95-25d0a41393e9'} Jul 20 19:59:01.750393 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:59:01.750393 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:59:01.750393 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:59:01.750393 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:59:01.750393 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:59:01.750393 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:59:01.750393 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:59:01.750393 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:59:01.750393 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:59:01.750393 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:59:01.750393 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. Jul 20 19:59:01.750393 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.750393 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:59:01.750393 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.750393 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:59:01.750393 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:59:01.750393 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:59:01.750393 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:59:01.750393 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:59:01.750393 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:59:01.751760 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:59:01.751760 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:59:01.751760 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:59:01.751760 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:59:01.751760 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:59:01.751760 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:59:01.751760 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:59:01.751760 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. Jul 20 19:59:01.751760 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.751760 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:59:01.751760 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.751760 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:59:01.751760 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:59:01.751760 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:59:01.751760 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:59:01.751760 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:59:01.751760 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. Jul 20 19:59:01.751760 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.753228 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-af39d45c-556c-4373-a3eb-467ccc45348b tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Returning 404 to user: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:59:01.753228 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-af39d45c-556c-4373-a3eb-467ccc45348b tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9" status: 404 len: 111 microversion: 2.1 time: 0.028471 Jul 20 19:59:01.753228 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1640/2271] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:59:01 2022] GET /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:59:01.754094 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-9376be7b-6f4b-4c30-a494-204a07701f8c tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:59:01.754989 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-9376be7b-6f4b-4c30-a494-204a07701f8c tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:59:01.761201 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9376be7b-6f4b-4c30-a494-204a07701f8c tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:59:01.761699 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9376be7b-6f4b-4c30-a494-204a07701f8c tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:59:01.762460 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9376be7b-6f4b-4c30-a494-204a07701f8c tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:59:01.762897 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9376be7b-6f4b-4c30-a494-204a07701f8c tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:59:01.793074 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-9376be7b-6f4b-4c30-a494-204a07701f8c tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042377 Jul 20 19:59:01.793565 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1641/2272] 10.222.0.69 () {58 vars in 1301 bytes} [Wed Jul 20 19:59:01 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:59:01.797787 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-43228c54-99c4-47a1-aa66-e21cdb11e8fc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '.version_select at 0x7ff60a571a60>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:59:01.807446 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.wsgi [None req-43228c54-99c4-47a1-aa66-e21cdb11e8fc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] HTTP exception thrown: Keypair tempest-TestVolumeBootPattern-495469876 not found for user 8c67fe170c60476d88610d85f2528c52 Jul 20 19:59:01.809175 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-43228c54-99c4-47a1-aa66-e21cdb11e8fc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Request method failure captured: Jul 20 19:59:01.809175 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-495469876 HTTP/1.1 Jul 20 19:59:01.809175 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 19:59:01.809175 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 19:59:01.809175 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 19:59:01.809175 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 0 Jul 20 19:59:01.809175 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 19:59:01.809175 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 19:59:01.809175 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 19:59:01.809175 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 19:59:01.809175 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2FdVs7eM67G3Zazrj_GsNI3i4m-y-efJaSddI0Xv6CRjD4yd2s6wL8tBZ6J1lP1JcE-Z0KelK_x4rgOH83_SGm2Q_B0FQwtGNvnMavX0_Pu_FfJRr2tyHjewEt1Sj0gEQ1F4i50DsY9pQO0aod7uKcbHr0cFYew_ONOTFpjPqkoMjzM Jul 20 19:59:01.809175 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 19:59:01.809175 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 19:59:01.809175 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 19:59:01.809175 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 19:59:01.809175 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 19:59:01.809175 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 19:59:01.809175 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: 8064950f9a1942149aa8d6c08c206850 Jul 20 19:59:01.809175 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-TestVolumeBootPattern-439210935 Jul 20 19:59:01.809175 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 19:59:01.809175 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 19:59:01.810970 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8064950f9a1942149aa8d6c08c206850"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8064950f9a1942149aa8d6c08c206850"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8064950f9a1942149aa8d6c08c206850", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8064950f9a1942149aa8d6c08c206850"}]}] Jul 20 19:59:01.810970 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-TestVolumeBootPattern-439210935 Jul 20 19:59:01.810970 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: 8064950f9a1942149aa8d6c08c206850 Jul 20 19:59:01.810970 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-TestVolumeBootPattern-439210935 Jul 20 19:59:01.810970 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-TestVolumeBootPattern-439210935-project Jul 20 19:59:01.810970 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 19:59:01.810970 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 19:59:01.810970 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: 8c67fe170c60476d88610d85f2528c52 Jul 20 19:59:01.810970 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-TestVolumeBootPattern-439210935-project Jul 20 19:59:01.810970 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: Jul 20 19:59:01.810970 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Keypair tempest-TestVolumeBootPattern-495469876 not found for user 8c67fe170c60476d88610d85f2528c52 Jul 20 19:59:01.810970 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'id': 'tempest-TestVolumeBootPattern-495469876'} Jul 20 19:59:01.810970 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:59:01.812031 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:59:01.812031 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 164, in _delete Jul 20 19:59:01.812031 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Jul 20 19:59:01.812031 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 19:59:01.812031 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 19:59:01.812031 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 19:59:01.812031 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 19:59:01.812031 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 19:59:01.812031 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 19:59:01.812031 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 19:59:01.812031 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 19:59:01.812031 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6745, in delete_key_pair Jul 20 19:59:01.812031 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Jul 20 19:59:01.812031 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6766, in get_key_pair Jul 20 19:59:01.812031 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Jul 20 19:59:01.812031 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 19:59:01.812031 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 19:59:01.812031 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jul 20 19:59:01.812031 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jul 20 19:59:01.813667 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jul 20 19:59:01.813667 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jul 20 19:59:01.813667 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 19:59:01.813667 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 19:59:01.813667 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jul 20 19:59:01.813667 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jul 20 19:59:01.813667 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-TestVolumeBootPattern-495469876 not found for user 8c67fe170c60476d88610d85f2528c52 Jul 20 19:59:01.813667 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.813667 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:59:01.813667 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.813667 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:59:01.813667 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:59:01.813667 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:59:01.813667 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:59:01.813667 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:59:01.813667 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 19:59:01.813667 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 19:59:01.813667 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 19:59:01.813667 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 19:59:01.815182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:59:01.815182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:59:01.815182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 137, in delete Jul 20 19:59:01.815182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self._delete(req, id) Jul 20 19:59:01.815182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 166, in _delete Jul 20 19:59:01.815182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Jul 20 19:59:01.815182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-TestVolumeBootPattern-495469876 not found for user 8c67fe170c60476d88610d85f2528c52 Jul 20 19:59:01.815182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.815182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:59:01.815182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.815182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:59:01.815182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:59:01.815182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:59:01.815182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:59:01.815182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:59:01.815182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-TestVolumeBootPattern-495469876 not found for user 8c67fe170c60476d88610d85f2528c52 Jul 20 19:59:01.815182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.816552 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-43228c54-99c4-47a1-aa66-e21cdb11e8fc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Returning 404 to user: Keypair tempest-TestVolumeBootPattern-495469876 not found for user 8c67fe170c60476d88610d85f2528c52 {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:59:01.816552 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-43228c54-99c4-47a1-aa66-e21cdb11e8fc tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-495469876" status: 404 len: 145 microversion: 2.1 time: 0.016081 Jul 20 19:59:01.816552 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1642/2273] 10.222.0.69 () {58 vars in 1259 bytes} [Wed Jul 20 19:59:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-495469876 => generated 145 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:59:01.816552 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-485b8061-8420-4a01-a963-c2c8c1c152b8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Calling method '.version_select at 0x7ff609fec310>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:59:01.825468 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.wsgi [None req-485b8061-8420-4a01-a963-c2c8c1c152b8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] HTTP exception thrown: Keypair tempest-TestShelveInstance-1245547191 not found for user 4d7204f863c64eeeb7dab59a30c447b8 Jul 20 19:59:01.827190 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-485b8061-8420-4a01-a963-c2c8c1c152b8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Request method failure captured: Jul 20 19:59:01.827190 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1245547191 HTTP/1.1 Jul 20 19:59:01.827190 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 19:59:01.827190 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 19:59:01.827190 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 19:59:01.827190 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 0 Jul 20 19:59:01.827190 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 19:59:01.827190 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 19:59:01.827190 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 19:59:01.827190 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 19:59:01.827190 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2Fdu0HiuH5KQppzr_EuhJcsw9wvAUMfmlXaunNxDv05d6CEWWJ64B3V4ShLvbdBjxBPFtwG1oeqUfcHYUP34DQduKIQwbY6I9S59QgvQ8ZJLUpq98bIrTZuBAQUBv5ehnSZY1v9pstAy2JtOPlBPa5cN1SAjn2UADZCDuAa7ElZDaMc Jul 20 19:59:01.827190 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 19:59:01.827190 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 19:59:01.827190 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 19:59:01.827190 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 19:59:01.827190 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 19:59:01.827190 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 19:59:01.827190 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: da296fe635c84b99b1645ceaf0138b83 Jul 20 19:59:01.827190 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-TestShelveInstance-1788616897 Jul 20 19:59:01.827190 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 19:59:01.827190 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 19:59:01.828873 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/da296fe635c84b99b1645ceaf0138b83"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/da296fe635c84b99b1645ceaf0138b83"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_da296fe635c84b99b1645ceaf0138b83", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/da296fe635c84b99b1645ceaf0138b83"}]}] Jul 20 19:59:01.828873 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-TestShelveInstance-1788616897 Jul 20 19:59:01.828873 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: da296fe635c84b99b1645ceaf0138b83 Jul 20 19:59:01.828873 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-TestShelveInstance-1788616897 Jul 20 19:59:01.828873 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-TestShelveInstance-1788616897-project Jul 20 19:59:01.828873 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 19:59:01.828873 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 19:59:01.828873 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: 4d7204f863c64eeeb7dab59a30c447b8 Jul 20 19:59:01.828873 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-TestShelveInstance-1788616897-project Jul 20 19:59:01.828873 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: Jul 20 19:59:01.828873 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Keypair tempest-TestShelveInstance-1245547191 not found for user 4d7204f863c64eeeb7dab59a30c447b8 Jul 20 19:59:01.828873 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'id': 'tempest-TestShelveInstance-1245547191'} Jul 20 19:59:01.828873 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:59:01.830158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:59:01.830158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 164, in _delete Jul 20 19:59:01.830158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Jul 20 19:59:01.830158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 19:59:01.830158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 19:59:01.830158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 19:59:01.830158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 19:59:01.830158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 19:59:01.830158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 19:59:01.830158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 19:59:01.830158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 19:59:01.830158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6745, in delete_key_pair Jul 20 19:59:01.830158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Jul 20 19:59:01.830158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6766, in get_key_pair Jul 20 19:59:01.830158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Jul 20 19:59:01.830158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 19:59:01.830158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 19:59:01.830158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jul 20 19:59:01.830158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jul 20 19:59:01.831680 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jul 20 19:59:01.831680 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jul 20 19:59:01.831680 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 19:59:01.831680 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 19:59:01.831680 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jul 20 19:59:01.831680 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jul 20 19:59:01.831680 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-TestShelveInstance-1245547191 not found for user 4d7204f863c64eeeb7dab59a30c447b8 Jul 20 19:59:01.831680 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.831680 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:59:01.831680 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.831680 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:59:01.831680 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:59:01.831680 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:59:01.831680 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:59:01.831680 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:59:01.831680 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 19:59:01.831680 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 19:59:01.831680 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 19:59:01.831680 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 19:59:01.833915 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:59:01.833915 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:59:01.833915 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 137, in delete Jul 20 19:59:01.833915 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self._delete(req, id) Jul 20 19:59:01.833915 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 166, in _delete Jul 20 19:59:01.833915 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Jul 20 19:59:01.833915 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-TestShelveInstance-1245547191 not found for user 4d7204f863c64eeeb7dab59a30c447b8 Jul 20 19:59:01.833915 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.833915 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:59:01.833915 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.833915 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:59:01.833915 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:59:01.833915 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:59:01.833915 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:59:01.833915 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:59:01.833915 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-TestShelveInstance-1245547191 not found for user 4d7204f863c64eeeb7dab59a30c447b8 Jul 20 19:59:01.833915 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.835247 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-485b8061-8420-4a01-a963-c2c8c1c152b8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] Returning 404 to user: Keypair tempest-TestShelveInstance-1245547191 not found for user 4d7204f863c64eeeb7dab59a30c447b8 {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:59:01.835247 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-485b8061-8420-4a01-a963-c2c8c1c152b8 tempest-TestShelveInstance-1788616897 tempest-TestShelveInstance-1788616897-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1245547191" status: 404 len: 143 microversion: 2.1 time: 0.016633 Jul 20 19:59:01.835247 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1643/2274] 10.222.0.69 () {58 vars in 1253 bytes} [Wed Jul 20 19:59:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1245547191 => generated 143 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:59:01.835247 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-320fdd8c-02d7-4cb9-b385-8bbb11972e65 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:59:01.835247 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-320fdd8c-02d7-4cb9-b385-8bbb11972e65 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 2b8da868-71d1-49ad-be95-25d0a41393e9] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:59:01.844618 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-320fdd8c-02d7-4cb9-b385-8bbb11972e65 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:59:01.845068 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-320fdd8c-02d7-4cb9-b385-8bbb11972e65 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:59:01.845875 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-320fdd8c-02d7-4cb9-b385-8bbb11972e65 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:59:01.846316 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-320fdd8c-02d7-4cb9-b385-8bbb11972e65 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:59:01.861132 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.wsgi [None req-320fdd8c-02d7-4cb9-b385-8bbb11972e65 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] HTTP exception thrown: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. Jul 20 19:59:01.862789 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-320fdd8c-02d7-4cb9-b385-8bbb11972e65 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Request method failure captured: Jul 20 19:59:01.862789 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: GET /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9 HTTP/1.1 Jul 20 19:59:01.862789 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 19:59:01.862789 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 19:59:01.862789 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 19:59:01.862789 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 0 Jul 20 19:59:01.862789 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 19:59:01.862789 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 19:59:01.862789 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 19:59:01.862789 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 19:59:01.862789 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2FZGdJT3PjrXOalhxF4cK7yFRY_rdKs7nWDyfOnHDqihLmSc76hrlTVi8pwFl4fc0_PdYOdKi8ehCojNmpTfeHu0z7420hnbFU_7tQyUQZJWpu7NkYJxMVzpGVG2-8TAgdTN19E5_16lQGWKKWKpZnKtS08L9dJthhYfMLyISTLj6Mc Jul 20 19:59:01.862789 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 19:59:01.862789 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 19:59:01.862789 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 19:59:01.862789 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 19:59:01.862789 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 19:59:01.862789 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 19:59:01.862789 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: 8821facab6ed48588d9d484b5e3d98ba Jul 20 19:59:01.862789 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1121196344 Jul 20 19:59:01.862789 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 19:59:01.862789 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 19:59:01.870406 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8821facab6ed48588d9d484b5e3d98ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8821facab6ed48588d9d484b5e3d98ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8821facab6ed48588d9d484b5e3d98ba", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8821facab6ed48588d9d484b5e3d98ba"}]}] Jul 20 19:59:01.870406 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1121196344 Jul 20 19:59:01.870406 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: 8821facab6ed48588d9d484b5e3d98ba Jul 20 19:59:01.870406 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1121196344 Jul 20 19:59:01.870406 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-ServerRescueNegativeTestJSON-1121196344-project Jul 20 19:59:01.870406 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 19:59:01.870406 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 19:59:01.870406 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: 9192f2842ca044f08e5f95f98f2e1b88 Jul 20 19:59:01.870406 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1121196344-project Jul 20 19:59:01.870406 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: > Jul 20 19:59:01.870406 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. Jul 20 19:59:01.870406 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'id': '2b8da868-71d1-49ad-be95-25d0a41393e9'} Jul 20 19:59:01.872099 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:59:01.872099 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:59:01.872099 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:59:01.872099 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:59:01.872099 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:59:01.872099 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:59:01.872099 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:59:01.872099 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:59:01.872099 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:59:01.872099 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:59:01.872099 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. Jul 20 19:59:01.872099 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.872099 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:59:01.872099 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.872099 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:59:01.872099 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:59:01.872099 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:59:01.872099 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:59:01.872099 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:59:01.872099 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:59:01.874978 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:59:01.874978 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:59:01.874978 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:59:01.874978 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:59:01.874978 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:59:01.874978 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:59:01.874978 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:59:01.874978 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. Jul 20 19:59:01.874978 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.874978 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:59:01.874978 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.874978 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:59:01.874978 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:59:01.874978 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:59:01.874978 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:59:01.874978 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:59:01.874978 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. Jul 20 19:59:01.874978 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.877116 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-320fdd8c-02d7-4cb9-b385-8bbb11972e65 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Returning 404 to user: Instance 2b8da868-71d1-49ad-be95-25d0a41393e9 could not be found. {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:59:01.877116 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-320fdd8c-02d7-4cb9-b385-8bbb11972e65 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9" status: 404 len: 111 microversion: 2.1 time: 0.034242 Jul 20 19:59:01.877116 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1644/2275] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 19:59:01 2022] GET /compute/v2.1/servers/2b8da868-71d1-49ad-be95-25d0a41393e9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:59:01.877116 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-23e523d2-f623-4a2c-9cae-8a100e792d7b tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:59:01.877116 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-23e523d2-f623-4a2c-9cae-8a100e792d7b tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:59:01.877853 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-23e523d2-f623-4a2c-9cae-8a100e792d7b tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:59:01.878031 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-23e523d2-f623-4a2c-9cae-8a100e792d7b tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:59:01.878673 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-23e523d2-f623-4a2c-9cae-8a100e792d7b tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:59:01.879104 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-23e523d2-f623-4a2c-9cae-8a100e792d7b tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:59:01.908412 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-23e523d2-f623-4a2c-9cae-8a100e792d7b tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041594 Jul 20 19:59:01.909150 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1645/2276] 10.222.0.69 () {58 vars in 1301 bytes} [Wed Jul 20 19:59:01 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:59:01.913659 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-cd743e93-1ad5-46aa-90ba-042743235460 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Calling method '.version_select at 0x7ff609fb3d30>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:59:01.923468 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.wsgi [None req-cd743e93-1ad5-46aa-90ba-042743235460 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] HTTP exception thrown: Keypair tempest-TestVolumeBootPattern-495469876 not found for user 8c67fe170c60476d88610d85f2528c52 Jul 20 19:59:01.925194 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-cd743e93-1ad5-46aa-90ba-042743235460 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Request method failure captured: Jul 20 19:59:01.925194 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-495469876 HTTP/1.1 Jul 20 19:59:01.925194 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 19:59:01.925194 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 19:59:01.925194 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 19:59:01.925194 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 0 Jul 20 19:59:01.925194 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 19:59:01.925194 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 19:59:01.925194 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 19:59:01.925194 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 19:59:01.925194 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2FdVs7eM67G3Zazrj_GsNI3i4m-y-efJaSddI0Xv6CRjD4yd2s6wL8tBZ6J1lP1JcE-Z0KelK_x4rgOH83_SGm2Q_B0FQwtGNvnMavX0_Pu_FfJRr2tyHjewEt1Sj0gEQ1F4i50DsY9pQO0aod7uKcbHr0cFYew_ONOTFpjPqkoMjzM Jul 20 19:59:01.925194 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 19:59:01.925194 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 19:59:01.925194 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 19:59:01.925194 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 19:59:01.925194 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 19:59:01.925194 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 19:59:01.925194 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: 8064950f9a1942149aa8d6c08c206850 Jul 20 19:59:01.925194 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-TestVolumeBootPattern-439210935 Jul 20 19:59:01.925194 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 19:59:01.925194 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 19:59:01.927578 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8064950f9a1942149aa8d6c08c206850"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8064950f9a1942149aa8d6c08c206850"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8064950f9a1942149aa8d6c08c206850", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8064950f9a1942149aa8d6c08c206850"}]}] Jul 20 19:59:01.927578 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-TestVolumeBootPattern-439210935 Jul 20 19:59:01.927578 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: 8064950f9a1942149aa8d6c08c206850 Jul 20 19:59:01.927578 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-TestVolumeBootPattern-439210935 Jul 20 19:59:01.927578 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-TestVolumeBootPattern-439210935-project Jul 20 19:59:01.927578 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 19:59:01.927578 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 19:59:01.927578 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: 8c67fe170c60476d88610d85f2528c52 Jul 20 19:59:01.927578 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-TestVolumeBootPattern-439210935-project Jul 20 19:59:01.927578 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: Jul 20 19:59:01.927578 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Keypair tempest-TestVolumeBootPattern-495469876 not found for user 8c67fe170c60476d88610d85f2528c52 Jul 20 19:59:01.927578 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'id': 'tempest-TestVolumeBootPattern-495469876'} Jul 20 19:59:01.927578 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:59:01.929727 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:59:01.929727 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 164, in _delete Jul 20 19:59:01.929727 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Jul 20 19:59:01.929727 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 19:59:01.929727 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 19:59:01.929727 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 19:59:01.929727 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 19:59:01.929727 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 19:59:01.929727 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 19:59:01.929727 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 19:59:01.929727 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 19:59:01.929727 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6745, in delete_key_pair Jul 20 19:59:01.929727 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Jul 20 19:59:01.929727 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6766, in get_key_pair Jul 20 19:59:01.929727 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Jul 20 19:59:01.929727 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 19:59:01.929727 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 19:59:01.929727 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jul 20 19:59:01.929727 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jul 20 19:59:01.931360 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jul 20 19:59:01.931360 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jul 20 19:59:01.931360 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 19:59:01.931360 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 19:59:01.931360 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jul 20 19:59:01.931360 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jul 20 19:59:01.931360 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-TestVolumeBootPattern-495469876 not found for user 8c67fe170c60476d88610d85f2528c52 Jul 20 19:59:01.931360 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.931360 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:59:01.931360 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.931360 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:59:01.931360 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:59:01.931360 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:59:01.931360 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:59:01.931360 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:59:01.931360 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 19:59:01.931360 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 19:59:01.931360 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 19:59:01.931360 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 19:59:01.932957 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:59:01.932957 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:59:01.932957 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 137, in delete Jul 20 19:59:01.932957 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self._delete(req, id) Jul 20 19:59:01.932957 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 166, in _delete Jul 20 19:59:01.932957 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Jul 20 19:59:01.932957 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-TestVolumeBootPattern-495469876 not found for user 8c67fe170c60476d88610d85f2528c52 Jul 20 19:59:01.932957 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.932957 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:59:01.932957 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.932957 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:59:01.932957 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:59:01.932957 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:59:01.932957 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:59:01.932957 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:59:01.932957 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-TestVolumeBootPattern-495469876 not found for user 8c67fe170c60476d88610d85f2528c52 Jul 20 19:59:01.932957 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 19:59:01.934360 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-cd743e93-1ad5-46aa-90ba-042743235460 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] Returning 404 to user: Keypair tempest-TestVolumeBootPattern-495469876 not found for user 8c67fe170c60476d88610d85f2528c52 {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:59:01.934360 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-cd743e93-1ad5-46aa-90ba-042743235460 tempest-TestVolumeBootPattern-439210935 tempest-TestVolumeBootPattern-439210935-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-495469876" status: 404 len: 145 microversion: 2.1 time: 0.016608 Jul 20 19:59:01.934360 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1646/2277] 10.222.0.69 () {58 vars in 1259 bytes} [Wed Jul 20 19:59:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-495469876 => generated 145 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:59:01.934360 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-5d9e052a-a1e4-480a-85ba-d807c6212b19 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '.version_select at 0x7ff60a266d30>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:59:01.950642 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-5d9e052a-a1e4-480a-85ba-d807c6212b19 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2006040141" status: 202 len: 0 microversion: 2.1 time: 0.021796 Jul 20 19:59:01.951431 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1647/2278] 10.222.0.69 () {58 vars in 1220 bytes} [Wed Jul 20 19:59:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2006040141 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 19:59:02.922644 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d2c4c7d9-edba-4c77-adcc-dd4a67fbfaa0 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:59:02.923809 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d2c4c7d9-edba-4c77-adcc-dd4a67fbfaa0 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:59:02.930977 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d2c4c7d9-edba-4c77-adcc-dd4a67fbfaa0 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:59:02.931429 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d2c4c7d9-edba-4c77-adcc-dd4a67fbfaa0 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:59:02.932192 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d2c4c7d9-edba-4c77-adcc-dd4a67fbfaa0 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:59:02.932633 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d2c4c7d9-edba-4c77-adcc-dd4a67fbfaa0 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:59:03.014361 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d2c4c7d9-edba-4c77-adcc-dd4a67fbfaa0 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "POST /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a/action" status: 200 len: 76440 microversion: 2.1 time: 0.096211 Jul 20 19:59:03.021548 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1648/2279] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Jul 20 19:59:02 2022] POST /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a/action => generated 76440 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 20:00:55.582985 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=3 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 20:00:55.583873 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=32 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 20:00:55.588027 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-82638b6c-a313-40ff-9d3e-e300e2f54ade tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:00:55.588615 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-82638b6c-a313-40ff-9d3e-e300e2f54ade tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:00:55.597426 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-82638b6c-a313-40ff-9d3e-e300e2f54ade tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:00:55.597897 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-82638b6c-a313-40ff-9d3e-e300e2f54ade tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:00:55.598666 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-82638b6c-a313-40ff-9d3e-e300e2f54ade tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:00:55.599096 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-82638b6c-a313-40ff-9d3e-e300e2f54ade tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:00:55.626504 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-82638b6c-a313-40ff-9d3e-e300e2f54ade tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Going to try to terminate instance {{(pid=117761) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 20:00:55.704116 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-82638b6c-a313-40ff-9d3e-e300e2f54ade tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "DELETE /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 204 len: 0 microversion: 2.1 time: 0.123091 Jul 20 20:00:55.704765 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1649/2280] 10.222.0.69 () {58 vars in 1238 bytes} [Wed Jul 20 20:00:55 2022] DELETE /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 20:00:55.712913 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-8198cdf0-e795-41c0-a0c4-6316f2ba953c tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:00:55.713633 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-8198cdf0-e795-41c0-a0c4-6316f2ba953c tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:00:55.719801 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8198cdf0-e795-41c0-a0c4-6316f2ba953c tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:00:55.720241 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8198cdf0-e795-41c0-a0c4-6316f2ba953c tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:00:55.720990 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8198cdf0-e795-41c0-a0c4-6316f2ba953c tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:00:55.721417 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8198cdf0-e795-41c0-a0c4-6316f2ba953c tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:00:56.047528 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8198cdf0-e795-41c0-a0c4-6316f2ba953c tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:00:56.055111 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-8198cdf0-e795-41c0-a0c4-6316f2ba953c tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1506 microversion: 2.1 time: 0.346150 Jul 20 20:00:56.055711 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1650/2281] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:00:55 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1506 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 20:00:57.072228 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-6b526feb-39af-47c0-ae45-d388181ae26d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:00:57.072919 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-6b526feb-39af-47c0-ae45-d388181ae26d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:00:57.080676 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6b526feb-39af-47c0-ae45-d388181ae26d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:00:57.081074 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6b526feb-39af-47c0-ae45-d388181ae26d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:00:57.082063 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6b526feb-39af-47c0-ae45-d388181ae26d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:00:57.082710 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6b526feb-39af-47c0-ae45-d388181ae26d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:00:57.352092 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6b526feb-39af-47c0-ae45-d388181ae26d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:00:57.363536 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-6b526feb-39af-47c0-ae45-d388181ae26d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 200 len: 1506 microversion: 2.1 time: 0.295170 Jul 20 20:00:57.364112 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1651/2282] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:00:57 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 1506 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 20:00:57.368642 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [req-61ff32fa-2c22-4638-b430-12d4b8030420 req-e8d4c3c9-55ea-4ced-9186-e8ed53b941ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "689a26d3-0640-4e71-acf6-10bda1f0f4fc", "name": "network-vif-deleted", "tag": "64f9d89f-7304-4e79-86e7-8900cf5f72fc"}]} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 20:00:57.377051 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-61ff32fa-2c22-4638-b430-12d4b8030420 req-e8d4c3c9-55ea-4ced-9186-e8ed53b941ce service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:00:57.377488 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-61ff32fa-2c22-4638-b430-12d4b8030420 req-e8d4c3c9-55ea-4ced-9186-e8ed53b941ce service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:00:57.388177 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.compute.server_external_events [req-61ff32fa-2c22-4638-b430-12d4b8030420 req-e8d4c3c9-55ea-4ced-9186-e8ed53b941ce service nova] Creating event network-vif-deleted:64f9d89f-7304-4e79-86e7-8900cf5f72fc for instance 689a26d3-0640-4e71-acf6-10bda1f0f4fc on hv-cinder-83538 Jul 20 20:00:57.393978 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [req-61ff32fa-2c22-4638-b430-12d4b8030420 req-e8d4c3c9-55ea-4ced-9186-e8ed53b941ce service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028605 Jul 20 20:00:57.394570 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1652/2283] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 20:00:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 20:00:58.382306 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-27afa7f4-409b-4205-8f38-0a739b4387b7 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:00:58.383286 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-27afa7f4-409b-4205-8f38-0a739b4387b7 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 689a26d3-0640-4e71-acf6-10bda1f0f4fc] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:00:58.389040 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-27afa7f4-409b-4205-8f38-0a739b4387b7 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:00:58.389488 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-27afa7f4-409b-4205-8f38-0a739b4387b7 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:00:58.390286 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-27afa7f4-409b-4205-8f38-0a739b4387b7 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:00:58.391414 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-27afa7f4-409b-4205-8f38-0a739b4387b7 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:00:58.405146 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.wsgi [None req-27afa7f4-409b-4205-8f38-0a739b4387b7 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] HTTP exception thrown: Instance 689a26d3-0640-4e71-acf6-10bda1f0f4fc could not be found. Jul 20 20:00:58.407339 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-27afa7f4-409b-4205-8f38-0a739b4387b7 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Request method failure captured: Jul 20 20:00:58.407339 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc HTTP/1.1 Jul 20 20:00:58.407339 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 20:00:58.407339 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 20:00:58.407339 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 20:00:58.407339 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 0 Jul 20 20:00:58.407339 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 20:00:58.407339 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 20:00:58.407339 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 20:00:58.407339 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 20:00:58.407339 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2FZGdJT3PjrXOalhxF4cK7yFRY_rdKs7nWDyfOnHDqihLmSc76hrlTVi8pwFl4fc0_PdYOdKi8ehCojNmpTfeHu0z7420hnbFU_7tQyUQZJWpu7NkYJxMVzpGVG2-8TAgdTN19E5_16lQGWKKWKpZnKtS08L9dJthhYfMLyISTLj6Mc Jul 20 20:00:58.407339 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 20:00:58.407339 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 20:00:58.407339 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 20:00:58.407339 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 20:00:58.407339 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 20:00:58.407339 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 20:00:58.407339 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: 8821facab6ed48588d9d484b5e3d98ba Jul 20 20:00:58.407339 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1121196344 Jul 20 20:00:58.407339 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 20:00:58.407339 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 20:00:58.409470 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8821facab6ed48588d9d484b5e3d98ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8821facab6ed48588d9d484b5e3d98ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8821facab6ed48588d9d484b5e3d98ba", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8821facab6ed48588d9d484b5e3d98ba"}]}] Jul 20 20:00:58.409470 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1121196344 Jul 20 20:00:58.409470 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: 8821facab6ed48588d9d484b5e3d98ba Jul 20 20:00:58.409470 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1121196344 Jul 20 20:00:58.409470 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-ServerRescueNegativeTestJSON-1121196344-project Jul 20 20:00:58.409470 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 20:00:58.409470 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 20:00:58.409470 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: 9192f2842ca044f08e5f95f98f2e1b88 Jul 20 20:00:58.409470 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1121196344-project Jul 20 20:00:58.409470 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: > Jul 20 20:00:58.409470 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Instance 689a26d3-0640-4e71-acf6-10bda1f0f4fc could not be found. Jul 20 20:00:58.409470 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'id': '689a26d3-0640-4e71-acf6-10bda1f0f4fc'} Jul 20 20:00:58.410796 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 20:00:58.410796 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:00:58.410796 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 20:00:58.410796 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 20:00:58.410796 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 20:00:58.410796 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 20:00:58.410796 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 20:00:58.410796 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 20:00:58.410796 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 20:00:58.410796 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 20:00:58.410796 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 689a26d3-0640-4e71-acf6-10bda1f0f4fc could not be found. Jul 20 20:00:58.410796 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:00:58.410796 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:00:58.410796 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:00:58.410796 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:00:58.410796 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:00:58.410796 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:00:58.410796 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 20:00:58.410796 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 20:00:58.410796 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 20:00:58.412580 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 20:00:58.412580 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 20:00:58.412580 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 20:00:58.412580 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 20:00:58.412580 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 20:00:58.412580 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 20:00:58.412580 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 20:00:58.412580 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 689a26d3-0640-4e71-acf6-10bda1f0f4fc could not be found. Jul 20 20:00:58.412580 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:00:58.412580 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:00:58.412580 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:00:58.412580 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:00:58.412580 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:00:58.412580 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:00:58.412580 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 20:00:58.412580 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 20:00:58.412580 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 689a26d3-0640-4e71-acf6-10bda1f0f4fc could not be found. Jul 20 20:00:58.412580 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:00:58.414275 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-27afa7f4-409b-4205-8f38-0a739b4387b7 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Returning 404 to user: Instance 689a26d3-0640-4e71-acf6-10bda1f0f4fc could not be found. {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 20:00:58.414275 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-27afa7f4-409b-4205-8f38-0a739b4387b7 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc" status: 404 len: 111 microversion: 2.1 time: 0.031184 Jul 20 20:00:58.414275 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1653/2284] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:00:58 2022] GET /compute/v2.1/servers/689a26d3-0640-4e71-acf6-10bda1f0f4fc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 20:00:58.416932 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e962981e-d6af-4f65-bfa9-74f4dbb74bf4 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:00:58.417415 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e962981e-d6af-4f65-bfa9-74f4dbb74bf4 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 053acc99-052e-4247-a54a-2799958f10e6] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:00:58.424192 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e962981e-d6af-4f65-bfa9-74f4dbb74bf4 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:00:58.424624 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e962981e-d6af-4f65-bfa9-74f4dbb74bf4 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:00:58.425371 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e962981e-d6af-4f65-bfa9-74f4dbb74bf4 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:00:58.425826 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e962981e-d6af-4f65-bfa9-74f4dbb74bf4 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:00:58.450626 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e962981e-d6af-4f65-bfa9-74f4dbb74bf4 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 053acc99-052e-4247-a54a-2799958f10e6] Going to try to terminate instance {{(pid=117761) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 20:00:58.528215 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e962981e-d6af-4f65-bfa9-74f4dbb74bf4 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "DELETE /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6" status: 204 len: 0 microversion: 2.1 time: 0.114398 Jul 20 20:00:58.529085 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1654/2285] 10.222.0.69 () {58 vars in 1238 bytes} [Wed Jul 20 20:00:58 2022] DELETE /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 20:00:58.538885 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-537468d8-4e44-469a-860e-c7f7a77d30f4 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:00:58.539581 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-537468d8-4e44-469a-860e-c7f7a77d30f4 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 053acc99-052e-4247-a54a-2799958f10e6] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:00:58.545932 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-537468d8-4e44-469a-860e-c7f7a77d30f4 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:00:58.546407 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-537468d8-4e44-469a-860e-c7f7a77d30f4 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:00:58.547754 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-537468d8-4e44-469a-860e-c7f7a77d30f4 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:00:58.548179 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-537468d8-4e44-469a-860e-c7f7a77d30f4 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:00:58.679264 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-537468d8-4e44-469a-860e-c7f7a77d30f4 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:00:58.686680 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-537468d8-4e44-469a-860e-c7f7a77d30f4 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6" status: 200 len: 1522 microversion: 2.1 time: 0.152770 Jul 20 20:00:58.687238 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1655/2286] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:00:58 2022] GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:00:59.704260 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-7679915a-740d-4c2f-b7dc-39d9a016673d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:00:59.704876 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-7679915a-740d-4c2f-b7dc-39d9a016673d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 053acc99-052e-4247-a54a-2799958f10e6] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:00:59.711199 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7679915a-740d-4c2f-b7dc-39d9a016673d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:00:59.711653 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7679915a-740d-4c2f-b7dc-39d9a016673d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:00:59.712489 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7679915a-740d-4c2f-b7dc-39d9a016673d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:00:59.712924 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7679915a-740d-4c2f-b7dc-39d9a016673d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:00:59.804068 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-7679915a-740d-4c2f-b7dc-39d9a016673d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9192f2842ca044f08e5f95f98f2e1b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8821facab6ed48588d9d484b5e3d98ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:00:59.815220 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-7679915a-740d-4c2f-b7dc-39d9a016673d tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6" status: 200 len: 1480 microversion: 2.1 time: 0.115006 Jul 20 20:00:59.816011 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1656/2287] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:00:59 2022] GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6 => generated 1480 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:00:59.821403 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [req-b38a95be-dd88-4511-85f6-6c58bddd8680 req-1630be70-3a9a-4eca-b54b-ece2a2a6824f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "053acc99-052e-4247-a54a-2799958f10e6", "name": "network-vif-deleted", "tag": "4d19ea60-bcb5-4893-ad87-553405e3a20a"}]} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 20:00:59.831486 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-b38a95be-dd88-4511-85f6-6c58bddd8680 req-1630be70-3a9a-4eca-b54b-ece2a2a6824f service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:00:59.832308 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-b38a95be-dd88-4511-85f6-6c58bddd8680 req-1630be70-3a9a-4eca-b54b-ece2a2a6824f service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:00:59.846489 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.compute.server_external_events [req-b38a95be-dd88-4511-85f6-6c58bddd8680 req-1630be70-3a9a-4eca-b54b-ece2a2a6824f service nova] Creating event network-vif-deleted:4d19ea60-bcb5-4893-ad87-553405e3a20a for instance 053acc99-052e-4247-a54a-2799958f10e6 on hv-cinder-83538 Jul 20 20:00:59.851978 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [req-b38a95be-dd88-4511-85f6-6c58bddd8680 req-1630be70-3a9a-4eca-b54b-ece2a2a6824f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034398 Jul 20 20:00:59.852937 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1657/2288] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 20:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 20:01:00.833296 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-9ec87e83-a7d2-4109-bded-10cbaa48b057 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:01:00.834019 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-9ec87e83-a7d2-4109-bded-10cbaa48b057 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] [instance: 053acc99-052e-4247-a54a-2799958f10e6] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:01:00.840460 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9ec87e83-a7d2-4109-bded-10cbaa48b057 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:01:00.840926 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9ec87e83-a7d2-4109-bded-10cbaa48b057 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:01:00.841711 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9ec87e83-a7d2-4109-bded-10cbaa48b057 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:01:00.842153 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9ec87e83-a7d2-4109-bded-10cbaa48b057 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:01:00.856411 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.wsgi [None req-9ec87e83-a7d2-4109-bded-10cbaa48b057 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] HTTP exception thrown: Instance 053acc99-052e-4247-a54a-2799958f10e6 could not be found. Jul 20 20:01:00.858038 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-9ec87e83-a7d2-4109-bded-10cbaa48b057 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Request method failure captured: Jul 20 20:01:00.858038 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6 HTTP/1.1 Jul 20 20:01:00.858038 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 20:01:00.858038 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 20:01:00.858038 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 20:01:00.858038 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 0 Jul 20 20:01:00.858038 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 20:01:00.858038 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 20:01:00.858038 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 20:01:00.858038 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 20:01:00.858038 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2FZGdJT3PjrXOalhxF4cK7yFRY_rdKs7nWDyfOnHDqihLmSc76hrlTVi8pwFl4fc0_PdYOdKi8ehCojNmpTfeHu0z7420hnbFU_7tQyUQZJWpu7NkYJxMVzpGVG2-8TAgdTN19E5_16lQGWKKWKpZnKtS08L9dJthhYfMLyISTLj6Mc Jul 20 20:01:00.858038 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 20:01:00.858038 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 20:01:00.858038 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 20:01:00.858038 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 20:01:00.858038 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 20:01:00.858038 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 20:01:00.858038 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: 8821facab6ed48588d9d484b5e3d98ba Jul 20 20:01:00.858038 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1121196344 Jul 20 20:01:00.858038 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 20:01:00.858038 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 20:01:00.860461 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8821facab6ed48588d9d484b5e3d98ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8821facab6ed48588d9d484b5e3d98ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8821facab6ed48588d9d484b5e3d98ba", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8821facab6ed48588d9d484b5e3d98ba"}]}] Jul 20 20:01:00.860461 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1121196344 Jul 20 20:01:00.860461 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: 8821facab6ed48588d9d484b5e3d98ba Jul 20 20:01:00.860461 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1121196344 Jul 20 20:01:00.860461 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-ServerRescueNegativeTestJSON-1121196344-project Jul 20 20:01:00.860461 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 20:01:00.860461 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 20:01:00.860461 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: 9192f2842ca044f08e5f95f98f2e1b88 Jul 20 20:01:00.860461 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1121196344-project Jul 20 20:01:00.860461 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: > Jul 20 20:01:00.860461 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Instance 053acc99-052e-4247-a54a-2799958f10e6 could not be found. Jul 20 20:01:00.860461 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'id': '053acc99-052e-4247-a54a-2799958f10e6'} Jul 20 20:01:00.861679 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 20:01:00.861679 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:01:00.861679 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 20:01:00.861679 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 20:01:00.861679 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 20:01:00.861679 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 20:01:00.861679 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 20:01:00.861679 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 20:01:00.861679 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 20:01:00.861679 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 20:01:00.861679 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 053acc99-052e-4247-a54a-2799958f10e6 could not be found. Jul 20 20:01:00.861679 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:01:00.861679 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:01:00.861679 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:01:00.861679 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:01:00.861679 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:01:00.861679 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:01:00.861679 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 20:01:00.861679 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 20:01:00.861679 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 20:01:00.863349 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 20:01:00.863349 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 20:01:00.863349 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 20:01:00.863349 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 20:01:00.863349 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 20:01:00.863349 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 20:01:00.863349 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 20:01:00.863349 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 053acc99-052e-4247-a54a-2799958f10e6 could not be found. Jul 20 20:01:00.863349 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:01:00.863349 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:01:00.863349 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:01:00.863349 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:01:00.863349 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:01:00.863349 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:01:00.863349 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 20:01:00.863349 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 20:01:00.863349 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 053acc99-052e-4247-a54a-2799958f10e6 could not be found. Jul 20 20:01:00.863349 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:01:00.865039 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-9ec87e83-a7d2-4109-bded-10cbaa48b057 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] Returning 404 to user: Instance 053acc99-052e-4247-a54a-2799958f10e6 could not be found. {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 20:01:00.865039 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-9ec87e83-a7d2-4109-bded-10cbaa48b057 tempest-ServerRescueNegativeTestJSON-1121196344 tempest-ServerRescueNegativeTestJSON-1121196344-project] 10.222.0.69 "GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6" status: 404 len: 111 microversion: 2.1 time: 0.030591 Jul 20 20:01:00.865039 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1658/2289] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:01:00 2022] GET /compute/v2.1/servers/053acc99-052e-4247-a54a-2799958f10e6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 20:01:09.539222 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-237ca2f6-fa1d-4415-a51c-0e0b62e69812 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Action: 'create', calling method: .version_select at 0x7ff60a4d6670>, body: {"keypair": {"name": "tempest-keypair-533006012", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOaMfBvsA8+qiWUvLpcMNFIQIL3kgipXTl9mHnhXlYfZuuKsHUxfDq3CK39a45GOwPr/j9vm0dSqsbW/gI6kSV2QoB8ukCSTlWhHHC4GIpRumVlgT0imRMGlg5PUi1bFZA=="}} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 20:01:09.555530 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.quota [None req-237ca2f6-fa1d-4415-a51c-0e0b62e69812 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Getting quotas for project b2b576df300148ad8d8d7dd3f8335f8e. Resources: {'key_pairs'} {{(pid=117761) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 20:01:09.560462 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.quota [None req-237ca2f6-fa1d-4415-a51c-0e0b62e69812 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Getting quotas for user 0d1cf9b55ce04cf997bf23ad73222814 and project b2b576df300148ad8d8d7dd3f8335f8e. Resources: {'key_pairs'} {{(pid=117761) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 20:01:09.587251 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-237ca2f6-fa1d-4415-a51c-0e0b62e69812 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.198320 Jul 20 20:01:09.588718 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1659/2290] 10.222.0.69 () {60 vars in 1158 bytes} [Wed Jul 20 20:01:09 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 20:01:11.252682 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c6be18e5-7f9b-4d13-ac79-5fc57093e8dd tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1657168251", "imageRef": "59575804-e013-4dec-af24-b6c2dbbce73a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "78c100cc-b222-4c1f-ade0-f8cea14841c5"}], "security_groups": [{"name": "tempest-securitygroup--479132963"}], "key_name": "tempest-keypair-533006012", "user_data": "}} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 20:01:11.261237 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 20:01:11.426554 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.network.neutron [None req-c6be18e5-7f9b-4d13-ac79-5fc57093e8dd tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] validate_networks() for [('78c100cc-b222-4c1f-ade0-f8cea14841c5', None, None, None, None, None)] {{(pid=117761) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 20:01:12.153299 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.virt.hardware [None req-c6be18e5-7f9b-4d13-ac79-5fc57093e8dd tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Flavor limits 0:0:0 {{(pid=117761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 20:01:12.153752 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.virt.hardware [None req-c6be18e5-7f9b-4d13-ac79-5fc57093e8dd tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Image limits 0:0:0 {{(pid=117761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 20:01:12.154215 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.virt.hardware [None req-c6be18e5-7f9b-4d13-ac79-5fc57093e8dd tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Flavor pref 0:0:0 {{(pid=117761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 20:01:12.154994 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.virt.hardware [None req-c6be18e5-7f9b-4d13-ac79-5fc57093e8dd tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Image pref 0:0:0 {{(pid=117761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 20:01:12.154994 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.virt.hardware [None req-c6be18e5-7f9b-4d13-ac79-5fc57093e8dd tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 20:01:12.165070 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c6be18e5-7f9b-4d13-ac79-5fc57093e8dd tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:01:12.165428 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c6be18e5-7f9b-4d13-ac79-5fc57093e8dd tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:01:12.166238 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c6be18e5-7f9b-4d13-ac79-5fc57093e8dd tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:01:12.166667 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c6be18e5-7f9b-4d13-ac79-5fc57093e8dd tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:01:12.184799 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.quota [None req-c6be18e5-7f9b-4d13-ac79-5fc57093e8dd tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Getting quotas for project b2b576df300148ad8d8d7dd3f8335f8e. Resources: {'cores', 'ram', 'instances'} {{(pid=117761) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 20:01:12.190057 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.quota [None req-c6be18e5-7f9b-4d13-ac79-5fc57093e8dd tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Getting quotas for user 0d1cf9b55ce04cf997bf23ad73222814 and project b2b576df300148ad8d8d7dd3f8335f8e. Resources: {'cores', 'ram', 'instances'} {{(pid=117761) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 20:01:12.201207 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c6be18e5-7f9b-4d13-ac79-5fc57093e8dd tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Going to run 1 instances... {{(pid=117761) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 20:01:12.204664 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c6be18e5-7f9b-4d13-ac79-5fc57093e8dd tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: b3442f69-2ce9-4c5c-b137-e09fa9317e17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='59575804-e013-4dec-af24-b6c2dbbce73a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117761) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 20:01:12.257265 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c6be18e5-7f9b-4d13-ac79-5fc57093e8dd tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.009088 Jul 20 20:01:12.258310 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1660/2291] 10.222.0.69 () {60 vars in 1146 bytes} [Wed Jul 20 20:01:11 2022] POST /compute/v2.1/servers => generated 401 bytes in 1011 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 20:01:12.270543 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e1a21f79-2ade-462b-af6e-2222b370e321 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:01:12.271258 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e1a21f79-2ade-462b-af6e-2222b370e321 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: b3442f69-2ce9-4c5c-b137-e09fa9317e17] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:01:12.420493 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e1a21f79-2ade-462b-af6e-2222b370e321 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1cf9b55ce04cf997bf23ad73222814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b576df300148ad8d8d7dd3f8335f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:01:12.432160 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e1a21f79-2ade-462b-af6e-2222b370e321 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/b3442f69-2ce9-4c5c-b137-e09fa9317e17" status: 200 len: 1241 microversion: 2.1 time: 0.165629 Jul 20 20:01:12.433908 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1661/2292] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:01:12 2022] GET /compute/v2.1/servers/b3442f69-2ce9-4c5c-b137-e09fa9317e17 => generated 1241 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:01:13.456834 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-44060230-e739-4e86-81b3-21b34af91f2f tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:01:13.457396 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-44060230-e739-4e86-81b3-21b34af91f2f tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: b3442f69-2ce9-4c5c-b137-e09fa9317e17] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:01:13.464160 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-44060230-e739-4e86-81b3-21b34af91f2f tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:01:13.464599 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-44060230-e739-4e86-81b3-21b34af91f2f tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:01:13.465367 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-44060230-e739-4e86-81b3-21b34af91f2f tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:01:13.465828 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-44060230-e739-4e86-81b3-21b34af91f2f tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:01:13.535389 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-44060230-e739-4e86-81b3-21b34af91f2f tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1cf9b55ce04cf997bf23ad73222814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b576df300148ad8d8d7dd3f8335f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:01:13.543972 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-44060230-e739-4e86-81b3-21b34af91f2f tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/b3442f69-2ce9-4c5c-b137-e09fa9317e17" status: 200 len: 1293 microversion: 2.1 time: 0.091711 Jul 20 20:01:13.544452 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1662/2293] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:01:13 2022] GET /compute/v2.1/servers/b3442f69-2ce9-4c5c-b137-e09fa9317e17 => generated 1293 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 20:01:14.564981 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4d21a038-856f-4248-acbb-76cc914087ed tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:01:14.565961 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-4d21a038-856f-4248-acbb-76cc914087ed tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: b3442f69-2ce9-4c5c-b137-e09fa9317e17] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:01:14.573025 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4d21a038-856f-4248-acbb-76cc914087ed tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:01:14.573476 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4d21a038-856f-4248-acbb-76cc914087ed tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:01:14.574330 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4d21a038-856f-4248-acbb-76cc914087ed tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:01:14.574777 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4d21a038-856f-4248-acbb-76cc914087ed tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:01:14.801085 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-4d21a038-856f-4248-acbb-76cc914087ed tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1cf9b55ce04cf997bf23ad73222814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b576df300148ad8d8d7dd3f8335f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:01:14.808574 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-4d21a038-856f-4248-acbb-76cc914087ed tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/b3442f69-2ce9-4c5c-b137-e09fa9317e17" status: 200 len: 1366 microversion: 2.1 time: 0.250010 Jul 20 20:01:14.809271 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1663/2294] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:01:14 2022] GET /compute/v2.1/servers/b3442f69-2ce9-4c5c-b137-e09fa9317e17 => generated 1366 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:01:15.159556 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [req-c7ccc7e1-4f42-4b1d-8d69-37f5d4185606 req-d7e2045d-6d9c-4836-a003-b80a3f1ccb75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3442f69-2ce9-4c5c-b137-e09fa9317e17", "tag": "ad39f13e-c5ed-4efa-bdd8-2d20d7bf6422"}]} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 20:01:15.169712 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-c7ccc7e1-4f42-4b1d-8d69-37f5d4185606 req-d7e2045d-6d9c-4836-a003-b80a3f1ccb75 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:01:15.170260 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-c7ccc7e1-4f42-4b1d-8d69-37f5d4185606 req-d7e2045d-6d9c-4836-a003-b80a3f1ccb75 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:01:15.182104 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.compute.server_external_events [req-c7ccc7e1-4f42-4b1d-8d69-37f5d4185606 req-d7e2045d-6d9c-4836-a003-b80a3f1ccb75 service nova] Creating event network-changed:ad39f13e-c5ed-4efa-bdd8-2d20d7bf6422 for instance b3442f69-2ce9-4c5c-b137-e09fa9317e17 on hv-cinder-83538 Jul 20 20:01:15.191349 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [req-c7ccc7e1-4f42-4b1d-8d69-37f5d4185606 req-d7e2045d-6d9c-4836-a003-b80a3f1ccb75 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041679 Jul 20 20:01:15.193606 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1664/2295] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 20:01:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 20:01:15.826535 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-05414b60-bb3e-43c8-9367-37ffea7efb65 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:01:15.827541 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-05414b60-bb3e-43c8-9367-37ffea7efb65 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: b3442f69-2ce9-4c5c-b137-e09fa9317e17] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:01:15.834134 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-05414b60-bb3e-43c8-9367-37ffea7efb65 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:01:15.834577 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-05414b60-bb3e-43c8-9367-37ffea7efb65 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:01:15.835326 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-05414b60-bb3e-43c8-9367-37ffea7efb65 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:01:15.835755 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-05414b60-bb3e-43c8-9367-37ffea7efb65 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:01:15.972072 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-05414b60-bb3e-43c8-9367-37ffea7efb65 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1cf9b55ce04cf997bf23ad73222814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b576df300148ad8d8d7dd3f8335f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:01:15.979399 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-05414b60-bb3e-43c8-9367-37ffea7efb65 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/b3442f69-2ce9-4c5c-b137-e09fa9317e17" status: 200 len: 1366 microversion: 2.1 time: 0.157546 Jul 20 20:01:15.979957 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1665/2296] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:01:15 2022] GET /compute/v2.1/servers/b3442f69-2ce9-4c5c-b137-e09fa9317e17 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:01:16.996862 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-aed4f8fd-c4a2-4348-b6ec-843c0424c2b6 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:01:16.997543 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-aed4f8fd-c4a2-4348-b6ec-843c0424c2b6 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: b3442f69-2ce9-4c5c-b137-e09fa9317e17] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:01:17.004741 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aed4f8fd-c4a2-4348-b6ec-843c0424c2b6 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:01:17.005193 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aed4f8fd-c4a2-4348-b6ec-843c0424c2b6 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:01:17.006004 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aed4f8fd-c4a2-4348-b6ec-843c0424c2b6 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:01:17.006439 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aed4f8fd-c4a2-4348-b6ec-843c0424c2b6 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:01:17.138918 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-aed4f8fd-c4a2-4348-b6ec-843c0424c2b6 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1cf9b55ce04cf997bf23ad73222814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b576df300148ad8d8d7dd3f8335f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:01:17.147289 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-aed4f8fd-c4a2-4348-b6ec-843c0424c2b6 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/b3442f69-2ce9-4c5c-b137-e09fa9317e17" status: 200 len: 1366 microversion: 2.1 time: 0.154360 Jul 20 20:01:17.147850 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1666/2297] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:01:16 2022] GET /compute/v2.1/servers/b3442f69-2ce9-4c5c-b137-e09fa9317e17 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:01:18.164229 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-02d86d0e-7647-4941-9073-d7e1acb57aa0 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:01:18.164866 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-02d86d0e-7647-4941-9073-d7e1acb57aa0 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: b3442f69-2ce9-4c5c-b137-e09fa9317e17] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:01:18.171923 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-02d86d0e-7647-4941-9073-d7e1acb57aa0 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:01:18.172376 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-02d86d0e-7647-4941-9073-d7e1acb57aa0 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:01:18.173138 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-02d86d0e-7647-4941-9073-d7e1acb57aa0 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:01:18.173603 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-02d86d0e-7647-4941-9073-d7e1acb57aa0 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:01:18.311680 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-02d86d0e-7647-4941-9073-d7e1acb57aa0 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1cf9b55ce04cf997bf23ad73222814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b576df300148ad8d8d7dd3f8335f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:01:18.319672 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-02d86d0e-7647-4941-9073-d7e1acb57aa0 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/b3442f69-2ce9-4c5c-b137-e09fa9317e17" status: 200 len: 1366 microversion: 2.1 time: 0.159299 Jul 20 20:01:18.320349 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1667/2298] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:01:18 2022] GET /compute/v2.1/servers/b3442f69-2ce9-4c5c-b137-e09fa9317e17 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:01:19.337581 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-b99889e7-33b2-48fa-8e7a-ca3c4fd77ca5 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:01:19.338180 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-b99889e7-33b2-48fa-8e7a-ca3c4fd77ca5 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: b3442f69-2ce9-4c5c-b137-e09fa9317e17] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:01:19.345390 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b99889e7-33b2-48fa-8e7a-ca3c4fd77ca5 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:01:19.345862 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b99889e7-33b2-48fa-8e7a-ca3c4fd77ca5 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:01:19.346619 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b99889e7-33b2-48fa-8e7a-ca3c4fd77ca5 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:01:19.347051 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b99889e7-33b2-48fa-8e7a-ca3c4fd77ca5 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:01:19.483188 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-b99889e7-33b2-48fa-8e7a-ca3c4fd77ca5 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1cf9b55ce04cf997bf23ad73222814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b576df300148ad8d8d7dd3f8335f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:01:19.491234 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-b99889e7-33b2-48fa-8e7a-ca3c4fd77ca5 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/b3442f69-2ce9-4c5c-b137-e09fa9317e17" status: 200 len: 1366 microversion: 2.1 time: 0.157550 Jul 20 20:01:19.491807 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1668/2299] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:01:19 2022] GET /compute/v2.1/servers/b3442f69-2ce9-4c5c-b137-e09fa9317e17 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:01:20.507949 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-155f9efb-1ed2-4631-96e3-671e2fc5fe86 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:01:20.508639 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-155f9efb-1ed2-4631-96e3-671e2fc5fe86 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: b3442f69-2ce9-4c5c-b137-e09fa9317e17] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:01:20.515623 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-155f9efb-1ed2-4631-96e3-671e2fc5fe86 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:01:20.516063 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-155f9efb-1ed2-4631-96e3-671e2fc5fe86 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:01:20.516823 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-155f9efb-1ed2-4631-96e3-671e2fc5fe86 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:01:20.517349 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-155f9efb-1ed2-4631-96e3-671e2fc5fe86 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:01:20.651638 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-155f9efb-1ed2-4631-96e3-671e2fc5fe86 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1cf9b55ce04cf997bf23ad73222814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b576df300148ad8d8d7dd3f8335f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:01:20.659665 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-155f9efb-1ed2-4631-96e3-671e2fc5fe86 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/b3442f69-2ce9-4c5c-b137-e09fa9317e17" status: 200 len: 1366 microversion: 2.1 time: 0.155571 Jul 20 20:01:20.660240 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1669/2300] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:01:20 2022] GET /compute/v2.1/servers/b3442f69-2ce9-4c5c-b137-e09fa9317e17 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:01:21.677078 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-756ec0dd-2d97-44cc-b822-c4287ab67289 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:01:21.677807 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-756ec0dd-2d97-44cc-b822-c4287ab67289 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: b3442f69-2ce9-4c5c-b137-e09fa9317e17] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:01:21.687077 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-756ec0dd-2d97-44cc-b822-c4287ab67289 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:01:21.687414 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-756ec0dd-2d97-44cc-b822-c4287ab67289 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:01:21.688314 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-756ec0dd-2d97-44cc-b822-c4287ab67289 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:01:21.688767 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-756ec0dd-2d97-44cc-b822-c4287ab67289 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:01:21.821082 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-756ec0dd-2d97-44cc-b822-c4287ab67289 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1cf9b55ce04cf997bf23ad73222814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b576df300148ad8d8d7dd3f8335f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:01:21.829594 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-756ec0dd-2d97-44cc-b822-c4287ab67289 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/b3442f69-2ce9-4c5c-b137-e09fa9317e17" status: 200 len: 1366 microversion: 2.1 time: 0.155773 Jul 20 20:01:21.830236 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1670/2301] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:01:21 2022] GET /compute/v2.1/servers/b3442f69-2ce9-4c5c-b137-e09fa9317e17 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:01:22.057728 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [req-482529d2-a813-4070-a6eb-595a19f11e33 req-d785fad0-64a9-48d3-afc9-97fcfed66cd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3442f69-2ce9-4c5c-b137-e09fa9317e17", "name": "network-vif-plugged", "status": "completed", "tag": "ad39f13e-c5ed-4efa-bdd8-2d20d7bf6422"}]} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 20:01:22.065921 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-482529d2-a813-4070-a6eb-595a19f11e33 req-d785fad0-64a9-48d3-afc9-97fcfed66cd3 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:01:22.066359 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-482529d2-a813-4070-a6eb-595a19f11e33 req-d785fad0-64a9-48d3-afc9-97fcfed66cd3 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:01:22.077977 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.compute.server_external_events [req-482529d2-a813-4070-a6eb-595a19f11e33 req-d785fad0-64a9-48d3-afc9-97fcfed66cd3 service nova] Creating event network-vif-plugged:ad39f13e-c5ed-4efa-bdd8-2d20d7bf6422 for instance b3442f69-2ce9-4c5c-b137-e09fa9317e17 on hv-cinder-83538 Jul 20 20:01:22.083095 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [req-482529d2-a813-4070-a6eb-595a19f11e33 req-d785fad0-64a9-48d3-afc9-97fcfed66cd3 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089815 Jul 20 20:01:22.083674 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1671/2302] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 20:01:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 20:01:22.844567 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell0:SELECT=2 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 20:01:22.845357 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell0:SELECT=12 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 20:01:22.850728 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-8fb92422-d833-4a34-a7a3-cdcfc0ec8d1f tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:01:22.851421 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-8fb92422-d833-4a34-a7a3-cdcfc0ec8d1f tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: b3442f69-2ce9-4c5c-b137-e09fa9317e17] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:01:22.858704 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8fb92422-d833-4a34-a7a3-cdcfc0ec8d1f tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:01:22.859148 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8fb92422-d833-4a34-a7a3-cdcfc0ec8d1f tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:01:22.859895 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8fb92422-d833-4a34-a7a3-cdcfc0ec8d1f tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:01:22.860319 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8fb92422-d833-4a34-a7a3-cdcfc0ec8d1f tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:01:22.992299 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8fb92422-d833-4a34-a7a3-cdcfc0ec8d1f tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1cf9b55ce04cf997bf23ad73222814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b576df300148ad8d8d7dd3f8335f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:01:23.000561 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-8fb92422-d833-4a34-a7a3-cdcfc0ec8d1f tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/b3442f69-2ce9-4c5c-b137-e09fa9317e17" status: 200 len: 1366 microversion: 2.1 time: 0.157866 Jul 20 20:01:23.001160 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1672/2303] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:01:22 2022] GET /compute/v2.1/servers/b3442f69-2ce9-4c5c-b137-e09fa9317e17 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:01:24.017482 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-22dc132d-86b4-4b5e-be4e-753a721d0f56 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:01:24.018187 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-22dc132d-86b4-4b5e-be4e-753a721d0f56 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: b3442f69-2ce9-4c5c-b137-e09fa9317e17] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:01:24.024539 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-22dc132d-86b4-4b5e-be4e-753a721d0f56 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:01:24.024981 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-22dc132d-86b4-4b5e-be4e-753a721d0f56 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:01:24.025763 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-22dc132d-86b4-4b5e-be4e-753a721d0f56 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:01:24.026190 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-22dc132d-86b4-4b5e-be4e-753a721d0f56 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:01:24.168645 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-22dc132d-86b4-4b5e-be4e-753a721d0f56 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1cf9b55ce04cf997bf23ad73222814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b576df300148ad8d8d7dd3f8335f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:01:24.176603 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-22dc132d-86b4-4b5e-be4e-753a721d0f56 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/b3442f69-2ce9-4c5c-b137-e09fa9317e17" status: 200 len: 1366 microversion: 2.1 time: 0.163086 Jul 20 20:01:24.177166 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1673/2304] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:01:24 2022] GET /compute/v2.1/servers/b3442f69-2ce9-4c5c-b137-e09fa9317e17 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:01:25.193686 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e9f887de-f8cc-488c-abbe-02d94998f238 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:01:25.194392 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e9f887de-f8cc-488c-abbe-02d94998f238 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: b3442f69-2ce9-4c5c-b137-e09fa9317e17] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:01:25.201073 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e9f887de-f8cc-488c-abbe-02d94998f238 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:01:25.201571 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e9f887de-f8cc-488c-abbe-02d94998f238 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:01:25.203304 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e9f887de-f8cc-488c-abbe-02d94998f238 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:01:25.203743 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e9f887de-f8cc-488c-abbe-02d94998f238 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:01:25.343602 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e9f887de-f8cc-488c-abbe-02d94998f238 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1cf9b55ce04cf997bf23ad73222814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b576df300148ad8d8d7dd3f8335f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:01:25.351143 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e9f887de-f8cc-488c-abbe-02d94998f238 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/b3442f69-2ce9-4c5c-b137-e09fa9317e17" status: 200 len: 1556 microversion: 2.1 time: 0.161325 Jul 20 20:01:25.351724 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1674/2305] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:01:25 2022] GET /compute/v2.1/servers/b3442f69-2ce9-4c5c-b137-e09fa9317e17 => generated 1556 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:01:25.367713 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-43abf6d8-1bc2-468a-8597-7da52c14aa15 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:01:25.368202 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-43abf6d8-1bc2-468a-8597-7da52c14aa15 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: b3442f69-2ce9-4c5c-b137-e09fa9317e17] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:01:25.374674 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-43abf6d8-1bc2-468a-8597-7da52c14aa15 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:01:25.375125 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-43abf6d8-1bc2-468a-8597-7da52c14aa15 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:01:25.375893 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-43abf6d8-1bc2-468a-8597-7da52c14aa15 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:01:25.376328 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-43abf6d8-1bc2-468a-8597-7da52c14aa15 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:01:25.456984 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-43abf6d8-1bc2-468a-8597-7da52c14aa15 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/b3442f69-2ce9-4c5c-b137-e09fa9317e17/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092975 Jul 20 20:01:25.457615 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1675/2306] 10.222.0.69 () {58 vars in 1274 bytes} [Wed Jul 20 20:01:25 2022] GET /compute/v2.1/servers/b3442f69-2ce9-4c5c-b137-e09fa9317e17/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 20:01:26.676877 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [req-a7d0b94f-5997-48e3-9e17-560cd792e8f9 req-94371a46-82f1-4164-bb10-7be3f569a2b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3442f69-2ce9-4c5c-b137-e09fa9317e17", "tag": "ad39f13e-c5ed-4efa-bdd8-2d20d7bf6422"}]} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 20:01:26.680245 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 20:01:26.686662 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-a7d0b94f-5997-48e3-9e17-560cd792e8f9 req-94371a46-82f1-4164-bb10-7be3f569a2b8 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:01:26.687720 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-a7d0b94f-5997-48e3-9e17-560cd792e8f9 req-94371a46-82f1-4164-bb10-7be3f569a2b8 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:01:26.701856 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.compute.server_external_events [req-a7d0b94f-5997-48e3-9e17-560cd792e8f9 req-94371a46-82f1-4164-bb10-7be3f569a2b8 service nova] Creating event network-changed:ad39f13e-c5ed-4efa-bdd8-2d20d7bf6422 for instance b3442f69-2ce9-4c5c-b137-e09fa9317e17 on hv-cinder-83538 Jul 20 20:01:26.705324 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [req-a7d0b94f-5997-48e3-9e17-560cd792e8f9 req-94371a46-82f1-4164-bb10-7be3f569a2b8 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032620 Jul 20 20:01:26.706236 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1676/2307] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 20:01:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 20:02:41.966947 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=78 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 20:02:41.972429 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-42704d1c-39c5-4538-9948-153e6fe68c03 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:02:41.973020 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-42704d1c-39c5-4538-9948-153e6fe68c03 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: b3442f69-2ce9-4c5c-b137-e09fa9317e17] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:02:41.980216 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-42704d1c-39c5-4538-9948-153e6fe68c03 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:02:41.980667 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-42704d1c-39c5-4538-9948-153e6fe68c03 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:02:41.981616 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-42704d1c-39c5-4538-9948-153e6fe68c03 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:02:41.982050 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-42704d1c-39c5-4538-9948-153e6fe68c03 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:02:42.005670 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-42704d1c-39c5-4538-9948-153e6fe68c03 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/b3442f69-2ce9-4c5c-b137-e09fa9317e17/ips" status: 200 len: 150 microversion: 2.1 time: 0.042297 Jul 20 20:02:42.006269 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1677/2308] 10.222.0.69 () {58 vars in 1247 bytes} [Wed Jul 20 20:02:41 2022] GET /compute/v2.1/servers/b3442f69-2ce9-4c5c-b137-e09fa9317e17/ips => generated 150 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 20:02:43.362503 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-85e311be-6e8b-466c-a2af-b34c173362e5 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b461f7b6-6674-4170-8672-2f783e8907b3"}} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 20:02:43.363608 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-85e311be-6e8b-466c-a2af-b34c173362e5 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: b3442f69-2ce9-4c5c-b137-e09fa9317e17] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:02:43.370766 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-85e311be-6e8b-466c-a2af-b34c173362e5 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:02:43.371203 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-85e311be-6e8b-466c-a2af-b34c173362e5 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:02:43.371997 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-85e311be-6e8b-466c-a2af-b34c173362e5 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:02:43.372429 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-85e311be-6e8b-466c-a2af-b34c173362e5 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:02:43.619317 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-85e311be-6e8b-466c-a2af-b34c173362e5 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "POST /compute/v2.1/servers/b3442f69-2ce9-4c5c-b137-e09fa9317e17/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.260524 Jul 20 20:02:43.619935 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1678/2309] 10.222.0.69 () {60 vars in 1322 bytes} [Wed Jul 20 20:02:43 2022] POST /compute/v2.1/servers/b3442f69-2ce9-4c5c-b137-e09fa9317e17/os-volume_attachments => generated 194 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 20:02:51.119366 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-9aa04b89-b3f8-49ff-a6b2-810f8aceeb3f tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Action: 'create', calling method: .version_select at 0x7ff609fecf70>, body: {"keypair": {"name": "tempest-keypair-1461563521", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJH0q0uMkkcGvMuXRQCFxk2NGu4YuHgbo8kxJU188On+6RxF2v7l3ki2HQTx0ow0plZa/YxL0wJ58pj+Y31eDVHGFHXpU8Vt821uK+84ISaeHyDkkhfAsxJPHT8NUqn/Eg=="}} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 20:02:51.134607 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.quota [None req-9aa04b89-b3f8-49ff-a6b2-810f8aceeb3f tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Getting quotas for project b2b576df300148ad8d8d7dd3f8335f8e. Resources: {'key_pairs'} {{(pid=117761) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 20:02:51.139203 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.quota [None req-9aa04b89-b3f8-49ff-a6b2-810f8aceeb3f tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Getting quotas for user 0d1cf9b55ce04cf997bf23ad73222814 and project b2b576df300148ad8d8d7dd3f8335f8e. Resources: {'key_pairs'} {{(pid=117761) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 20:02:51.161191 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-9aa04b89-b3f8-49ff-a6b2-810f8aceeb3f tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046721 Jul 20 20:02:51.161827 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1679/2310] 10.222.0.69 () {60 vars in 1158 bytes} [Wed Jul 20 20:02:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 20:02:52.447645 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-f31e537c-2880-442e-9a5c-7f45b8d8c443 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1436689976", "imageRef": "59575804-e013-4dec-af24-b6c2dbbce73a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "78c100cc-b222-4c1f-ade0-f8cea14841c5"}], "security_groups": [{"name": "tempest-securitygroup--314514088"}], "key_name": "tempest-keypair-1461563521", "user_data": "}} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 20:02:52.555936 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.network.neutron [None req-f31e537c-2880-442e-9a5c-7f45b8d8c443 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] validate_networks() for [('78c100cc-b222-4c1f-ade0-f8cea14841c5', None, None, None, None, None)] {{(pid=117761) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 20:02:52.969527 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.virt.hardware [None req-f31e537c-2880-442e-9a5c-7f45b8d8c443 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Flavor limits 0:0:0 {{(pid=117761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 20:02:52.969988 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.virt.hardware [None req-f31e537c-2880-442e-9a5c-7f45b8d8c443 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Image limits 0:0:0 {{(pid=117761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 20:02:52.970458 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.virt.hardware [None req-f31e537c-2880-442e-9a5c-7f45b8d8c443 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Flavor pref 0:0:0 {{(pid=117761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 20:02:52.970896 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.virt.hardware [None req-f31e537c-2880-442e-9a5c-7f45b8d8c443 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Image pref 0:0:0 {{(pid=117761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 20:02:52.971300 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.virt.hardware [None req-f31e537c-2880-442e-9a5c-7f45b8d8c443 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 20:02:52.980490 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f31e537c-2880-442e-9a5c-7f45b8d8c443 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:02:52.980938 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f31e537c-2880-442e-9a5c-7f45b8d8c443 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:02:52.981867 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f31e537c-2880-442e-9a5c-7f45b8d8c443 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:02:52.982196 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f31e537c-2880-442e-9a5c-7f45b8d8c443 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:02:53.000176 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.quota [None req-f31e537c-2880-442e-9a5c-7f45b8d8c443 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Getting quotas for project b2b576df300148ad8d8d7dd3f8335f8e. Resources: {'cores', 'ram', 'instances'} {{(pid=117761) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 20:02:53.004105 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.quota [None req-f31e537c-2880-442e-9a5c-7f45b8d8c443 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Getting quotas for user 0d1cf9b55ce04cf997bf23ad73222814 and project b2b576df300148ad8d8d7dd3f8335f8e. Resources: {'cores', 'ram', 'instances'} {{(pid=117761) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 20:02:53.014927 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-f31e537c-2880-442e-9a5c-7f45b8d8c443 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Going to run 1 instances... {{(pid=117761) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 20:02:53.017256 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-f31e537c-2880-442e-9a5c-7f45b8d8c443 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: 21f47247-6afa-4d0b-a3aa-3d9e87d114c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='59575804-e013-4dec-af24-b6c2dbbce73a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117761) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 20:02:53.066375 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-f31e537c-2880-442e-9a5c-7f45b8d8c443 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.623426 Jul 20 20:02:53.067028 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1680/2311] 10.222.0.69 () {60 vars in 1146 bytes} [Wed Jul 20 20:02:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 625 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 20:02:53.077285 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4db24196-5d30-4542-ab90-fdf95267f7ae tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:02:53.077915 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-4db24196-5d30-4542-ab90-fdf95267f7ae tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: 21f47247-6afa-4d0b-a3aa-3d9e87d114c2] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:02:53.132111 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-4db24196-5d30-4542-ab90-fdf95267f7ae tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1cf9b55ce04cf997bf23ad73222814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b576df300148ad8d8d7dd3f8335f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:02:53.138999 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-4db24196-5d30-4542-ab90-fdf95267f7ae tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/21f47247-6afa-4d0b-a3aa-3d9e87d114c2" status: 200 len: 1242 microversion: 2.1 time: 0.065711 Jul 20 20:02:53.139574 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1681/2312] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:02:53 2022] GET /compute/v2.1/servers/21f47247-6afa-4d0b-a3aa-3d9e87d114c2 => generated 1242 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:02:54.156577 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-41735bb7-c89d-4f36-acc6-5e5a8b643be7 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:02:54.157208 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-41735bb7-c89d-4f36-acc6-5e5a8b643be7 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: 21f47247-6afa-4d0b-a3aa-3d9e87d114c2] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:02:54.164492 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-41735bb7-c89d-4f36-acc6-5e5a8b643be7 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:02:54.164943 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-41735bb7-c89d-4f36-acc6-5e5a8b643be7 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:02:54.165733 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-41735bb7-c89d-4f36-acc6-5e5a8b643be7 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:02:54.166171 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-41735bb7-c89d-4f36-acc6-5e5a8b643be7 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:02:54.238091 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-41735bb7-c89d-4f36-acc6-5e5a8b643be7 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1cf9b55ce04cf997bf23ad73222814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b576df300148ad8d8d7dd3f8335f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:02:54.245999 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-41735bb7-c89d-4f36-acc6-5e5a8b643be7 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/21f47247-6afa-4d0b-a3aa-3d9e87d114c2" status: 200 len: 1300 microversion: 2.1 time: 0.093146 Jul 20 20:02:54.246646 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1682/2313] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:02:54 2022] GET /compute/v2.1/servers/21f47247-6afa-4d0b-a3aa-3d9e87d114c2 => generated 1300 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:02:55.264520 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4ee8d2a0-8e33-4b44-8afc-5fc8b165d6d9 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:02:55.265214 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-4ee8d2a0-8e33-4b44-8afc-5fc8b165d6d9 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: 21f47247-6afa-4d0b-a3aa-3d9e87d114c2] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:02:55.273543 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4ee8d2a0-8e33-4b44-8afc-5fc8b165d6d9 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:02:55.273984 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4ee8d2a0-8e33-4b44-8afc-5fc8b165d6d9 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:02:55.274754 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4ee8d2a0-8e33-4b44-8afc-5fc8b165d6d9 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:02:55.275185 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4ee8d2a0-8e33-4b44-8afc-5fc8b165d6d9 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:02:55.482868 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-4ee8d2a0-8e33-4b44-8afc-5fc8b165d6d9 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1cf9b55ce04cf997bf23ad73222814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b576df300148ad8d8d7dd3f8335f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:02:55.490467 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-4ee8d2a0-8e33-4b44-8afc-5fc8b165d6d9 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/21f47247-6afa-4d0b-a3aa-3d9e87d114c2" status: 200 len: 1367 microversion: 2.1 time: 0.231034 Jul 20 20:02:55.491034 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1683/2314] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:02:55 2022] GET /compute/v2.1/servers/21f47247-6afa-4d0b-a3aa-3d9e87d114c2 => generated 1367 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:02:55.655511 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [req-05ac247b-1078-4f97-a1ce-c62c3805292b req-32f619ff-dde1-4cad-825b-f0219524a0e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21f47247-6afa-4d0b-a3aa-3d9e87d114c2", "tag": "05291923-3eb6-4459-b0df-7f5b4e731ab5"}]} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 20:02:55.665234 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-05ac247b-1078-4f97-a1ce-c62c3805292b req-32f619ff-dde1-4cad-825b-f0219524a0e5 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:02:55.665696 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-05ac247b-1078-4f97-a1ce-c62c3805292b req-32f619ff-dde1-4cad-825b-f0219524a0e5 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:02:55.679356 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.compute.server_external_events [req-05ac247b-1078-4f97-a1ce-c62c3805292b req-32f619ff-dde1-4cad-825b-f0219524a0e5 service nova] Creating event network-changed:05291923-3eb6-4459-b0df-7f5b4e731ab5 for instance 21f47247-6afa-4d0b-a3aa-3d9e87d114c2 on hv-cinder-83538 Jul 20 20:02:55.686862 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [req-05ac247b-1078-4f97-a1ce-c62c3805292b req-32f619ff-dde1-4cad-825b-f0219524a0e5 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117905 Jul 20 20:02:55.688227 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1684/2315] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 20:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 20:02:56.508615 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-7ef5b923-ef00-46ad-ab92-06afde883253 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:02:56.509304 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-7ef5b923-ef00-46ad-ab92-06afde883253 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: 21f47247-6afa-4d0b-a3aa-3d9e87d114c2] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:02:56.515968 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7ef5b923-ef00-46ad-ab92-06afde883253 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:02:56.516420 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7ef5b923-ef00-46ad-ab92-06afde883253 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:02:56.517170 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7ef5b923-ef00-46ad-ab92-06afde883253 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:02:56.517626 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7ef5b923-ef00-46ad-ab92-06afde883253 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:02:56.647199 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-7ef5b923-ef00-46ad-ab92-06afde883253 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1cf9b55ce04cf997bf23ad73222814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b576df300148ad8d8d7dd3f8335f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:02:56.655406 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-7ef5b923-ef00-46ad-ab92-06afde883253 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/21f47247-6afa-4d0b-a3aa-3d9e87d114c2" status: 200 len: 1367 microversion: 2.1 time: 0.150912 Jul 20 20:02:56.655971 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1685/2316] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:02:56 2022] GET /compute/v2.1/servers/21f47247-6afa-4d0b-a3aa-3d9e87d114c2 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:02:57.672448 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-7b82746d-5aec-4626-bd65-22e2eaabb169 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:02:57.673128 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-7b82746d-5aec-4626-bd65-22e2eaabb169 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: 21f47247-6afa-4d0b-a3aa-3d9e87d114c2] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:02:57.679563 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7b82746d-5aec-4626-bd65-22e2eaabb169 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:02:57.680000 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7b82746d-5aec-4626-bd65-22e2eaabb169 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:02:57.680751 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7b82746d-5aec-4626-bd65-22e2eaabb169 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:02:57.681178 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7b82746d-5aec-4626-bd65-22e2eaabb169 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:02:57.814981 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-7b82746d-5aec-4626-bd65-22e2eaabb169 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1cf9b55ce04cf997bf23ad73222814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b576df300148ad8d8d7dd3f8335f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:02:57.822415 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-7b82746d-5aec-4626-bd65-22e2eaabb169 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/21f47247-6afa-4d0b-a3aa-3d9e87d114c2" status: 200 len: 1367 microversion: 2.1 time: 0.153790 Jul 20 20:02:57.823601 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1686/2317] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:02:57 2022] GET /compute/v2.1/servers/21f47247-6afa-4d0b-a3aa-3d9e87d114c2 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:02:58.841361 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-0cc16009-9107-453f-8429-0bbe8cb0f9e7 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:02:58.842415 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-0cc16009-9107-453f-8429-0bbe8cb0f9e7 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: 21f47247-6afa-4d0b-a3aa-3d9e87d114c2] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:02:58.850212 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0cc16009-9107-453f-8429-0bbe8cb0f9e7 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:02:58.850986 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0cc16009-9107-453f-8429-0bbe8cb0f9e7 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:02:58.851996 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0cc16009-9107-453f-8429-0bbe8cb0f9e7 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:02:58.852670 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0cc16009-9107-453f-8429-0bbe8cb0f9e7 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:02:59.330695 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0cc16009-9107-453f-8429-0bbe8cb0f9e7 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1cf9b55ce04cf997bf23ad73222814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b576df300148ad8d8d7dd3f8335f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:02:59.339041 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-0cc16009-9107-453f-8429-0bbe8cb0f9e7 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/21f47247-6afa-4d0b-a3aa-3d9e87d114c2" status: 200 len: 1367 microversion: 2.1 time: 0.502991 Jul 20 20:02:59.339675 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1687/2318] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:02:58 2022] GET /compute/v2.1/servers/21f47247-6afa-4d0b-a3aa-3d9e87d114c2 => generated 1367 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:02:59.344475 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-07e4b2e8-9fce-414f-8a3a-8faa63fbebac tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:02:59.344981 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-07e4b2e8-9fce-414f-8a3a-8faa63fbebac tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] [instance: 43fe56ab-bf09-4ec0-84d5-306f16cb9d5a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:02:59.351071 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-07e4b2e8-9fce-414f-8a3a-8faa63fbebac tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:02:59.351520 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-07e4b2e8-9fce-414f-8a3a-8faa63fbebac tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:02:59.352794 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-07e4b2e8-9fce-414f-8a3a-8faa63fbebac tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:02:59.353234 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-07e4b2e8-9fce-414f-8a3a-8faa63fbebac tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:02:59.379155 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-07e4b2e8-9fce-414f-8a3a-8faa63fbebac tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] [instance: 43fe56ab-bf09-4ec0-84d5-306f16cb9d5a] Going to try to terminate instance {{(pid=117761) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 20:02:59.460964 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-07e4b2e8-9fce-414f-8a3a-8faa63fbebac tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] 10.222.0.69 "DELETE /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a" status: 204 len: 0 microversion: 2.1 time: 0.119758 Jul 20 20:02:59.461591 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1688/2319] 10.222.0.69 () {58 vars in 1238 bytes} [Wed Jul 20 20:02:59 2022] DELETE /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 20:02:59.470257 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-b2992e67-294f-4e35-9751-d2a9bc8201fa tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:02:59.470954 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-b2992e67-294f-4e35-9751-d2a9bc8201fa tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] [instance: 43fe56ab-bf09-4ec0-84d5-306f16cb9d5a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:02:59.476786 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b2992e67-294f-4e35-9751-d2a9bc8201fa tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:02:59.477235 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b2992e67-294f-4e35-9751-d2a9bc8201fa tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:02:59.478031 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b2992e67-294f-4e35-9751-d2a9bc8201fa tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:02:59.478462 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b2992e67-294f-4e35-9751-d2a9bc8201fa tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:02:59.613650 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-b2992e67-294f-4e35-9751-d2a9bc8201fa tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ae826a812b44328c48b82e9498ad8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bb4af78c1d4589b1d3cc90d5e6be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:02:59.622159 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-b2992e67-294f-4e35-9751-d2a9bc8201fa tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] 10.222.0.69 "GET /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a" status: 200 len: 1559 microversion: 2.1 time: 0.156220 Jul 20 20:02:59.622716 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1689/2320] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:02:59 2022] GET /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:03:00.356244 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-b16ea39d-0b34-414c-9a04-63766ffde6b6 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:03:00.356882 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-b16ea39d-0b34-414c-9a04-63766ffde6b6 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: 21f47247-6afa-4d0b-a3aa-3d9e87d114c2] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:03:00.363379 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b16ea39d-0b34-414c-9a04-63766ffde6b6 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:03:00.363837 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b16ea39d-0b34-414c-9a04-63766ffde6b6 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:03:00.364625 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b16ea39d-0b34-414c-9a04-63766ffde6b6 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:03:00.365028 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b16ea39d-0b34-414c-9a04-63766ffde6b6 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:03:00.583969 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-b16ea39d-0b34-414c-9a04-63766ffde6b6 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1cf9b55ce04cf997bf23ad73222814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b576df300148ad8d8d7dd3f8335f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:03:00.593563 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-b16ea39d-0b34-414c-9a04-63766ffde6b6 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/21f47247-6afa-4d0b-a3aa-3d9e87d114c2" status: 200 len: 1367 microversion: 2.1 time: 0.241112 Jul 20 20:03:00.603016 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1690/2321] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:03:00 2022] GET /compute/v2.1/servers/21f47247-6afa-4d0b-a3aa-3d9e87d114c2 => generated 1367 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:03:00.639798 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-852ef4c7-b0cc-4ed0-8b35-990099a93b3c tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:03:00.640546 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-852ef4c7-b0cc-4ed0-8b35-990099a93b3c tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] [instance: 43fe56ab-bf09-4ec0-84d5-306f16cb9d5a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:03:00.651086 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-852ef4c7-b0cc-4ed0-8b35-990099a93b3c tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:03:00.651674 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-852ef4c7-b0cc-4ed0-8b35-990099a93b3c tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:03:00.653224 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-852ef4c7-b0cc-4ed0-8b35-990099a93b3c tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:03:00.660793 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-852ef4c7-b0cc-4ed0-8b35-990099a93b3c tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:03:00.858641 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-852ef4c7-b0cc-4ed0-8b35-990099a93b3c tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ae826a812b44328c48b82e9498ad8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bb4af78c1d4589b1d3cc90d5e6be63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:03:00.866526 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-852ef4c7-b0cc-4ed0-8b35-990099a93b3c tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] 10.222.0.69 "GET /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a" status: 200 len: 1559 microversion: 2.1 time: 0.231559 Jul 20 20:03:00.867376 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1691/2322] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:03:00 2022] GET /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a => generated 1559 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 20:03:01.016963 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [req-9dd8363a-cb32-4303-aff5-42af16ea31ee req-12f5fe7a-d555-49f4-a385-0185c3ac1e7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43fe56ab-bf09-4ec0-84d5-306f16cb9d5a", "name": "network-vif-deleted", "tag": "4d776a97-1613-4d92-893b-9c96e6a8a268"}]} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 20:03:01.026208 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-9dd8363a-cb32-4303-aff5-42af16ea31ee req-12f5fe7a-d555-49f4-a385-0185c3ac1e7c service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:03:01.026663 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-9dd8363a-cb32-4303-aff5-42af16ea31ee req-12f5fe7a-d555-49f4-a385-0185c3ac1e7c service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:03:01.039239 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.compute.server_external_events [req-9dd8363a-cb32-4303-aff5-42af16ea31ee req-12f5fe7a-d555-49f4-a385-0185c3ac1e7c service nova] Creating event network-vif-deleted:4d776a97-1613-4d92-893b-9c96e6a8a268 for instance 43fe56ab-bf09-4ec0-84d5-306f16cb9d5a on hv-cinder-83538 Jul 20 20:03:01.044692 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [req-9dd8363a-cb32-4303-aff5-42af16ea31ee req-12f5fe7a-d555-49f4-a385-0185c3ac1e7c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031261 Jul 20 20:03:01.045582 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1692/2323] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 20:03:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 20:03:01.611396 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-22e24152-77cf-40f7-894a-1b1df75de5cc tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:03:01.613000 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-22e24152-77cf-40f7-894a-1b1df75de5cc tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: 21f47247-6afa-4d0b-a3aa-3d9e87d114c2] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:03:01.619921 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-22e24152-77cf-40f7-894a-1b1df75de5cc tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:03:01.620393 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-22e24152-77cf-40f7-894a-1b1df75de5cc tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:03:01.621153 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-22e24152-77cf-40f7-894a-1b1df75de5cc tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:03:01.621632 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-22e24152-77cf-40f7-894a-1b1df75de5cc tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:03:01.756861 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-22e24152-77cf-40f7-894a-1b1df75de5cc tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1cf9b55ce04cf997bf23ad73222814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b576df300148ad8d8d7dd3f8335f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:03:01.764796 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-22e24152-77cf-40f7-894a-1b1df75de5cc tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/21f47247-6afa-4d0b-a3aa-3d9e87d114c2" status: 200 len: 1367 microversion: 2.1 time: 0.158172 Jul 20 20:03:01.765365 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1693/2324] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:03:01 2022] GET /compute/v2.1/servers/21f47247-6afa-4d0b-a3aa-3d9e87d114c2 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:03:01.883858 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-51105fd0-fcb0-41a3-ba0e-c61e697e40cd tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:03:01.884525 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-51105fd0-fcb0-41a3-ba0e-c61e697e40cd tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] [instance: 43fe56ab-bf09-4ec0-84d5-306f16cb9d5a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:03:01.891524 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-51105fd0-fcb0-41a3-ba0e-c61e697e40cd tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:03:01.891972 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-51105fd0-fcb0-41a3-ba0e-c61e697e40cd tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:03:01.892729 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-51105fd0-fcb0-41a3-ba0e-c61e697e40cd tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:03:01.893155 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-51105fd0-fcb0-41a3-ba0e-c61e697e40cd tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:03:01.907381 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.wsgi [None req-51105fd0-fcb0-41a3-ba0e-c61e697e40cd tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] HTTP exception thrown: Instance 43fe56ab-bf09-4ec0-84d5-306f16cb9d5a could not be found. Jul 20 20:03:01.909003 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-51105fd0-fcb0-41a3-ba0e-c61e697e40cd tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Request method failure captured: Jul 20 20:03:01.909003 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: GET /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a HTTP/1.1 Jul 20 20:03:01.909003 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 20:03:01.909003 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 20:03:01.909003 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 20:03:01.909003 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 0 Jul 20 20:03:01.909003 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 20:03:01.909003 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 20:03:01.909003 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 20:03:01.909003 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 20:03:01.909003 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2FbvraeCBRrPE4O7lrRb8qOLZk5VEOCVBOl4zMC1gg8XMd7uuHid9RioGTRX_JruGVyWJZ88XS9h66QDLJKZqWWE0MjOusG0phS1nTYkPwx2OHkqAGkCtP2OLBH1bnn2QsTgDuvA_AZ-0_Frr--F8Gf2qGtpGL5jfce4gMVrg4Ozv-Y Jul 20 20:03:01.909003 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 20:03:01.909003 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 20:03:01.909003 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 20:03:01.909003 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 20:03:01.909003 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 20:03:01.909003 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 20:03:01.909003 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: e0bb4af78c1d4589b1d3cc90d5e6be63 Jul 20 20:03:01.909003 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1199788649 Jul 20 20:03:01.909003 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 20:03:01.909003 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 20:03:01.910861 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e0bb4af78c1d4589b1d3cc90d5e6be63"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e0bb4af78c1d4589b1d3cc90d5e6be63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_e0bb4af78c1d4589b1d3cc90d5e6be63", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/e0bb4af78c1d4589b1d3cc90d5e6be63"}]}] Jul 20 20:03:01.910861 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-VolumesSnapshotTestJSON-1199788649 Jul 20 20:03:01.910861 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: e0bb4af78c1d4589b1d3cc90d5e6be63 Jul 20 20:03:01.910861 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1199788649 Jul 20 20:03:01.910861 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-VolumesSnapshotTestJSON-1199788649-project Jul 20 20:03:01.910861 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 20:03:01.910861 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 20:03:01.910861 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: 78ae826a812b44328c48b82e9498ad8b Jul 20 20:03:01.910861 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-VolumesSnapshotTestJSON-1199788649-project Jul 20 20:03:01.910861 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: > Jul 20 20:03:01.910861 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Instance 43fe56ab-bf09-4ec0-84d5-306f16cb9d5a could not be found. Jul 20 20:03:01.910861 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'id': '43fe56ab-bf09-4ec0-84d5-306f16cb9d5a'} Jul 20 20:03:01.912059 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 20:03:01.912059 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:03:01.912059 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 20:03:01.912059 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 20:03:01.912059 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 20:03:01.912059 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 20:03:01.912059 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 20:03:01.912059 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 20:03:01.912059 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 20:03:01.912059 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 20:03:01.912059 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43fe56ab-bf09-4ec0-84d5-306f16cb9d5a could not be found. Jul 20 20:03:01.912059 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:03:01.912059 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:03:01.912059 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:03:01.912059 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:03:01.912059 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:03:01.912059 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:03:01.912059 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 20:03:01.912059 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 20:03:01.912059 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 20:03:01.913841 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 20:03:01.913841 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 20:03:01.913841 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 20:03:01.913841 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 20:03:01.913841 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 20:03:01.913841 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 20:03:01.913841 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 20:03:01.913841 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43fe56ab-bf09-4ec0-84d5-306f16cb9d5a could not be found. Jul 20 20:03:01.913841 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:03:01.913841 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:03:01.913841 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:03:01.913841 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:03:01.913841 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:03:01.913841 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:03:01.913841 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 20:03:01.913841 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 20:03:01.913841 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43fe56ab-bf09-4ec0-84d5-306f16cb9d5a could not be found. Jul 20 20:03:01.913841 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:03:01.915275 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-51105fd0-fcb0-41a3-ba0e-c61e697e40cd tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] Returning 404 to user: Instance 43fe56ab-bf09-4ec0-84d5-306f16cb9d5a could not be found. {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 20:03:01.915275 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-51105fd0-fcb0-41a3-ba0e-c61e697e40cd tempest-VolumesSnapshotTestJSON-1199788649 tempest-VolumesSnapshotTestJSON-1199788649-project] 10.222.0.69 "GET /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a" status: 404 len: 111 microversion: 2.1 time: 0.030570 Jul 20 20:03:01.915275 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1694/2325] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:03:01 2022] GET /compute/v2.1/servers/43fe56ab-bf09-4ec0-84d5-306f16cb9d5a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 20:03:02.615726 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [req-2ae4e953-bf67-4e96-949d-332188a63850 req-e5e0341b-2c2a-4edd-a338-cb8d096bb85d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21f47247-6afa-4d0b-a3aa-3d9e87d114c2", "name": "network-vif-plugged", "status": "completed", "tag": "05291923-3eb6-4459-b0df-7f5b4e731ab5"}]} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 20:03:02.625304 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-2ae4e953-bf67-4e96-949d-332188a63850 req-e5e0341b-2c2a-4edd-a338-cb8d096bb85d service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:03:02.625960 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-2ae4e953-bf67-4e96-949d-332188a63850 req-e5e0341b-2c2a-4edd-a338-cb8d096bb85d service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:03:02.637870 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.compute.server_external_events [req-2ae4e953-bf67-4e96-949d-332188a63850 req-e5e0341b-2c2a-4edd-a338-cb8d096bb85d service nova] Creating event network-vif-plugged:05291923-3eb6-4459-b0df-7f5b4e731ab5 for instance 21f47247-6afa-4d0b-a3aa-3d9e87d114c2 on hv-cinder-83538 Jul 20 20:03:02.642868 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [req-2ae4e953-bf67-4e96-949d-332188a63850 req-e5e0341b-2c2a-4edd-a338-cb8d096bb85d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030907 Jul 20 20:03:02.643641 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1695/2326] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 20:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 20:03:02.782027 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-5da31985-4909-49e3-835f-0f281ce1f2df tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:03:02.782720 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-5da31985-4909-49e3-835f-0f281ce1f2df tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: 21f47247-6afa-4d0b-a3aa-3d9e87d114c2] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:03:02.789047 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5da31985-4909-49e3-835f-0f281ce1f2df tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:03:02.789497 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5da31985-4909-49e3-835f-0f281ce1f2df tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:03:02.790281 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5da31985-4909-49e3-835f-0f281ce1f2df tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:03:02.790712 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5da31985-4909-49e3-835f-0f281ce1f2df tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:03:02.795607 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 20:03:02.955920 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-5da31985-4909-49e3-835f-0f281ce1f2df tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1cf9b55ce04cf997bf23ad73222814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b576df300148ad8d8d7dd3f8335f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:03:02.963723 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-5da31985-4909-49e3-835f-0f281ce1f2df tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/21f47247-6afa-4d0b-a3aa-3d9e87d114c2" status: 200 len: 1367 microversion: 2.1 time: 0.185461 Jul 20 20:03:02.964364 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1696/2327] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:03:02 2022] GET /compute/v2.1/servers/21f47247-6afa-4d0b-a3aa-3d9e87d114c2 => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:03:03.981225 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-00fd395e-f307-4d80-a83a-95fb46b81206 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:03:03.981958 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-00fd395e-f307-4d80-a83a-95fb46b81206 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: 21f47247-6afa-4d0b-a3aa-3d9e87d114c2] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:03:03.983879 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell0:SELECT=2 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 20:03:03.984683 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell0:SELECT=12 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 20:03:03.991073 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-00fd395e-f307-4d80-a83a-95fb46b81206 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:03:03.991550 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-00fd395e-f307-4d80-a83a-95fb46b81206 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:03:03.992308 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-00fd395e-f307-4d80-a83a-95fb46b81206 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:03:03.992739 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-00fd395e-f307-4d80-a83a-95fb46b81206 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:03:04.127225 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-00fd395e-f307-4d80-a83a-95fb46b81206 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1cf9b55ce04cf997bf23ad73222814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b576df300148ad8d8d7dd3f8335f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:03:04.134538 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-00fd395e-f307-4d80-a83a-95fb46b81206 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/21f47247-6afa-4d0b-a3aa-3d9e87d114c2" status: 200 len: 1367 microversion: 2.1 time: 0.157789 Jul 20 20:03:04.135290 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1697/2328] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:03:03 2022] GET /compute/v2.1/servers/21f47247-6afa-4d0b-a3aa-3d9e87d114c2 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:03:05.152067 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c7479ffa-0878-410b-be00-05bdc730a91b tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:03:05.152856 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c7479ffa-0878-410b-be00-05bdc730a91b tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: 21f47247-6afa-4d0b-a3aa-3d9e87d114c2] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:03:05.159196 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c7479ffa-0878-410b-be00-05bdc730a91b tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:03:05.159651 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c7479ffa-0878-410b-be00-05bdc730a91b tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:03:05.160413 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c7479ffa-0878-410b-be00-05bdc730a91b tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:03:05.160843 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c7479ffa-0878-410b-be00-05bdc730a91b tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:03:05.296399 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c7479ffa-0878-410b-be00-05bdc730a91b tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1cf9b55ce04cf997bf23ad73222814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b576df300148ad8d8d7dd3f8335f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:03:05.303857 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c7479ffa-0878-410b-be00-05bdc730a91b tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/21f47247-6afa-4d0b-a3aa-3d9e87d114c2" status: 200 len: 1367 microversion: 2.1 time: 0.155977 Jul 20 20:03:05.304418 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1698/2329] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:03:05 2022] GET /compute/v2.1/servers/21f47247-6afa-4d0b-a3aa-3d9e87d114c2 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:03:06.320933 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ee118aaa-be4c-41b8-9443-95c3aebe7864 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:03:06.321620 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ee118aaa-be4c-41b8-9443-95c3aebe7864 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: 21f47247-6afa-4d0b-a3aa-3d9e87d114c2] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:03:06.328826 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ee118aaa-be4c-41b8-9443-95c3aebe7864 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:03:06.329276 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ee118aaa-be4c-41b8-9443-95c3aebe7864 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:03:06.330177 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ee118aaa-be4c-41b8-9443-95c3aebe7864 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:03:06.330623 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ee118aaa-be4c-41b8-9443-95c3aebe7864 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:03:06.456884 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ee118aaa-be4c-41b8-9443-95c3aebe7864 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1cf9b55ce04cf997bf23ad73222814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b576df300148ad8d8d7dd3f8335f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:03:06.465084 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ee118aaa-be4c-41b8-9443-95c3aebe7864 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/21f47247-6afa-4d0b-a3aa-3d9e87d114c2" status: 200 len: 1367 microversion: 2.1 time: 0.148691 Jul 20 20:03:06.465600 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1699/2330] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:03:06 2022] GET /compute/v2.1/servers/21f47247-6afa-4d0b-a3aa-3d9e87d114c2 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:03:07.483228 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-b5798d5a-da83-4960-8471-7c7b508d79b3 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:03:07.483868 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-b5798d5a-da83-4960-8471-7c7b508d79b3 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: 21f47247-6afa-4d0b-a3aa-3d9e87d114c2] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:03:07.489876 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b5798d5a-da83-4960-8471-7c7b508d79b3 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:03:07.490327 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b5798d5a-da83-4960-8471-7c7b508d79b3 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:03:07.491086 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b5798d5a-da83-4960-8471-7c7b508d79b3 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:03:07.491529 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b5798d5a-da83-4960-8471-7c7b508d79b3 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:03:07.621040 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-b5798d5a-da83-4960-8471-7c7b508d79b3 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1cf9b55ce04cf997bf23ad73222814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b576df300148ad8d8d7dd3f8335f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:03:07.629226 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-b5798d5a-da83-4960-8471-7c7b508d79b3 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/21f47247-6afa-4d0b-a3aa-3d9e87d114c2" status: 200 len: 1367 microversion: 2.1 time: 0.150976 Jul 20 20:03:07.629857 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1700/2331] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:03:07 2022] GET /compute/v2.1/servers/21f47247-6afa-4d0b-a3aa-3d9e87d114c2 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:03:08.646721 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-adfd7645-3c9a-4a0a-9d54-3fef093f63a7 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:03:08.647351 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-adfd7645-3c9a-4a0a-9d54-3fef093f63a7 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: 21f47247-6afa-4d0b-a3aa-3d9e87d114c2] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:03:08.653840 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-adfd7645-3c9a-4a0a-9d54-3fef093f63a7 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:03:08.654288 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-adfd7645-3c9a-4a0a-9d54-3fef093f63a7 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:03:08.655048 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-adfd7645-3c9a-4a0a-9d54-3fef093f63a7 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:03:08.655478 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-adfd7645-3c9a-4a0a-9d54-3fef093f63a7 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:03:08.797879 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-adfd7645-3c9a-4a0a-9d54-3fef093f63a7 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1cf9b55ce04cf997bf23ad73222814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b576df300148ad8d8d7dd3f8335f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:03:08.807407 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-adfd7645-3c9a-4a0a-9d54-3fef093f63a7 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/21f47247-6afa-4d0b-a3aa-3d9e87d114c2" status: 200 len: 1557 microversion: 2.1 time: 0.163872 Jul 20 20:03:08.808242 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1701/2332] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:03:08 2022] GET /compute/v2.1/servers/21f47247-6afa-4d0b-a3aa-3d9e87d114c2 => generated 1557 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:03:08.825595 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-59837e05-ea52-4639-a0a7-80b58fd3e329 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:03:08.826081 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-59837e05-ea52-4639-a0a7-80b58fd3e329 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: 21f47247-6afa-4d0b-a3aa-3d9e87d114c2] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:03:08.832833 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-59837e05-ea52-4639-a0a7-80b58fd3e329 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:03:08.833286 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-59837e05-ea52-4639-a0a7-80b58fd3e329 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:03:08.834155 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-59837e05-ea52-4639-a0a7-80b58fd3e329 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:03:08.834582 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-59837e05-ea52-4639-a0a7-80b58fd3e329 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:03:08.926994 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-59837e05-ea52-4639-a0a7-80b58fd3e329 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/21f47247-6afa-4d0b-a3aa-3d9e87d114c2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.105750 Jul 20 20:03:08.929937 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1702/2333] 10.222.0.69 () {58 vars in 1274 bytes} [Wed Jul 20 20:03:08 2022] GET /compute/v2.1/servers/21f47247-6afa-4d0b-a3aa-3d9e87d114c2/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 20:03:10.206125 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [req-6d2eb127-2412-4aa6-b954-7cc566b2dae9 req-610a2072-68e3-4be4-b29c-3c79071527a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21f47247-6afa-4d0b-a3aa-3d9e87d114c2", "tag": "05291923-3eb6-4459-b0df-7f5b4e731ab5"}]} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 20:03:10.215166 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-6d2eb127-2412-4aa6-b954-7cc566b2dae9 req-610a2072-68e3-4be4-b29c-3c79071527a6 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:03:10.215604 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-6d2eb127-2412-4aa6-b954-7cc566b2dae9 req-610a2072-68e3-4be4-b29c-3c79071527a6 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:03:10.227144 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.compute.server_external_events [req-6d2eb127-2412-4aa6-b954-7cc566b2dae9 req-610a2072-68e3-4be4-b29c-3c79071527a6 service nova] Creating event network-changed:05291923-3eb6-4459-b0df-7f5b4e731ab5 for instance 21f47247-6afa-4d0b-a3aa-3d9e87d114c2 on hv-cinder-83538 Jul 20 20:03:10.232348 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [req-6d2eb127-2412-4aa6-b954-7cc566b2dae9 req-610a2072-68e3-4be4-b29c-3c79071527a6 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117190 Jul 20 20:03:10.232961 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1703/2334] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 20:03:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 20:04:37.094806 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 20:04:37.095482 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=40 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 20:04:37.100324 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-6907833e-8bb4-42c2-a6be-aca19a0fd198 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:04:37.100900 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-6907833e-8bb4-42c2-a6be-aca19a0fd198 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: 21f47247-6afa-4d0b-a3aa-3d9e87d114c2] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:04:37.108980 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6907833e-8bb4-42c2-a6be-aca19a0fd198 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:04:37.109530 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6907833e-8bb4-42c2-a6be-aca19a0fd198 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:04:37.110606 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6907833e-8bb4-42c2-a6be-aca19a0fd198 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:04:37.111235 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6907833e-8bb4-42c2-a6be-aca19a0fd198 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:04:37.136643 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-6907833e-8bb4-42c2-a6be-aca19a0fd198 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/21f47247-6afa-4d0b-a3aa-3d9e87d114c2/ips" status: 200 len: 150 microversion: 2.1 time: 0.044106 Jul 20 20:04:37.137214 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1704/2335] 10.222.0.69 () {58 vars in 1247 bytes} [Wed Jul 20 20:04:37 2022] GET /compute/v2.1/servers/21f47247-6afa-4d0b-a3aa-3d9e87d114c2/ips => generated 150 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 20:04:37.147269 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-53cc8f87-5e9f-4194-8f16-5e85ed82b453 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b461f7b6-6674-4170-8672-2f783e8907b3"}} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 20:04:37.148318 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-53cc8f87-5e9f-4194-8f16-5e85ed82b453 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: 21f47247-6afa-4d0b-a3aa-3d9e87d114c2] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:04:37.154138 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-53cc8f87-5e9f-4194-8f16-5e85ed82b453 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:04:37.154589 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-53cc8f87-5e9f-4194-8f16-5e85ed82b453 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:04:37.155344 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-53cc8f87-5e9f-4194-8f16-5e85ed82b453 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:04:37.155778 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-53cc8f87-5e9f-4194-8f16-5e85ed82b453 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:04:37.234294 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.wsgi [None req-53cc8f87-5e9f-4194-8f16-5e85ed82b453 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] HTTP exception thrown: Invalid volume: volume b461f7b6-6674-4170-8672-2f783e8907b3 is already attached to instances: b3442f69-2ce9-4c5c-b137-e09fa9317e17 Jul 20 20:04:37.236041 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-53cc8f87-5e9f-4194-8f16-5e85ed82b453 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Request method failure captured: Jul 20 20:04:37.236041 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: POST /compute/v2.1/servers/21f47247-6afa-4d0b-a3aa-3d9e87d114c2/os-volume_attachments HTTP/1.1 Jul 20 20:04:37.236041 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 20:04:37.236041 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 20:04:37.236041 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 20:04:37.236041 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 74 Jul 20 20:04:37.236041 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 20:04:37.236041 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 20:04:37.236041 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 20:04:37.236041 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 20:04:37.236041 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2F8F6Ge10hBXuhDa0NLuoIQGKdCbH_-0Qytzgx2TiuDpG5vxQ-IW-4WPHWLIEm2lkY4j4eRPFcsjkcnP9w_FRJ3X-P89qM9tliQWnJkm78fASQt3Z_jz-B1-QjBfFR7l1gMla2jtR2bkXlUlscrWVmnS7NtJkSS_8OjKqGZtvWPk5Iw Jul 20 20:04:37.236041 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 20:04:37.236041 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 20:04:37.236041 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 20:04:37.236041 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 20:04:37.236041 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 20:04:37.236041 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 20:04:37.236041 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: b2b576df300148ad8d8d7dd3f8335f8e Jul 20 20:04:37.236041 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-AttachVolumeNegativeTest-1904845904 Jul 20 20:04:37.236041 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 20:04:37.236041 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 20:04:37.237940 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b2b576df300148ad8d8d7dd3f8335f8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b2b576df300148ad8d8d7dd3f8335f8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_b2b576df300148ad8d8d7dd3f8335f8e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/b2b576df300148ad8d8d7dd3f8335f8e"}]}] Jul 20 20:04:37.237940 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-AttachVolumeNegativeTest-1904845904 Jul 20 20:04:37.237940 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: b2b576df300148ad8d8d7dd3f8335f8e Jul 20 20:04:37.237940 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1904845904 Jul 20 20:04:37.237940 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-AttachVolumeNegativeTest-1904845904-project Jul 20 20:04:37.237940 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 20:04:37.237940 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 20:04:37.237940 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: 0d1cf9b55ce04cf997bf23ad73222814 Jul 20 20:04:37.237940 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-AttachVolumeNegativeTest-1904845904-project Jul 20 20:04:37.237940 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Jul 20 20:04:37.237940 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {"volumeAttachment": {"volumeId": "b461f7b6-6674-4170-8672-2f783e8907b3"}} Jul 20 20:04:37.237940 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: > Jul 20 20:04:37.238995 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Invalid volume: volume b461f7b6-6674-4170-8672-2f783e8907b3 is already attached to instances: b3442f69-2ce9-4c5c-b137-e09fa9317e17 Jul 20 20:04:37.238995 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'server_id': '21f47247-6afa-4d0b-a3aa-3d9e87d114c2', 'body': {'volumeAttachment': {'volumeId': 'b461f7b6-6674-4170-8672-2f783e8907b3'}}} Jul 20 20:04:37.238995 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 20:04:37.238995 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:04:37.238995 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 20 20:04:37.238995 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 20 20:04:37.238995 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 20:04:37.238995 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 20:04:37.238995 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 20 20:04:37.238995 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 20:04:37.238995 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 20 20:04:37.238995 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 20 20:04:37.238995 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 20 20:04:37.238995 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 20 20:04:37.238995 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b461f7b6-6674-4170-8672-2f783e8907b3 is already attached to instances: b3442f69-2ce9-4c5c-b137-e09fa9317e17 Jul 20 20:04:37.238995 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:04:37.238995 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:04:37.238995 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:04:37.238995 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:04:37.241139 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:04:37.241139 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:04:37.241139 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 20:04:37.241139 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 20:04:37.241139 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 20:04:37.241139 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 20:04:37.241139 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 20:04:37.241139 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 20:04:37.241139 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 20:04:37.241139 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 20:04:37.241139 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 20:04:37.241139 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 20:04:37.241139 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 20 20:04:37.241139 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 20 20:04:37.241139 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b461f7b6-6674-4170-8672-2f783e8907b3 is already attached to instances: b3442f69-2ce9-4c5c-b137-e09fa9317e17 Jul 20 20:04:37.241139 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:04:37.241139 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:04:37.241139 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:04:37.241139 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:04:37.241139 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:04:37.242609 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:04:37.242609 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 20:04:37.242609 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 20:04:37.242609 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b461f7b6-6674-4170-8672-2f783e8907b3 is already attached to instances: b3442f69-2ce9-4c5c-b137-e09fa9317e17 Jul 20 20:04:37.242609 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:04:37.242609 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-53cc8f87-5e9f-4194-8f16-5e85ed82b453 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Returning 400 to user: Invalid volume: volume b461f7b6-6674-4170-8672-2f783e8907b3 is already attached to instances: b3442f69-2ce9-4c5c-b137-e09fa9317e17 {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 20:04:37.242609 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-53cc8f87-5e9f-4194-8f16-5e85ed82b453 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "POST /compute/v2.1/servers/21f47247-6afa-4d0b-a3aa-3d9e87d114c2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.093941 Jul 20 20:04:37.242609 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1705/2336] 10.222.0.69 () {60 vars in 1322 bytes} [Wed Jul 20 20:04:37 2022] POST /compute/v2.1/servers/21f47247-6afa-4d0b-a3aa-3d9e87d114c2/os-volume_attachments => generated 174 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 20 20:04:37.246602 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-2f714e4b-d0dc-46f2-8708-e4f3c59f5b65 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:04:37.247093 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-2f714e4b-d0dc-46f2-8708-e4f3c59f5b65 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: 21f47247-6afa-4d0b-a3aa-3d9e87d114c2] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:04:37.252843 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2f714e4b-d0dc-46f2-8708-e4f3c59f5b65 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:04:37.253318 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2f714e4b-d0dc-46f2-8708-e4f3c59f5b65 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:04:37.254100 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2f714e4b-d0dc-46f2-8708-e4f3c59f5b65 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:04:37.254538 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2f714e4b-d0dc-46f2-8708-e4f3c59f5b65 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:04:37.281540 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-2f714e4b-d0dc-46f2-8708-e4f3c59f5b65 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: 21f47247-6afa-4d0b-a3aa-3d9e87d114c2] Going to try to terminate instance {{(pid=117761) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 20:04:37.358111 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-2f714e4b-d0dc-46f2-8708-e4f3c59f5b65 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "DELETE /compute/v2.1/servers/21f47247-6afa-4d0b-a3aa-3d9e87d114c2" status: 204 len: 0 microversion: 2.1 time: 0.114688 Jul 20 20:04:37.358847 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1706/2337] 10.222.0.69 () {58 vars in 1238 bytes} [Wed Jul 20 20:04:37 2022] DELETE /compute/v2.1/servers/21f47247-6afa-4d0b-a3aa-3d9e87d114c2 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 20:04:37.367637 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-cf6bb873-00c1-44e2-b523-b816db748446 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:04:37.368368 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-cf6bb873-00c1-44e2-b523-b816db748446 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: 21f47247-6afa-4d0b-a3aa-3d9e87d114c2] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:04:37.374447 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cf6bb873-00c1-44e2-b523-b816db748446 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:04:37.374897 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cf6bb873-00c1-44e2-b523-b816db748446 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:04:37.375658 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cf6bb873-00c1-44e2-b523-b816db748446 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:04:37.376119 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cf6bb873-00c1-44e2-b523-b816db748446 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:04:37.506839 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-cf6bb873-00c1-44e2-b523-b816db748446 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1cf9b55ce04cf997bf23ad73222814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b576df300148ad8d8d7dd3f8335f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:04:37.514410 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-cf6bb873-00c1-44e2-b523-b816db748446 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/21f47247-6afa-4d0b-a3aa-3d9e87d114c2" status: 200 len: 1682 microversion: 2.1 time: 0.150949 Jul 20 20:04:37.514969 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1707/2338] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:04:37 2022] GET /compute/v2.1/servers/21f47247-6afa-4d0b-a3aa-3d9e87d114c2 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:04:38.532857 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e9006fda-80a9-4d4b-8afd-93f3fbb2618e tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:04:38.533593 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e9006fda-80a9-4d4b-8afd-93f3fbb2618e tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: 21f47247-6afa-4d0b-a3aa-3d9e87d114c2] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:04:38.540872 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e9006fda-80a9-4d4b-8afd-93f3fbb2618e tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:04:38.541309 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e9006fda-80a9-4d4b-8afd-93f3fbb2618e tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:04:38.542087 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e9006fda-80a9-4d4b-8afd-93f3fbb2618e tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:04:38.542553 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e9006fda-80a9-4d4b-8afd-93f3fbb2618e tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:04:38.675050 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e9006fda-80a9-4d4b-8afd-93f3fbb2618e tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1cf9b55ce04cf997bf23ad73222814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b576df300148ad8d8d7dd3f8335f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:04:38.683350 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e9006fda-80a9-4d4b-8afd-93f3fbb2618e tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/21f47247-6afa-4d0b-a3aa-3d9e87d114c2" status: 200 len: 1682 microversion: 2.1 time: 0.154449 Jul 20 20:04:38.683916 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1708/2339] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:04:38 2022] GET /compute/v2.1/servers/21f47247-6afa-4d0b-a3aa-3d9e87d114c2 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:04:39.700343 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-8d94ba78-7e68-4120-9a6c-937d6e4bebe4 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:04:39.701054 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-8d94ba78-7e68-4120-9a6c-937d6e4bebe4 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: 21f47247-6afa-4d0b-a3aa-3d9e87d114c2] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:04:39.707427 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8d94ba78-7e68-4120-9a6c-937d6e4bebe4 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:04:39.707885 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8d94ba78-7e68-4120-9a6c-937d6e4bebe4 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:04:39.708688 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8d94ba78-7e68-4120-9a6c-937d6e4bebe4 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:04:39.709125 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8d94ba78-7e68-4120-9a6c-937d6e4bebe4 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:04:39.902733 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8d94ba78-7e68-4120-9a6c-937d6e4bebe4 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1cf9b55ce04cf997bf23ad73222814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b576df300148ad8d8d7dd3f8335f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:04:39.910628 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-8d94ba78-7e68-4120-9a6c-937d6e4bebe4 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/21f47247-6afa-4d0b-a3aa-3d9e87d114c2" status: 200 len: 1682 microversion: 2.1 time: 0.214130 Jul 20 20:04:39.911394 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1709/2340] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:04:39 2022] GET /compute/v2.1/servers/21f47247-6afa-4d0b-a3aa-3d9e87d114c2 => generated 1682 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 20:04:40.277843 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [req-a344130e-eb64-4da3-9bbe-90cd1d048211 req-8becc23a-bb73-4187-b04a-fcc119b5c1bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21f47247-6afa-4d0b-a3aa-3d9e87d114c2", "name": "network-vif-deleted", "tag": "05291923-3eb6-4459-b0df-7f5b4e731ab5"}]} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 20:04:40.287017 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-a344130e-eb64-4da3-9bbe-90cd1d048211 req-8becc23a-bb73-4187-b04a-fcc119b5c1bf service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:04:40.287643 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-a344130e-eb64-4da3-9bbe-90cd1d048211 req-8becc23a-bb73-4187-b04a-fcc119b5c1bf service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:04:40.300368 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.compute.server_external_events [req-a344130e-eb64-4da3-9bbe-90cd1d048211 req-8becc23a-bb73-4187-b04a-fcc119b5c1bf service nova] Creating event network-vif-deleted:05291923-3eb6-4459-b0df-7f5b4e731ab5 for instance 21f47247-6afa-4d0b-a3aa-3d9e87d114c2 on hv-cinder-83538 Jul 20 20:04:40.306664 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [req-a344130e-eb64-4da3-9bbe-90cd1d048211 req-8becc23a-bb73-4187-b04a-fcc119b5c1bf service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033791 Jul 20 20:04:40.307650 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1710/2341] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 20:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 20:04:40.929767 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-f46e72e5-a37a-4b41-8d73-6a3144d1ca5f tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:04:40.930467 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-f46e72e5-a37a-4b41-8d73-6a3144d1ca5f tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: 21f47247-6afa-4d0b-a3aa-3d9e87d114c2] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:04:40.936646 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f46e72e5-a37a-4b41-8d73-6a3144d1ca5f tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:04:40.937094 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f46e72e5-a37a-4b41-8d73-6a3144d1ca5f tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:04:40.937884 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f46e72e5-a37a-4b41-8d73-6a3144d1ca5f tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:04:40.938317 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f46e72e5-a37a-4b41-8d73-6a3144d1ca5f tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:04:40.951702 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.wsgi [None req-f46e72e5-a37a-4b41-8d73-6a3144d1ca5f tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] HTTP exception thrown: Instance 21f47247-6afa-4d0b-a3aa-3d9e87d114c2 could not be found. Jul 20 20:04:40.953369 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-f46e72e5-a37a-4b41-8d73-6a3144d1ca5f tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Request method failure captured: Jul 20 20:04:40.953369 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: GET /compute/v2.1/servers/21f47247-6afa-4d0b-a3aa-3d9e87d114c2 HTTP/1.1 Jul 20 20:04:40.953369 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 20:04:40.953369 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 20:04:40.953369 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 20:04:40.953369 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 0 Jul 20 20:04:40.953369 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 20:04:40.953369 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 20:04:40.953369 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 20:04:40.953369 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 20:04:40.953369 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2F8F6Ge10hBXuhDa0NLuoIQGKdCbH_-0Qytzgx2TiuDpG5vxQ-IW-4WPHWLIEm2lkY4j4eRPFcsjkcnP9w_FRJ3X-P89qM9tliQWnJkm78fASQt3Z_jz-B1-QjBfFR7l1gMla2jtR2bkXlUlscrWVmnS7NtJkSS_8OjKqGZtvWPk5Iw Jul 20 20:04:40.953369 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 20:04:40.953369 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 20:04:40.953369 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 20:04:40.953369 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 20:04:40.953369 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 20:04:40.953369 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 20:04:40.953369 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: b2b576df300148ad8d8d7dd3f8335f8e Jul 20 20:04:40.953369 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-AttachVolumeNegativeTest-1904845904 Jul 20 20:04:40.953369 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 20:04:40.953369 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 20:04:40.955016 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b2b576df300148ad8d8d7dd3f8335f8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b2b576df300148ad8d8d7dd3f8335f8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_b2b576df300148ad8d8d7dd3f8335f8e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/b2b576df300148ad8d8d7dd3f8335f8e"}]}] Jul 20 20:04:40.955016 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-AttachVolumeNegativeTest-1904845904 Jul 20 20:04:40.955016 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: b2b576df300148ad8d8d7dd3f8335f8e Jul 20 20:04:40.955016 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1904845904 Jul 20 20:04:40.955016 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-AttachVolumeNegativeTest-1904845904-project Jul 20 20:04:40.955016 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 20:04:40.955016 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 20:04:40.955016 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: 0d1cf9b55ce04cf997bf23ad73222814 Jul 20 20:04:40.955016 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-AttachVolumeNegativeTest-1904845904-project Jul 20 20:04:40.955016 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: > Jul 20 20:04:40.955016 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Instance 21f47247-6afa-4d0b-a3aa-3d9e87d114c2 could not be found. Jul 20 20:04:40.955016 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'id': '21f47247-6afa-4d0b-a3aa-3d9e87d114c2'} Jul 20 20:04:40.955868 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 20:04:40.955868 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:04:40.955868 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 20:04:40.955868 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 20:04:40.955868 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 20:04:40.955868 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 20:04:40.955868 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 20:04:40.955868 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 20:04:40.955868 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 20:04:40.955868 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 20:04:40.955868 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21f47247-6afa-4d0b-a3aa-3d9e87d114c2 could not be found. Jul 20 20:04:40.955868 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:04:40.955868 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:04:40.955868 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:04:40.955868 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:04:40.955868 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:04:40.955868 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:04:40.955868 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 20:04:40.955868 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 20:04:40.955868 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 20:04:40.957287 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 20:04:40.957287 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 20:04:40.957287 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 20:04:40.957287 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 20:04:40.957287 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 20:04:40.957287 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 20:04:40.957287 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 20:04:40.957287 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21f47247-6afa-4d0b-a3aa-3d9e87d114c2 could not be found. Jul 20 20:04:40.957287 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:04:40.957287 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:04:40.957287 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:04:40.957287 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:04:40.957287 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:04:40.957287 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:04:40.957287 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 20:04:40.957287 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 20:04:40.957287 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21f47247-6afa-4d0b-a3aa-3d9e87d114c2 could not be found. Jul 20 20:04:40.957287 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:04:40.959675 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-f46e72e5-a37a-4b41-8d73-6a3144d1ca5f tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Returning 404 to user: Instance 21f47247-6afa-4d0b-a3aa-3d9e87d114c2 could not be found. {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 20:04:40.959675 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-f46e72e5-a37a-4b41-8d73-6a3144d1ca5f tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/21f47247-6afa-4d0b-a3aa-3d9e87d114c2" status: 404 len: 111 microversion: 2.1 time: 0.030233 Jul 20 20:04:40.959675 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1711/2342] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:04:40 2022] GET /compute/v2.1/servers/21f47247-6afa-4d0b-a3aa-3d9e87d114c2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 20:04:40.965437 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-0f7a95c9-4cef-4a54-af9a-576e54c6fa9c tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '.version_select at 0x7ff60a4c4d30>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:04:40.985455 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-0f7a95c9-4cef-4a54-af9a-576e54c6fa9c tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1461563521" status: 202 len: 0 microversion: 2.1 time: 0.025342 Jul 20 20:04:40.986461 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1712/2343] 10.222.0.69 () {58 vars in 1220 bytes} [Wed Jul 20 20:04:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1461563521 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 20:04:41.693619 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-9b0a45c5-dba3-47e9-a514-953830283326 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:04:41.694102 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-9b0a45c5-dba3-47e9-a514-953830283326 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: b3442f69-2ce9-4c5c-b137-e09fa9317e17] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:04:41.700074 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9b0a45c5-dba3-47e9-a514-953830283326 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:04:41.700590 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9b0a45c5-dba3-47e9-a514-953830283326 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:04:41.701259 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9b0a45c5-dba3-47e9-a514-953830283326 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:04:41.701722 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9b0a45c5-dba3-47e9-a514-953830283326 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:04:41.783816 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.objects.instance [None req-9b0a45c5-dba3-47e9-a514-953830283326 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lazy-loading 'services' on Instance uuid b3442f69-2ce9-4c5c-b137-e09fa9317e17 {{(pid=117761) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 20:04:41.858123 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-9b0a45c5-dba3-47e9-a514-953830283326 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "DELETE /compute/v2.1/servers/b3442f69-2ce9-4c5c-b137-e09fa9317e17/os-volume_attachments/b461f7b6-6674-4170-8672-2f783e8907b3" status: 202 len: 0 microversion: 2.1 time: 0.168792 Jul 20 20:04:41.858716 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1713/2344] 10.222.0.69 () {58 vars in 1415 bytes} [Wed Jul 20 20:04:41 2022] DELETE /compute/v2.1/servers/b3442f69-2ce9-4c5c-b137-e09fa9317e17/os-volume_attachments/b461f7b6-6674-4170-8672-2f783e8907b3 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 20:04:41.867233 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-be9cf1a8-9ea3-4b71-bd76-2073b91d9b15 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:04:41.868237 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-be9cf1a8-9ea3-4b71-bd76-2073b91d9b15 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: b3442f69-2ce9-4c5c-b137-e09fa9317e17] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:04:41.874640 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-be9cf1a8-9ea3-4b71-bd76-2073b91d9b15 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:04:41.875093 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-be9cf1a8-9ea3-4b71-bd76-2073b91d9b15 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:04:41.875864 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-be9cf1a8-9ea3-4b71-bd76-2073b91d9b15 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:04:41.876350 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-be9cf1a8-9ea3-4b71-bd76-2073b91d9b15 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:04:41.905759 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-be9cf1a8-9ea3-4b71-bd76-2073b91d9b15 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/b3442f69-2ce9-4c5c-b137-e09fa9317e17/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042535 Jul 20 20:04:41.906319 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1714/2345] 10.222.0.69 () {58 vars in 1301 bytes} [Wed Jul 20 20:04:41 2022] GET /compute/v2.1/servers/b3442f69-2ce9-4c5c-b137-e09fa9317e17/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 20:04:42.918139 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d0418a20-dc2d-4cb4-bfdb-10483864eba6 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:04:42.919050 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d0418a20-dc2d-4cb4-bfdb-10483864eba6 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: b3442f69-2ce9-4c5c-b137-e09fa9317e17] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:04:42.925532 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d0418a20-dc2d-4cb4-bfdb-10483864eba6 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:04:42.926005 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d0418a20-dc2d-4cb4-bfdb-10483864eba6 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:04:42.926770 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d0418a20-dc2d-4cb4-bfdb-10483864eba6 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:04:42.927205 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d0418a20-dc2d-4cb4-bfdb-10483864eba6 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:04:42.956151 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d0418a20-dc2d-4cb4-bfdb-10483864eba6 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/b3442f69-2ce9-4c5c-b137-e09fa9317e17/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042015 Jul 20 20:04:42.956706 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1715/2346] 10.222.0.69 () {58 vars in 1301 bytes} [Wed Jul 20 20:04:42 2022] GET /compute/v2.1/servers/b3442f69-2ce9-4c5c-b137-e09fa9317e17/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 20:04:43.014722 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c4513895-d929-4c1c-9fc5-da23d95acc85 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:04:43.015214 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c4513895-d929-4c1c-9fc5-da23d95acc85 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: b3442f69-2ce9-4c5c-b137-e09fa9317e17] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:04:43.021184 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c4513895-d929-4c1c-9fc5-da23d95acc85 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:04:43.021679 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c4513895-d929-4c1c-9fc5-da23d95acc85 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:04:43.022609 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c4513895-d929-4c1c-9fc5-da23d95acc85 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:04:43.023052 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c4513895-d929-4c1c-9fc5-da23d95acc85 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:04:43.047769 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c4513895-d929-4c1c-9fc5-da23d95acc85 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: b3442f69-2ce9-4c5c-b137-e09fa9317e17] Going to try to terminate instance {{(pid=117761) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 20:04:43.127767 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c4513895-d929-4c1c-9fc5-da23d95acc85 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "DELETE /compute/v2.1/servers/b3442f69-2ce9-4c5c-b137-e09fa9317e17" status: 204 len: 0 microversion: 2.1 time: 0.116594 Jul 20 20:04:43.128343 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1716/2347] 10.222.0.69 () {58 vars in 1238 bytes} [Wed Jul 20 20:04:43 2022] DELETE /compute/v2.1/servers/b3442f69-2ce9-4c5c-b137-e09fa9317e17 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 20:04:43.143063 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-fcd3c12d-a4ea-4110-b9bd-450645dbba3c tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:04:43.143765 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-fcd3c12d-a4ea-4110-b9bd-450645dbba3c tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: b3442f69-2ce9-4c5c-b137-e09fa9317e17] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:04:43.149891 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fcd3c12d-a4ea-4110-b9bd-450645dbba3c tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:04:43.150338 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fcd3c12d-a4ea-4110-b9bd-450645dbba3c tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:04:43.151101 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fcd3c12d-a4ea-4110-b9bd-450645dbba3c tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:04:43.151535 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fcd3c12d-a4ea-4110-b9bd-450645dbba3c tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:04:43.298667 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-fcd3c12d-a4ea-4110-b9bd-450645dbba3c tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1cf9b55ce04cf997bf23ad73222814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b576df300148ad8d8d7dd3f8335f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:04:43.306861 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-fcd3c12d-a4ea-4110-b9bd-450645dbba3c tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/b3442f69-2ce9-4c5c-b137-e09fa9317e17" status: 200 len: 1681 microversion: 2.1 time: 0.173560 Jul 20 20:04:43.307440 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1717/2348] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:04:43 2022] GET /compute/v2.1/servers/b3442f69-2ce9-4c5c-b137-e09fa9317e17 => generated 1681 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:04:44.324858 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-2ce37135-6cab-4403-8c89-85a72bc1c762 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:04:44.325467 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-2ce37135-6cab-4403-8c89-85a72bc1c762 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: b3442f69-2ce9-4c5c-b137-e09fa9317e17] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:04:44.331953 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2ce37135-6cab-4403-8c89-85a72bc1c762 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:04:44.332400 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2ce37135-6cab-4403-8c89-85a72bc1c762 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:04:44.333158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2ce37135-6cab-4403-8c89-85a72bc1c762 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:04:44.333622 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2ce37135-6cab-4403-8c89-85a72bc1c762 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:04:44.465262 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-2ce37135-6cab-4403-8c89-85a72bc1c762 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1cf9b55ce04cf997bf23ad73222814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b576df300148ad8d8d7dd3f8335f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:04:44.473023 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-2ce37135-6cab-4403-8c89-85a72bc1c762 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/b3442f69-2ce9-4c5c-b137-e09fa9317e17" status: 200 len: 1681 microversion: 2.1 time: 0.151996 Jul 20 20:04:44.473607 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1718/2349] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:04:44 2022] GET /compute/v2.1/servers/b3442f69-2ce9-4c5c-b137-e09fa9317e17 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 20:04:45.491642 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-8f77e089-2d50-470e-9394-c5c7c2bc5fc0 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:04:45.492346 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-8f77e089-2d50-470e-9394-c5c7c2bc5fc0 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: b3442f69-2ce9-4c5c-b137-e09fa9317e17] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:04:45.501691 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8f77e089-2d50-470e-9394-c5c7c2bc5fc0 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:04:45.502152 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8f77e089-2d50-470e-9394-c5c7c2bc5fc0 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:04:45.502988 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8f77e089-2d50-470e-9394-c5c7c2bc5fc0 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:04:45.503427 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8f77e089-2d50-470e-9394-c5c7c2bc5fc0 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:04:45.508574 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 20:04:45.755826 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8f77e089-2d50-470e-9394-c5c7c2bc5fc0 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1cf9b55ce04cf997bf23ad73222814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b576df300148ad8d8d7dd3f8335f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:04:45.765555 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-8f77e089-2d50-470e-9394-c5c7c2bc5fc0 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/b3442f69-2ce9-4c5c-b137-e09fa9317e17" status: 200 len: 1681 microversion: 2.1 time: 0.278664 Jul 20 20:04:45.766134 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1719/2350] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:04:45 2022] GET /compute/v2.1/servers/b3442f69-2ce9-4c5c-b137-e09fa9317e17 => generated 1681 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:04:46.464575 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [req-231de600-660e-4663-9ce5-84f0db8c5bd6 req-9684c532-a47e-4267-8699-2e402a727954 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3442f69-2ce9-4c5c-b137-e09fa9317e17", "name": "network-vif-deleted", "tag": "ad39f13e-c5ed-4efa-bdd8-2d20d7bf6422"}]} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 20:04:46.474126 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-231de600-660e-4663-9ce5-84f0db8c5bd6 req-9684c532-a47e-4267-8699-2e402a727954 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:04:46.474732 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-231de600-660e-4663-9ce5-84f0db8c5bd6 req-9684c532-a47e-4267-8699-2e402a727954 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:04:46.486500 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.compute.server_external_events [req-231de600-660e-4663-9ce5-84f0db8c5bd6 req-9684c532-a47e-4267-8699-2e402a727954 service nova] Creating event network-vif-deleted:ad39f13e-c5ed-4efa-bdd8-2d20d7bf6422 for instance b3442f69-2ce9-4c5c-b137-e09fa9317e17 on hv-cinder-83538 Jul 20 20:04:46.492319 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [req-231de600-660e-4663-9ce5-84f0db8c5bd6 req-9684c532-a47e-4267-8699-2e402a727954 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031362 Jul 20 20:04:46.492995 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1720/2351] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 20:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 20:04:46.784683 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a2c5eb2d-7303-41fb-933b-2d391566f3fb tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:04:46.785373 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a2c5eb2d-7303-41fb-933b-2d391566f3fb tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: b3442f69-2ce9-4c5c-b137-e09fa9317e17] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:04:46.792949 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a2c5eb2d-7303-41fb-933b-2d391566f3fb tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:04:46.793431 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a2c5eb2d-7303-41fb-933b-2d391566f3fb tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:04:46.794501 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a2c5eb2d-7303-41fb-933b-2d391566f3fb tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:04:46.794938 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a2c5eb2d-7303-41fb-933b-2d391566f3fb tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:04:46.827978 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a2c5eb2d-7303-41fb-933b-2d391566f3fb tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:04:46.828421 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a2c5eb2d-7303-41fb-933b-2d391566f3fb tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:04:46.828868 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.objects.instance [None req-a2c5eb2d-7303-41fb-933b-2d391566f3fb tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lazy-loading 'fault' on Instance uuid b3442f69-2ce9-4c5c-b137-e09fa9317e17 {{(pid=117761) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 20:04:46.875954 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a2c5eb2d-7303-41fb-933b-2d391566f3fb tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1cf9b55ce04cf997bf23ad73222814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b576df300148ad8d8d7dd3f8335f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:04:46.884744 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a2c5eb2d-7303-41fb-933b-2d391566f3fb tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/b3442f69-2ce9-4c5c-b137-e09fa9317e17" status: 200 len: 1331 microversion: 2.1 time: 0.104743 Jul 20 20:04:46.885193 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1721/2352] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:04:46 2022] GET /compute/v2.1/servers/b3442f69-2ce9-4c5c-b137-e09fa9317e17 => generated 1331 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:04:47.901925 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c9e8491c-3fba-4893-af40-22434473997f tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:04:47.902597 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c9e8491c-3fba-4893-af40-22434473997f tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: b3442f69-2ce9-4c5c-b137-e09fa9317e17] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:04:47.909385 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c9e8491c-3fba-4893-af40-22434473997f tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:04:47.909881 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c9e8491c-3fba-4893-af40-22434473997f tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:04:47.910646 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c9e8491c-3fba-4893-af40-22434473997f tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:04:47.911083 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c9e8491c-3fba-4893-af40-22434473997f tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:04:47.924513 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.wsgi [None req-c9e8491c-3fba-4893-af40-22434473997f tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] HTTP exception thrown: Instance b3442f69-2ce9-4c5c-b137-e09fa9317e17 could not be found. Jul 20 20:04:47.926258 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c9e8491c-3fba-4893-af40-22434473997f tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Request method failure captured: Jul 20 20:04:47.926258 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: GET /compute/v2.1/servers/b3442f69-2ce9-4c5c-b137-e09fa9317e17 HTTP/1.1 Jul 20 20:04:47.926258 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 20:04:47.926258 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 20:04:47.926258 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 20:04:47.926258 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 0 Jul 20 20:04:47.926258 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 20:04:47.926258 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 20:04:47.926258 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 20:04:47.926258 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 20:04:47.926258 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2F8F6Ge10hBXuhDa0NLuoIQGKdCbH_-0Qytzgx2TiuDpG5vxQ-IW-4WPHWLIEm2lkY4j4eRPFcsjkcnP9w_FRJ3X-P89qM9tliQWnJkm78fASQt3Z_jz-B1-QjBfFR7l1gMla2jtR2bkXlUlscrWVmnS7NtJkSS_8OjKqGZtvWPk5Iw Jul 20 20:04:47.926258 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 20:04:47.926258 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 20:04:47.926258 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 20:04:47.926258 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 20:04:47.926258 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 20:04:47.926258 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 20:04:47.926258 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: b2b576df300148ad8d8d7dd3f8335f8e Jul 20 20:04:47.926258 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-AttachVolumeNegativeTest-1904845904 Jul 20 20:04:47.926258 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 20:04:47.926258 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 20:04:47.928025 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b2b576df300148ad8d8d7dd3f8335f8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b2b576df300148ad8d8d7dd3f8335f8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_b2b576df300148ad8d8d7dd3f8335f8e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/b2b576df300148ad8d8d7dd3f8335f8e"}]}] Jul 20 20:04:47.928025 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-AttachVolumeNegativeTest-1904845904 Jul 20 20:04:47.928025 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: b2b576df300148ad8d8d7dd3f8335f8e Jul 20 20:04:47.928025 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1904845904 Jul 20 20:04:47.928025 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-AttachVolumeNegativeTest-1904845904-project Jul 20 20:04:47.928025 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 20:04:47.928025 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 20:04:47.928025 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: 0d1cf9b55ce04cf997bf23ad73222814 Jul 20 20:04:47.928025 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-AttachVolumeNegativeTest-1904845904-project Jul 20 20:04:47.928025 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: > Jul 20 20:04:47.928025 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Instance b3442f69-2ce9-4c5c-b137-e09fa9317e17 could not be found. Jul 20 20:04:47.928025 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'id': 'b3442f69-2ce9-4c5c-b137-e09fa9317e17'} Jul 20 20:04:47.929553 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 20:04:47.929553 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:04:47.929553 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 20:04:47.929553 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 20:04:47.929553 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 20:04:47.929553 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 20:04:47.929553 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 20:04:47.929553 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 20:04:47.929553 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 20:04:47.929553 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 20:04:47.929553 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3442f69-2ce9-4c5c-b137-e09fa9317e17 could not be found. Jul 20 20:04:47.929553 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:04:47.929553 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:04:47.929553 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:04:47.929553 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:04:47.929553 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:04:47.929553 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:04:47.929553 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 20:04:47.929553 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 20:04:47.929553 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 20:04:47.931156 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 20:04:47.931156 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 20:04:47.931156 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 20:04:47.931156 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 20:04:47.931156 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 20:04:47.931156 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 20:04:47.931156 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 20:04:47.931156 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3442f69-2ce9-4c5c-b137-e09fa9317e17 could not be found. Jul 20 20:04:47.931156 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:04:47.931156 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:04:47.931156 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:04:47.931156 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:04:47.931156 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:04:47.931156 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:04:47.931156 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 20:04:47.931156 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 20:04:47.931156 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3442f69-2ce9-4c5c-b137-e09fa9317e17 could not be found. Jul 20 20:04:47.931156 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:04:47.932901 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c9e8491c-3fba-4893-af40-22434473997f tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Returning 404 to user: Instance b3442f69-2ce9-4c5c-b137-e09fa9317e17 could not be found. {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 20:04:47.932901 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c9e8491c-3fba-4893-af40-22434473997f tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/b3442f69-2ce9-4c5c-b137-e09fa9317e17" status: 404 len: 111 microversion: 2.1 time: 0.029588 Jul 20 20:04:47.932901 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1722/2353] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:04:47 2022] GET /compute/v2.1/servers/b3442f69-2ce9-4c5c-b137-e09fa9317e17 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 20:04:47.936754 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-95659846-6cd9-4ec0-89e6-d3285f1c2506 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '.version_select at 0x7ff60a08f820>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:04:47.954894 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-95659846-6cd9-4ec0-89e6-d3285f1c2506 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-533006012" status: 202 len: 0 microversion: 2.1 time: 0.021597 Jul 20 20:04:47.955463 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1723/2354] 10.222.0.69 () {58 vars in 1217 bytes} [Wed Jul 20 20:04:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-533006012 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 20:04:48.579630 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c8c3ae22-2feb-47ca-9104-07a7a9178018 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Action: 'create', calling method: .version_select at 0x7ff60a3a4700>, body: {"keypair": {"name": "tempest-keypair-1051035546", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKsQR+A90br44oLOIf8m1LzlJM4u+xKqljrZfl/uD0AioICIYEwJpVVVcMBnKSAYHL6MAOulrThET8giT9B9M5uKyQs2tv+NmSu9kC01ntGqnEp97dsBAws5wSvuWkQo5Q=="}} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 20:04:48.594444 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.quota [None req-c8c3ae22-2feb-47ca-9104-07a7a9178018 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Getting quotas for project b2b576df300148ad8d8d7dd3f8335f8e. Resources: {'key_pairs'} {{(pid=117761) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 20:04:48.598356 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.quota [None req-c8c3ae22-2feb-47ca-9104-07a7a9178018 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Getting quotas for user 0d1cf9b55ce04cf997bf23ad73222814 and project b2b576df300148ad8d8d7dd3f8335f8e. Resources: {'key_pairs'} {{(pid=117761) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 20:04:48.620628 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c8c3ae22-2feb-47ca-9104-07a7a9178018 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044884 Jul 20 20:04:48.621232 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1724/2355] 10.222.0.69 () {60 vars in 1158 bytes} [Wed Jul 20 20:04:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 20:04:49.937524 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-39fd6614-4b4f-46dc-9f37-ac345dda3d3c tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1237878176", "imageRef": "59575804-e013-4dec-af24-b6c2dbbce73a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "78c100cc-b222-4c1f-ade0-f8cea14841c5"}], "security_groups": [{"name": "tempest-securitygroup--1331320652"}], "key_name": "tempest-keypair-1051035546", "user_data": "}} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 20:04:50.051896 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.network.neutron [None req-39fd6614-4b4f-46dc-9f37-ac345dda3d3c tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] validate_networks() for [('78c100cc-b222-4c1f-ade0-f8cea14841c5', None, None, None, None, None)] {{(pid=117761) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 20:04:50.436306 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.virt.hardware [None req-39fd6614-4b4f-46dc-9f37-ac345dda3d3c tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Flavor limits 0:0:0 {{(pid=117761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 20:04:50.436728 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.virt.hardware [None req-39fd6614-4b4f-46dc-9f37-ac345dda3d3c tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Image limits 0:0:0 {{(pid=117761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 20:04:50.437199 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.virt.hardware [None req-39fd6614-4b4f-46dc-9f37-ac345dda3d3c tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Flavor pref 0:0:0 {{(pid=117761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 20:04:50.437651 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.virt.hardware [None req-39fd6614-4b4f-46dc-9f37-ac345dda3d3c tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Image pref 0:0:0 {{(pid=117761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 20:04:50.438051 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.virt.hardware [None req-39fd6614-4b4f-46dc-9f37-ac345dda3d3c tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 20:04:50.447761 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-39fd6614-4b4f-46dc-9f37-ac345dda3d3c tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:04:50.448204 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-39fd6614-4b4f-46dc-9f37-ac345dda3d3c tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:04:50.448996 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-39fd6614-4b4f-46dc-9f37-ac345dda3d3c tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:04:50.449428 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-39fd6614-4b4f-46dc-9f37-ac345dda3d3c tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:04:50.466861 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.quota [None req-39fd6614-4b4f-46dc-9f37-ac345dda3d3c tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Getting quotas for project b2b576df300148ad8d8d7dd3f8335f8e. Resources: {'cores', 'ram', 'instances'} {{(pid=117761) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 20:04:50.470787 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.quota [None req-39fd6614-4b4f-46dc-9f37-ac345dda3d3c tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Getting quotas for user 0d1cf9b55ce04cf997bf23ad73222814 and project b2b576df300148ad8d8d7dd3f8335f8e. Resources: {'cores', 'ram', 'instances'} {{(pid=117761) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 20:04:50.482317 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-39fd6614-4b4f-46dc-9f37-ac345dda3d3c tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Going to run 1 instances... {{(pid=117761) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 20:04:50.484568 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-39fd6614-4b4f-46dc-9f37-ac345dda3d3c tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: dce310ab-07be-49b9-a207-5d3f22f7b679] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='59575804-e013-4dec-af24-b6c2dbbce73a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117761) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 20:04:50.550422 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-39fd6614-4b4f-46dc-9f37-ac345dda3d3c tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.609156 Jul 20 20:04:50.550422 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1725/2356] 10.222.0.69 () {60 vars in 1146 bytes} [Wed Jul 20 20:04:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 20:04:50.552776 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4f1df404-8cb8-405d-a9df-dad311410da5 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:04:50.554303 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-4f1df404-8cb8-405d-a9df-dad311410da5 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: dce310ab-07be-49b9-a207-5d3f22f7b679] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:04:50.609605 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-4f1df404-8cb8-405d-a9df-dad311410da5 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1cf9b55ce04cf997bf23ad73222814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b576df300148ad8d8d7dd3f8335f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:04:50.618312 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-4f1df404-8cb8-405d-a9df-dad311410da5 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/dce310ab-07be-49b9-a207-5d3f22f7b679" status: 200 len: 1242 microversion: 2.1 time: 0.069812 Jul 20 20:04:50.619079 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1726/2357] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:04:50 2022] GET /compute/v2.1/servers/dce310ab-07be-49b9-a207-5d3f22f7b679 => generated 1242 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:04:51.636245 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-fe203b2e-b9f1-4ca5-812c-35ce17d9ab17 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:04:51.636906 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-fe203b2e-b9f1-4ca5-812c-35ce17d9ab17 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: dce310ab-07be-49b9-a207-5d3f22f7b679] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:04:51.646621 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fe203b2e-b9f1-4ca5-812c-35ce17d9ab17 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:04:51.647296 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fe203b2e-b9f1-4ca5-812c-35ce17d9ab17 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:04:51.648065 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fe203b2e-b9f1-4ca5-812c-35ce17d9ab17 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:04:51.648511 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fe203b2e-b9f1-4ca5-812c-35ce17d9ab17 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:04:51.714231 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-fe203b2e-b9f1-4ca5-812c-35ce17d9ab17 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1cf9b55ce04cf997bf23ad73222814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b576df300148ad8d8d7dd3f8335f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:04:51.722124 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-fe203b2e-b9f1-4ca5-812c-35ce17d9ab17 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/dce310ab-07be-49b9-a207-5d3f22f7b679" status: 200 len: 1300 microversion: 2.1 time: 0.090944 Jul 20 20:04:51.722708 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1727/2358] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:04:51 2022] GET /compute/v2.1/servers/dce310ab-07be-49b9-a207-5d3f22f7b679 => generated 1300 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:04:52.740252 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-97e0a3ff-0bfe-4174-857b-0f02d142430a tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:04:52.746910 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-97e0a3ff-0bfe-4174-857b-0f02d142430a tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: dce310ab-07be-49b9-a207-5d3f22f7b679] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:04:52.754605 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-97e0a3ff-0bfe-4174-857b-0f02d142430a tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:04:52.755062 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-97e0a3ff-0bfe-4174-857b-0f02d142430a tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:04:52.757408 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-97e0a3ff-0bfe-4174-857b-0f02d142430a tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:04:52.757925 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-97e0a3ff-0bfe-4174-857b-0f02d142430a tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:04:52.971634 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-97e0a3ff-0bfe-4174-857b-0f02d142430a tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1cf9b55ce04cf997bf23ad73222814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b576df300148ad8d8d7dd3f8335f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:04:52.979907 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-97e0a3ff-0bfe-4174-857b-0f02d142430a tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/dce310ab-07be-49b9-a207-5d3f22f7b679" status: 200 len: 1368 microversion: 2.1 time: 0.243476 Jul 20 20:04:52.980483 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1728/2359] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:04:52 2022] GET /compute/v2.1/servers/dce310ab-07be-49b9-a207-5d3f22f7b679 => generated 1368 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 20:04:53.049814 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [req-531c5025-60a0-4516-89ae-f54b8fdd70ff req-f8dc8115-b091-45df-af3d-1ef80b9129cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dce310ab-07be-49b9-a207-5d3f22f7b679", "tag": "818a3272-6cb4-42f4-b1a1-5f62c12568c5"}]} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 20:04:53.073905 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-531c5025-60a0-4516-89ae-f54b8fdd70ff req-f8dc8115-b091-45df-af3d-1ef80b9129cd service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:04:53.074351 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-531c5025-60a0-4516-89ae-f54b8fdd70ff req-f8dc8115-b091-45df-af3d-1ef80b9129cd service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:04:53.086602 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.compute.server_external_events [req-531c5025-60a0-4516-89ae-f54b8fdd70ff req-f8dc8115-b091-45df-af3d-1ef80b9129cd service nova] Creating event network-changed:818a3272-6cb4-42f4-b1a1-5f62c12568c5 for instance dce310ab-07be-49b9-a207-5d3f22f7b679 on hv-cinder-83538 Jul 20 20:04:53.091687 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [req-531c5025-60a0-4516-89ae-f54b8fdd70ff req-f8dc8115-b091-45df-af3d-1ef80b9129cd service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046019 Jul 20 20:04:53.092441 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1729/2360] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 20:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 20:04:53.998280 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-b4b768cd-faed-49fa-9647-cc7cc8db8480 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:04:53.998940 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-b4b768cd-faed-49fa-9647-cc7cc8db8480 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: dce310ab-07be-49b9-a207-5d3f22f7b679] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:04:54.001952 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 20:04:54.005907 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b4b768cd-faed-49fa-9647-cc7cc8db8480 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:04:54.007037 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b4b768cd-faed-49fa-9647-cc7cc8db8480 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:04:54.007871 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b4b768cd-faed-49fa-9647-cc7cc8db8480 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:04:54.008306 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b4b768cd-faed-49fa-9647-cc7cc8db8480 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:04:54.143136 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-b4b768cd-faed-49fa-9647-cc7cc8db8480 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1cf9b55ce04cf997bf23ad73222814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b576df300148ad8d8d7dd3f8335f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:04:54.150849 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-b4b768cd-faed-49fa-9647-cc7cc8db8480 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/dce310ab-07be-49b9-a207-5d3f22f7b679" status: 200 len: 1368 microversion: 2.1 time: 0.157309 Jul 20 20:04:54.151421 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1730/2361] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:04:53 2022] GET /compute/v2.1/servers/dce310ab-07be-49b9-a207-5d3f22f7b679 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:04:55.168355 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-1648df02-4b50-4c09-a1b7-c8246bc3a466 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:04:55.169059 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-1648df02-4b50-4c09-a1b7-c8246bc3a466 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: dce310ab-07be-49b9-a207-5d3f22f7b679] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:04:55.175667 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1648df02-4b50-4c09-a1b7-c8246bc3a466 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:04:55.176120 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1648df02-4b50-4c09-a1b7-c8246bc3a466 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:04:55.176892 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1648df02-4b50-4c09-a1b7-c8246bc3a466 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:04:55.177328 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1648df02-4b50-4c09-a1b7-c8246bc3a466 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:04:55.333682 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1648df02-4b50-4c09-a1b7-c8246bc3a466 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1cf9b55ce04cf997bf23ad73222814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b576df300148ad8d8d7dd3f8335f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:04:55.341784 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-1648df02-4b50-4c09-a1b7-c8246bc3a466 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/dce310ab-07be-49b9-a207-5d3f22f7b679" status: 200 len: 1368 microversion: 2.1 time: 0.177193 Jul 20 20:04:55.342368 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1731/2362] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:04:55 2022] GET /compute/v2.1/servers/dce310ab-07be-49b9-a207-5d3f22f7b679 => generated 1368 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:04:56.359054 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-7f9ba860-bede-4eb9-a60a-dddcc48d3354 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:04:56.359736 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-7f9ba860-bede-4eb9-a60a-dddcc48d3354 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: dce310ab-07be-49b9-a207-5d3f22f7b679] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:04:56.367001 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7f9ba860-bede-4eb9-a60a-dddcc48d3354 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:04:56.367442 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7f9ba860-bede-4eb9-a60a-dddcc48d3354 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:04:56.368192 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7f9ba860-bede-4eb9-a60a-dddcc48d3354 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:04:56.368620 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7f9ba860-bede-4eb9-a60a-dddcc48d3354 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:04:56.507799 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-7f9ba860-bede-4eb9-a60a-dddcc48d3354 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1cf9b55ce04cf997bf23ad73222814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b576df300148ad8d8d7dd3f8335f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:04:56.515099 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-7f9ba860-bede-4eb9-a60a-dddcc48d3354 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/dce310ab-07be-49b9-a207-5d3f22f7b679" status: 200 len: 1368 microversion: 2.1 time: 0.159845 Jul 20 20:04:56.515657 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1732/2363] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:04:56 2022] GET /compute/v2.1/servers/dce310ab-07be-49b9-a207-5d3f22f7b679 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:04:57.532277 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-83aedcbb-84df-42c1-a47d-626c44650550 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:04:57.532949 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-83aedcbb-84df-42c1-a47d-626c44650550 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: dce310ab-07be-49b9-a207-5d3f22f7b679] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:04:57.540297 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-83aedcbb-84df-42c1-a47d-626c44650550 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:04:57.540747 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-83aedcbb-84df-42c1-a47d-626c44650550 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:04:57.541532 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-83aedcbb-84df-42c1-a47d-626c44650550 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:04:57.541985 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-83aedcbb-84df-42c1-a47d-626c44650550 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:04:57.675970 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-83aedcbb-84df-42c1-a47d-626c44650550 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1cf9b55ce04cf997bf23ad73222814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b576df300148ad8d8d7dd3f8335f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:04:57.684024 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-83aedcbb-84df-42c1-a47d-626c44650550 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/dce310ab-07be-49b9-a207-5d3f22f7b679" status: 200 len: 1368 microversion: 2.1 time: 0.155548 Jul 20 20:04:57.684590 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1733/2364] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:04:57 2022] GET /compute/v2.1/servers/dce310ab-07be-49b9-a207-5d3f22f7b679 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:04:58.701209 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-7351514f-a1de-47ea-b3bd-54a312fe987f tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:04:58.701973 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-7351514f-a1de-47ea-b3bd-54a312fe987f tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: dce310ab-07be-49b9-a207-5d3f22f7b679] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:04:58.708254 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7351514f-a1de-47ea-b3bd-54a312fe987f tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:04:58.708690 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7351514f-a1de-47ea-b3bd-54a312fe987f tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:04:58.709797 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7351514f-a1de-47ea-b3bd-54a312fe987f tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:04:58.710328 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7351514f-a1de-47ea-b3bd-54a312fe987f tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:04:58.846408 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-7351514f-a1de-47ea-b3bd-54a312fe987f tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1cf9b55ce04cf997bf23ad73222814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b576df300148ad8d8d7dd3f8335f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:04:58.855046 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-7351514f-a1de-47ea-b3bd-54a312fe987f tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/dce310ab-07be-49b9-a207-5d3f22f7b679" status: 200 len: 1368 microversion: 2.1 time: 0.157747 Jul 20 20:04:58.855620 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1734/2365] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:04:58 2022] GET /compute/v2.1/servers/dce310ab-07be-49b9-a207-5d3f22f7b679 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:04:59.204396 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [req-36c5f0d5-041a-4738-9fb7-908c778dfaa3 req-2cda7599-bff6-4deb-9738-5606a6d54a02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dce310ab-07be-49b9-a207-5d3f22f7b679", "name": "network-vif-plugged", "status": "completed", "tag": "818a3272-6cb4-42f4-b1a1-5f62c12568c5"}]} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 20:04:59.213406 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-36c5f0d5-041a-4738-9fb7-908c778dfaa3 req-2cda7599-bff6-4deb-9738-5606a6d54a02 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:04:59.213890 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-36c5f0d5-041a-4738-9fb7-908c778dfaa3 req-2cda7599-bff6-4deb-9738-5606a6d54a02 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:04:59.226837 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.compute.server_external_events [req-36c5f0d5-041a-4738-9fb7-908c778dfaa3 req-2cda7599-bff6-4deb-9738-5606a6d54a02 service nova] Creating event network-vif-plugged:818a3272-6cb4-42f4-b1a1-5f62c12568c5 for instance dce310ab-07be-49b9-a207-5d3f22f7b679 on hv-cinder-83538 Jul 20 20:04:59.232018 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [req-36c5f0d5-041a-4738-9fb7-908c778dfaa3 req-2cda7599-bff6-4deb-9738-5606a6d54a02 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031368 Jul 20 20:04:59.232947 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1735/2366] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 20:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 20:04:59.873646 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-cbf87b04-cfda-4fe4-a489-eb558116fdb0 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:04:59.874336 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-cbf87b04-cfda-4fe4-a489-eb558116fdb0 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: dce310ab-07be-49b9-a207-5d3f22f7b679] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:04:59.880549 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cbf87b04-cfda-4fe4-a489-eb558116fdb0 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:04:59.881759 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cbf87b04-cfda-4fe4-a489-eb558116fdb0 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:04:59.882539 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cbf87b04-cfda-4fe4-a489-eb558116fdb0 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:04:59.882975 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cbf87b04-cfda-4fe4-a489-eb558116fdb0 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:00.018457 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-cbf87b04-cfda-4fe4-a489-eb558116fdb0 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1cf9b55ce04cf997bf23ad73222814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b576df300148ad8d8d7dd3f8335f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:05:00.026489 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-cbf87b04-cfda-4fe4-a489-eb558116fdb0 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/dce310ab-07be-49b9-a207-5d3f22f7b679" status: 200 len: 1368 microversion: 2.1 time: 0.157488 Jul 20 20:05:00.027070 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1736/2367] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:04:59 2022] GET /compute/v2.1/servers/dce310ab-07be-49b9-a207-5d3f22f7b679 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:05:00.198864 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-92d5f577-cf96-4fa6-9c8a-c0a3dc537fbf tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:05:00.199345 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-92d5f577-cf96-4fa6-9c8a-c0a3dc537fbf tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:05:00.205253 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-92d5f577-cf96-4fa6-9c8a-c0a3dc537fbf tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:00.205731 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-92d5f577-cf96-4fa6-9c8a-c0a3dc537fbf tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:00.206482 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-92d5f577-cf96-4fa6-9c8a-c0a3dc537fbf tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:00.206906 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-92d5f577-cf96-4fa6-9c8a-c0a3dc537fbf tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:00.235194 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-92d5f577-cf96-4fa6-9c8a-c0a3dc537fbf tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Going to try to terminate instance {{(pid=117761) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 20:05:00.242377 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.compute.api [None req-92d5f577-cf96-4fa6-9c8a-c0a3dc537fbf tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Working on deleting snapshot 3c3596de-78aa-443a-b824-84fe141f7ab3 from shelved instance... Jul 20 20:05:00.457857 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell0:SELECT=2 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 20:05:00.614096 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell0:SELECT=12 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 20:05:00.931503 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-92d5f577-cf96-4fa6-9c8a-c0a3dc537fbf tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Doing local delete in cell 691618a6-9620-40ee-ad72-b687b651ed73(cell1) {{(pid=117761) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jul 20 20:05:00.932225 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-92d5f577-cf96-4fa6-9c8a-c0a3dc537fbf tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:00.932662 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-92d5f577-cf96-4fa6-9c8a-c0a3dc537fbf tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:00.933277 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.compute.api [None req-92d5f577-cf96-4fa6-9c8a-c0a3dc537fbf tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jul 20 20:05:00.937267 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.network.neutron [None req-92d5f577-cf96-4fa6-9c8a-c0a3dc537fbf tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] deallocate_for_instance() {{(pid=117761) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 20 20:05:01.824259 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.network.neutron [None req-92d5f577-cf96-4fa6-9c8a-c0a3dc537fbf tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Updating instance_info_cache with network_info: [] {{(pid=117761) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 20 20:05:02.335786 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.scheduler.client.report [None req-92d5f577-cf96-4fa6-9c8a-c0a3dc537fbf tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Deleted allocations for instance 3b2abd53-4758-462c-b36a-0d1bf0b66a55 Jul 20 20:05:02.398297 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=6,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 20:05:02.476148 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-92d5f577-cf96-4fa6-9c8a-c0a3dc537fbf tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "DELETE /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 204 len: 0 microversion: 2.20 time: 2.281042 Jul 20 20:05:02.476841 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1737/2368] 10.222.0.69 () {60 vars in 1279 bytes} [Wed Jul 20 20:05:00 2022] DELETE /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 0 bytes in 2282 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 20:05:02.482122 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ab58c66d-63ae-4a74-982a-d27355b1c9e6 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:05:02.482832 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ab58c66d-63ae-4a74-982a-d27355b1c9e6 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: dce310ab-07be-49b9-a207-5d3f22f7b679] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:05:02.488948 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ab58c66d-63ae-4a74-982a-d27355b1c9e6 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:02.489399 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ab58c66d-63ae-4a74-982a-d27355b1c9e6 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:02.490819 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ab58c66d-63ae-4a74-982a-d27355b1c9e6 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:02.491434 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ab58c66d-63ae-4a74-982a-d27355b1c9e6 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:02.643839 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ab58c66d-63ae-4a74-982a-d27355b1c9e6 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1cf9b55ce04cf997bf23ad73222814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b576df300148ad8d8d7dd3f8335f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:05:02.652651 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ab58c66d-63ae-4a74-982a-d27355b1c9e6 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/dce310ab-07be-49b9-a207-5d3f22f7b679" status: 200 len: 1558 microversion: 2.1 time: 0.174593 Jul 20 20:05:02.653256 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1738/2369] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:05:02 2022] GET /compute/v2.1/servers/dce310ab-07be-49b9-a207-5d3f22f7b679 => generated 1558 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 20:05:02.657728 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [req-63dd8ae5-d82f-4df6-8216-dc3c52f54c57 req-f611f8fa-3cc2-46df-9a92-6a1b5cb948c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b2abd53-4758-462c-b36a-0d1bf0b66a55", "name": "network-vif-deleted", "tag": "3232872d-df06-40e7-a7c3-7cc3babe684d"}]} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 20:05:02.666923 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-63dd8ae5-d82f-4df6-8216-dc3c52f54c57 req-f611f8fa-3cc2-46df-9a92-6a1b5cb948c4 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:02.667367 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-63dd8ae5-d82f-4df6-8216-dc3c52f54c57 req-f611f8fa-3cc2-46df-9a92-6a1b5cb948c4 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:02.679813 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.compute.server_external_events [req-63dd8ae5-d82f-4df6-8216-dc3c52f54c57 req-f611f8fa-3cc2-46df-9a92-6a1b5cb948c4 service nova] Unable to find a host for instance 3b2abd53-4758-462c-b36a-0d1bf0b66a55. Dropping event network-vif-deleted {{(pid=117761) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 20 20:05:02.680711 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [req-63dd8ae5-d82f-4df6-8216-dc3c52f54c57 req-f611f8fa-3cc2-46df-9a92-6a1b5cb948c4 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.026492 Jul 20 20:05:02.681312 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1739/2370] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 20:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 20 20:05:02.685852 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c75bb0d0-c51f-464f-a5bc-b9005ddf60fb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:05:02.686455 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c75bb0d0-c51f-464f-a5bc-b9005ddf60fb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:05:02.692510 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c75bb0d0-c51f-464f-a5bc-b9005ddf60fb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:02.692958 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c75bb0d0-c51f-464f-a5bc-b9005ddf60fb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:02.695096 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c75bb0d0-c51f-464f-a5bc-b9005ddf60fb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:02.695096 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c75bb0d0-c51f-464f-a5bc-b9005ddf60fb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:02.712039 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.wsgi [None req-c75bb0d0-c51f-464f-a5bc-b9005ddf60fb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] HTTP exception thrown: Instance 3b2abd53-4758-462c-b36a-0d1bf0b66a55 could not be found. Jul 20 20:05:02.713736 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c75bb0d0-c51f-464f-a5bc-b9005ddf60fb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Request method failure captured: Jul 20 20:05:02.713736 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 HTTP/1.1 Jul 20 20:05:02.713736 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 20:05:02.713736 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 20:05:02.713736 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 20:05:02.713736 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 0 Jul 20 20:05:02.713736 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 20:05:02.713736 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 20:05:02.713736 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 20:05:02.713736 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 20:05:02.713736 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2FZC6TLk9RyUoa-CnTzn6cQxntNIPmSHf4VFFjH4WEFcoeAmBV9hwPBPtC5Rl2l-XF4LktNbG9iGige5chaqXsYkrW0lRRuajMs1WJGqI2iOeUuFsH3YqbZ4MaB0FsoB66owZGpWtFZWEg7-b4uFtfLjY2JdEYIydzfjK6rmwA9rAok Jul 20 20:05:02.713736 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 20:05:02.713736 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 20:05:02.713736 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 20:05:02.713736 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 20:05:02.713736 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 20:05:02.713736 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 20:05:02.713736 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 20:05:02.713736 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: e6e0bccb45a24af3918f7db2c60de33d Jul 20 20:05:02.713736 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1947755824 Jul 20 20:05:02.713736 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 20:05:02.713736 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 20:05:02.716502 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e6e0bccb45a24af3918f7db2c60de33d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e6e0bccb45a24af3918f7db2c60de33d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_e6e0bccb45a24af3918f7db2c60de33d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/e6e0bccb45a24af3918f7db2c60de33d"}]}] Jul 20 20:05:02.716502 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1947755824 Jul 20 20:05:02.716502 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: e6e0bccb45a24af3918f7db2c60de33d Jul 20 20:05:02.716502 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1947755824 Jul 20 20:05:02.716502 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-AttachVolumeShelveTestJSON-1947755824-project Jul 20 20:05:02.716502 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 20:05:02.716502 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 20:05:02.716502 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: 343e480dd5ee4389ba430129cd7daaa4 Jul 20 20:05:02.716502 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1947755824-project Jul 20 20:05:02.716502 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: > Jul 20 20:05:02.716502 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Instance 3b2abd53-4758-462c-b36a-0d1bf0b66a55 could not be found. Jul 20 20:05:02.716502 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'id': '3b2abd53-4758-462c-b36a-0d1bf0b66a55'} Jul 20 20:05:02.717433 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 20:05:02.717433 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:05:02.717433 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 20:05:02.717433 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 20:05:02.717433 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 20:05:02.717433 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 20:05:02.717433 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 20:05:02.717433 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 20:05:02.717433 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 20:05:02.717433 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 20:05:02.717433 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b2abd53-4758-462c-b36a-0d1bf0b66a55 could not be found. Jul 20 20:05:02.717433 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:05:02.717433 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:05:02.717433 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:05:02.717433 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:05:02.717433 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:05:02.717433 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:05:02.717433 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 20:05:02.717433 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 20:05:02.717433 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 20:05:02.718956 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 20:05:02.718956 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 20:05:02.718956 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 20:05:02.718956 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 20:05:02.718956 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 20:05:02.718956 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 20:05:02.718956 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 20:05:02.718956 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b2abd53-4758-462c-b36a-0d1bf0b66a55 could not be found. Jul 20 20:05:02.718956 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:05:02.718956 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:05:02.718956 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:05:02.718956 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:05:02.718956 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:05:02.718956 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:05:02.718956 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 20:05:02.718956 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 20:05:02.718956 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b2abd53-4758-462c-b36a-0d1bf0b66a55 could not be found. Jul 20 20:05:02.718956 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:05:02.720307 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c75bb0d0-c51f-464f-a5bc-b9005ddf60fb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Returning 404 to user: Instance 3b2abd53-4758-462c-b36a-0d1bf0b66a55 could not be found. {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 20:05:02.720307 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c75bb0d0-c51f-464f-a5bc-b9005ddf60fb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 404 len: 111 microversion: 2.20 time: 0.032869 Jul 20 20:05:02.720307 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1740/2371] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:05:02 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 20:05:02.720572 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-edb80100-80f1-4e69-86cd-c4ea2f80a781 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:05:02.721061 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-edb80100-80f1-4e69-86cd-c4ea2f80a781 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: dce310ab-07be-49b9-a207-5d3f22f7b679] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:05:02.728164 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-edb80100-80f1-4e69-86cd-c4ea2f80a781 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:02.728603 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-edb80100-80f1-4e69-86cd-c4ea2f80a781 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:02.729379 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-edb80100-80f1-4e69-86cd-c4ea2f80a781 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:02.729842 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-edb80100-80f1-4e69-86cd-c4ea2f80a781 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:02.810005 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-edb80100-80f1-4e69-86cd-c4ea2f80a781 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/dce310ab-07be-49b9-a207-5d3f22f7b679/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092049 Jul 20 20:05:02.810005 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1741/2372] 10.222.0.69 () {58 vars in 1274 bytes} [Wed Jul 20 20:05:02 2022] GET /compute/v2.1/servers/dce310ab-07be-49b9-a207-5d3f22f7b679/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 20:05:02.814501 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ec578081-37b2-412f-bc74-25466d19d47e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '.version_select at 0x7ff60a2a3790>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:05:02.836321 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ec578081-37b2-412f-bc74-25466d19d47e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-543896985" status: 204 len: 0 microversion: 2.20 time: 0.025625 Jul 20 20:05:02.840871 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1742/2373] 10.222.0.69 () {60 vars in 1258 bytes} [Wed Jul 20 20:05:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-543896985 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 20:05:03.253068 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-1d7cf1df-af09-4f32-8c31-bec143921345 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:05:03.253569 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-1d7cf1df-af09-4f32-8c31-bec143921345 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:05:03.262714 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1d7cf1df-af09-4f32-8c31-bec143921345 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:03.263162 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1d7cf1df-af09-4f32-8c31-bec143921345 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:03.264356 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1d7cf1df-af09-4f32-8c31-bec143921345 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:03.264810 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1d7cf1df-af09-4f32-8c31-bec143921345 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:03.292696 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-1d7cf1df-af09-4f32-8c31-bec143921345 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Going to try to terminate instance {{(pid=117761) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 20:05:03.381351 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-1d7cf1df-af09-4f32-8c31-bec143921345 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "DELETE /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a" status: 204 len: 0 microversion: 2.1 time: 0.130078 Jul 20 20:05:03.386002 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1743/2374] 10.222.0.69 () {58 vars in 1238 bytes} [Wed Jul 20 20:05:03 2022] DELETE /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 20:05:03.392360 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-03188958-160e-4e51-ab0e-7d5be097afb7 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:05:03.393116 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-03188958-160e-4e51-ab0e-7d5be097afb7 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:05:03.401704 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-03188958-160e-4e51-ab0e-7d5be097afb7 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:03.402278 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-03188958-160e-4e51-ab0e-7d5be097afb7 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:03.403800 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-03188958-160e-4e51-ab0e-7d5be097afb7 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:03.404283 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-03188958-160e-4e51-ab0e-7d5be097afb7 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:03.583084 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-03188958-160e-4e51-ab0e-7d5be097afb7 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:05:03.596304 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-03188958-160e-4e51-ab0e-7d5be097afb7 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a" status: 200 len: 1720 microversion: 2.1 time: 0.208200 Jul 20 20:05:03.606533 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1744/2375] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:05:03 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a => generated 1720 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 20:05:03.736451 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-b3bfb989-124c-43f3-899e-672ff345a6a3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Action: 'create', calling method: .version_select at 0x7ff609fb71f0>, body: {"keypair": {"name": "tempest-keypair-1987905101", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGs4QL+s2vPdc8l3A2z1GAl+5Rm1nE7KZ/1r+tm616s4Yzn7QALOwCboRsLrlLIbKXYssOloyAYHdkcYWuBOxix1Gd1iR5ZiayXaTS/6D1kX+QwtqYUua2K+IM7dEGiYAQ=="}} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 20:05:03.753896 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.quota [None req-b3bfb989-124c-43f3-899e-672ff345a6a3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Getting quotas for project e6e0bccb45a24af3918f7db2c60de33d. Resources: {'key_pairs'} {{(pid=117761) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 20:05:03.758916 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.quota [None req-b3bfb989-124c-43f3-899e-672ff345a6a3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Getting quotas for user 343e480dd5ee4389ba430129cd7daaa4 and project e6e0bccb45a24af3918f7db2c60de33d. Resources: {'key_pairs'} {{(pid=117761) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 20:05:03.786045 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-b3bfb989-124c-43f3-899e-672ff345a6a3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.053665 Jul 20 20:05:03.786669 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1745/2376] 10.222.0.69 () {62 vars in 1199 bytes} [Wed Jul 20 20:05:03 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 55 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 20 20:05:03.854618 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [req-8241ea2b-1d51-4766-bece-9e4ff9a463b0 req-31bfd4f7-4703-4412-901a-78627ec066bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dce310ab-07be-49b9-a207-5d3f22f7b679", "tag": "818a3272-6cb4-42f4-b1a1-5f62c12568c5"}]} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 20:05:03.863079 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-8241ea2b-1d51-4766-bece-9e4ff9a463b0 req-31bfd4f7-4703-4412-901a-78627ec066bf service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:03.863551 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-8241ea2b-1d51-4766-bece-9e4ff9a463b0 req-31bfd4f7-4703-4412-901a-78627ec066bf service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:03.876248 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.compute.server_external_events [req-8241ea2b-1d51-4766-bece-9e4ff9a463b0 req-31bfd4f7-4703-4412-901a-78627ec066bf service nova] Creating event network-changed:818a3272-6cb4-42f4-b1a1-5f62c12568c5 for instance dce310ab-07be-49b9-a207-5d3f22f7b679 on hv-cinder-83538 Jul 20 20:05:03.881387 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [req-8241ea2b-1d51-4766-bece-9e4ff9a463b0 req-31bfd4f7-4703-4412-901a-78627ec066bf service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031701 Jul 20 20:05:03.882057 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1746/2377] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 20:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 20:05:04.618960 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-3b32850d-5f6e-4adf-8a20-fa33a65991f9 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:05:04.620512 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-3b32850d-5f6e-4adf-8a20-fa33a65991f9 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:05:04.628662 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3b32850d-5f6e-4adf-8a20-fa33a65991f9 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:04.629111 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3b32850d-5f6e-4adf-8a20-fa33a65991f9 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:04.630110 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3b32850d-5f6e-4adf-8a20-fa33a65991f9 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:04.630743 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3b32850d-5f6e-4adf-8a20-fa33a65991f9 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:04.990656 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3b32850d-5f6e-4adf-8a20-fa33a65991f9 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:05:05.016391 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-3b32850d-5f6e-4adf-8a20-fa33a65991f9 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a" status: 200 len: 1720 microversion: 2.1 time: 0.403548 Jul 20 20:05:05.019707 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1747/2378] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:05:04 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a => generated 1720 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 20:05:05.571028 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c7febb12-d0c4-41f7-a572-f3fd0b6f3b69 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-465165385", "imageRef": "59575804-e013-4dec-af24-b6c2dbbce73a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "38fecd6a-64fe-4f75-b0f6-54a5c956d554"}], "security_groups": [{"name": "tempest-securitygroup--803313606"}], "key_name": "tempest-keypair-1987905101", "user_data": "}} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 20:05:05.691567 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.network.neutron [None req-c7febb12-d0c4-41f7-a572-f3fd0b6f3b69 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] validate_networks() for [('38fecd6a-64fe-4f75-b0f6-54a5c956d554', None, None, None, None, None)] {{(pid=117761) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 20:05:06.201702 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.virt.hardware [None req-c7febb12-d0c4-41f7-a572-f3fd0b6f3b69 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Flavor limits 0:0:0 {{(pid=117761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 20:05:06.202255 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.virt.hardware [None req-c7febb12-d0c4-41f7-a572-f3fd0b6f3b69 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Image limits 0:0:0 {{(pid=117761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 20:05:06.202934 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.virt.hardware [None req-c7febb12-d0c4-41f7-a572-f3fd0b6f3b69 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Flavor pref 0:0:0 {{(pid=117761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 20:05:06.203338 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.virt.hardware [None req-c7febb12-d0c4-41f7-a572-f3fd0b6f3b69 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Image pref 0:0:0 {{(pid=117761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 20:05:06.203742 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.virt.hardware [None req-c7febb12-d0c4-41f7-a572-f3fd0b6f3b69 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 20:05:06.214961 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c7febb12-d0c4-41f7-a572-f3fd0b6f3b69 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:06.216060 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c7febb12-d0c4-41f7-a572-f3fd0b6f3b69 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:06.216768 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c7febb12-d0c4-41f7-a572-f3fd0b6f3b69 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:06.217447 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c7febb12-d0c4-41f7-a572-f3fd0b6f3b69 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:06.236945 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.quota [None req-c7febb12-d0c4-41f7-a572-f3fd0b6f3b69 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Getting quotas for project e6e0bccb45a24af3918f7db2c60de33d. Resources: {'cores', 'ram', 'instances'} {{(pid=117761) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 20:05:06.242270 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.quota [None req-c7febb12-d0c4-41f7-a572-f3fd0b6f3b69 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Getting quotas for user 343e480dd5ee4389ba430129cd7daaa4 and project e6e0bccb45a24af3918f7db2c60de33d. Resources: {'cores', 'ram', 'instances'} {{(pid=117761) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 20:05:06.253254 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c7febb12-d0c4-41f7-a572-f3fd0b6f3b69 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Going to run 1 instances... {{(pid=117761) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 20:05:06.255934 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c7febb12-d0c4-41f7-a572-f3fd0b6f3b69 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='59575804-e013-4dec-af24-b6c2dbbce73a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117761) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 20:05:06.306505 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c7febb12-d0c4-41f7-a572-f3fd0b6f3b69 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.740873 Jul 20 20:05:06.307171 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1748/2379] 10.222.0.69 () {62 vars in 1187 bytes} [Wed Jul 20 20:05:05 2022] POST /compute/v2.1/servers => generated 401 bytes in 742 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 20 20:05:06.315860 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [req-6981bb7c-6564-4fc5-8749-4f5a0361ee52 req-67fa502e-8293-46f2-8b64-1bc346b34c13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c33037ed-7b36-43aa-85ad-e48920801b0a", "name": "network-vif-deleted", "tag": "d530fbe6-76ab-41fc-9fa3-b088835bc0da"}]} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 20:05:06.325886 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-6981bb7c-6564-4fc5-8749-4f5a0361ee52 req-67fa502e-8293-46f2-8b64-1bc346b34c13 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:06.326398 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-6981bb7c-6564-4fc5-8749-4f5a0361ee52 req-67fa502e-8293-46f2-8b64-1bc346b34c13 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:06.337667 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.compute.server_external_events [req-6981bb7c-6564-4fc5-8749-4f5a0361ee52 req-67fa502e-8293-46f2-8b64-1bc346b34c13 service nova] Creating event network-vif-deleted:d530fbe6-76ab-41fc-9fa3-b088835bc0da for instance c33037ed-7b36-43aa-85ad-e48920801b0a on hv-cinder-83538 Jul 20 20:05:06.342730 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [req-6981bb7c-6564-4fc5-8749-4f5a0361ee52 req-67fa502e-8293-46f2-8b64-1bc346b34c13 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034440 Jul 20 20:05:06.343499 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1749/2380] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 20:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 20:05:06.348613 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-16a6c758-7911-404b-8ba5-8705eaa9d850 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:05:06.349999 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-16a6c758-7911-404b-8ba5-8705eaa9d850 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:05:06.356988 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-16a6c758-7911-404b-8ba5-8705eaa9d850 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:06.357499 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-16a6c758-7911-404b-8ba5-8705eaa9d850 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:06.358667 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-16a6c758-7911-404b-8ba5-8705eaa9d850 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:06.358801 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-16a6c758-7911-404b-8ba5-8705eaa9d850 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:06.393801 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-16a6c758-7911-404b-8ba5-8705eaa9d850 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:06.394381 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-16a6c758-7911-404b-8ba5-8705eaa9d850 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:06.394840 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.objects.instance [None req-16a6c758-7911-404b-8ba5-8705eaa9d850 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lazy-loading 'fault' on Instance uuid c33037ed-7b36-43aa-85ad-e48920801b0a {{(pid=117761) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 20:05:06.446616 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-16a6c758-7911-404b-8ba5-8705eaa9d850 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:05:06.455322 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-16a6c758-7911-404b-8ba5-8705eaa9d850 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a" status: 200 len: 1463 microversion: 2.1 time: 0.110346 Jul 20 20:05:06.455642 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1750/2381] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:05:06 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a => generated 1463 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 20:05:06.461427 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-0d75e2d4-4c9f-4245-b7b0-00521f1a9074 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:05:06.461839 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-0d75e2d4-4c9f-4245-b7b0-00521f1a9074 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:05:06.535244 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0d75e2d4-4c9f-4245-b7b0-00521f1a9074 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:05:06.548339 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0d75e2d4-4c9f-4245-b7b0-00521f1a9074 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:05:06.550188 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0d75e2d4-4c9f-4245-b7b0-00521f1a9074 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:05:06.551660 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-0d75e2d4-4c9f-4245-b7b0-00521f1a9074 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1281 microversion: 2.20 time: 0.094860 Jul 20 20:05:06.552269 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1751/2382] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:05:06 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1281 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 20:05:07.477853 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d42219ed-df69-46e8-b3a5-e1ff53d7d737 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:05:07.479826 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d42219ed-df69-46e8-b3a5-e1ff53d7d737 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:05:07.486870 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d42219ed-df69-46e8-b3a5-e1ff53d7d737 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:07.487312 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d42219ed-df69-46e8-b3a5-e1ff53d7d737 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:07.488065 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d42219ed-df69-46e8-b3a5-e1ff53d7d737 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:07.488706 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d42219ed-df69-46e8-b3a5-e1ff53d7d737 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:07.503771 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.wsgi [None req-d42219ed-df69-46e8-b3a5-e1ff53d7d737 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] HTTP exception thrown: Instance c33037ed-7b36-43aa-85ad-e48920801b0a could not be found. Jul 20 20:05:07.505882 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d42219ed-df69-46e8-b3a5-e1ff53d7d737 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Request method failure captured: Jul 20 20:05:07.505882 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a HTTP/1.1 Jul 20 20:05:07.505882 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 20:05:07.505882 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 20:05:07.505882 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 20:05:07.505882 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 0 Jul 20 20:05:07.505882 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 20:05:07.505882 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 20:05:07.505882 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 20:05:07.505882 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 20:05:07.505882 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2FZGo6-HVFVhR6OjPhJxZ1gh94do_O6d8P7kPPvbPDILEmBb1jM0xfV5m7JhTQt5sdz1iJC9fqY_tpPN-uIZZ_wcPYLmcsGaNA7u_2CgAPkrxbvTi4CqkH4xaTggAZoiITrtn1JA6v7LpNRqp8UVLC0NuMxUIRQmnj3pK9LvM26JN6A Jul 20 20:05:07.505882 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 20:05:07.505882 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 20:05:07.505882 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 20:05:07.505882 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 20:05:07.505882 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 20:05:07.505882 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 20:05:07.505882 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: d0ab510f529d4442bd0e379056c4c3e5 Jul 20 20:05:07.505882 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-AttachVolumeTestJSON-1160958235 Jul 20 20:05:07.505882 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 20:05:07.505882 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 20:05:07.507610 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d0ab510f529d4442bd0e379056c4c3e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d0ab510f529d4442bd0e379056c4c3e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_d0ab510f529d4442bd0e379056c4c3e5", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/d0ab510f529d4442bd0e379056c4c3e5"}]}] Jul 20 20:05:07.507610 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-AttachVolumeTestJSON-1160958235 Jul 20 20:05:07.507610 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: d0ab510f529d4442bd0e379056c4c3e5 Jul 20 20:05:07.507610 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1160958235 Jul 20 20:05:07.507610 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-AttachVolumeTestJSON-1160958235-project Jul 20 20:05:07.507610 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 20:05:07.507610 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 20:05:07.507610 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: 4d08da0ef69e4cf2abc6c18bbbc51a2f Jul 20 20:05:07.507610 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-AttachVolumeTestJSON-1160958235-project Jul 20 20:05:07.507610 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: > Jul 20 20:05:07.507610 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Instance c33037ed-7b36-43aa-85ad-e48920801b0a could not be found. Jul 20 20:05:07.507610 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'id': 'c33037ed-7b36-43aa-85ad-e48920801b0a'} Jul 20 20:05:07.509449 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 20:05:07.509449 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:05:07.509449 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 20:05:07.509449 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 20:05:07.509449 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 20:05:07.509449 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 20:05:07.509449 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 20:05:07.509449 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 20:05:07.509449 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 20:05:07.509449 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 20:05:07.509449 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c33037ed-7b36-43aa-85ad-e48920801b0a could not be found. Jul 20 20:05:07.509449 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:05:07.509449 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:05:07.509449 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:05:07.509449 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:05:07.509449 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:05:07.509449 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:05:07.509449 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 20:05:07.509449 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 20:05:07.509449 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 20:05:07.511240 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 20:05:07.511240 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 20:05:07.511240 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 20:05:07.511240 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 20:05:07.511240 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 20:05:07.511240 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 20:05:07.511240 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 20:05:07.511240 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c33037ed-7b36-43aa-85ad-e48920801b0a could not be found. Jul 20 20:05:07.511240 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:05:07.511240 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:05:07.511240 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:05:07.511240 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:05:07.511240 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:05:07.511240 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:05:07.511240 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 20:05:07.511240 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 20:05:07.511240 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c33037ed-7b36-43aa-85ad-e48920801b0a could not be found. Jul 20 20:05:07.511240 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:05:07.516559 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d42219ed-df69-46e8-b3a5-e1ff53d7d737 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Returning 404 to user: Instance c33037ed-7b36-43aa-85ad-e48920801b0a could not be found. {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 20:05:07.516559 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d42219ed-df69-46e8-b3a5-e1ff53d7d737 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a" status: 404 len: 111 microversion: 2.1 time: 0.034584 Jul 20 20:05:07.516559 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1752/2383] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:05:07 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 20:05:07.522308 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-8695607e-9cd5-4fa1-822c-bff2ce08d62d tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '.version_select at 0x7ff609ff03a0>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:05:07.540694 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-8695607e-9cd5-4fa1-822c-bff2ce08d62d tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1960440461" status: 202 len: 0 microversion: 2.1 time: 0.022821 Jul 20 20:05:07.541607 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1753/2384] 10.222.0.69 () {58 vars in 1220 bytes} [Wed Jul 20 20:05:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1960440461 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 20:05:07.571602 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-f78839ee-8f88-4a81-bef8-3745c064bb50 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:05:07.573339 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-f78839ee-8f88-4a81-bef8-3745c064bb50 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:05:07.580569 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f78839ee-8f88-4a81-bef8-3745c064bb50 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:07.580934 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f78839ee-8f88-4a81-bef8-3745c064bb50 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:07.581754 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f78839ee-8f88-4a81-bef8-3745c064bb50 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:07.582179 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f78839ee-8f88-4a81-bef8-3745c064bb50 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:07.655074 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-f78839ee-8f88-4a81-bef8-3745c064bb50 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:05:07.665407 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-f78839ee-8f88-4a81-bef8-3745c064bb50 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:05:07.667950 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-f78839ee-8f88-4a81-bef8-3745c064bb50 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:05:07.669350 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-f78839ee-8f88-4a81-bef8-3745c064bb50 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1339 microversion: 2.20 time: 0.103432 Jul 20 20:05:07.673552 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1754/2385] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:05:07 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1339 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 20:05:08.363092 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-de96be8d-a5d4-40df-80a4-e821d5261f25 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Action: 'create', calling method: .version_select at 0x7ff609ff0160>, body: {"keypair": {"name": "tempest-keypair-504751825", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMc3JNPX1eIMJVabrqkjKITXFjk5rfE3NSTIla+Vw1A4z7mpxAVVrzFdHLan7I4Qg6SD2daLVr6vEc1YVGbo7U7I+IvgnH2ZCKEglOG1ijkMsNrx7MK/uJ3M1awT9QIyVw=="}} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 20:05:08.373111 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 20:05:08.380230 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.quota [None req-de96be8d-a5d4-40df-80a4-e821d5261f25 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Getting quotas for project d0ab510f529d4442bd0e379056c4c3e5. Resources: {'key_pairs'} {{(pid=117761) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 20:05:08.385156 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.quota [None req-de96be8d-a5d4-40df-80a4-e821d5261f25 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Getting quotas for user 4d08da0ef69e4cf2abc6c18bbbc51a2f and project d0ab510f529d4442bd0e379056c4c3e5. Resources: {'key_pairs'} {{(pid=117761) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 20:05:08.410114 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-de96be8d-a5d4-40df-80a4-e821d5261f25 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050946 Jul 20 20:05:08.411120 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1755/2386] 10.222.0.69 () {60 vars in 1158 bytes} [Wed Jul 20 20:05:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 20:05:08.689256 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-45f50e80-a864-45f4-bfb5-e9c9bf4b503a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:05:08.690066 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-45f50e80-a864-45f4-bfb5-e9c9bf4b503a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:05:08.700144 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-45f50e80-a864-45f4-bfb5-e9c9bf4b503a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:08.700605 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-45f50e80-a864-45f4-bfb5-e9c9bf4b503a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:08.701435 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-45f50e80-a864-45f4-bfb5-e9c9bf4b503a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:08.701901 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-45f50e80-a864-45f4-bfb5-e9c9bf4b503a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:08.925015 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-45f50e80-a864-45f4-bfb5-e9c9bf4b503a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:05:08.933613 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-45f50e80-a864-45f4-bfb5-e9c9bf4b503a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:05:08.935433 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-45f50e80-a864-45f4-bfb5-e9c9bf4b503a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:05:08.936844 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-45f50e80-a864-45f4-bfb5-e9c9bf4b503a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1406 microversion: 2.20 time: 0.252307 Jul 20 20:05:08.937709 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1756/2387] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:05:08 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1406 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 20:05:08.986223 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [req-37273c9c-98e2-41b0-9607-40b37df7b451 req-12a3ebfa-1fe3-450e-803b-e70f250c323e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c5c0c16-97ac-46f6-8a3e-f5440a0d584b", "tag": "4d5fe51d-3208-445f-a00e-81057db89aa5"}]} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 20:05:09.004489 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-37273c9c-98e2-41b0-9607-40b37df7b451 req-12a3ebfa-1fe3-450e-803b-e70f250c323e service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:09.005241 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-37273c9c-98e2-41b0-9607-40b37df7b451 req-12a3ebfa-1fe3-450e-803b-e70f250c323e service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:09.035817 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.compute.server_external_events [req-37273c9c-98e2-41b0-9607-40b37df7b451 req-12a3ebfa-1fe3-450e-803b-e70f250c323e service nova] Creating event network-changed:4d5fe51d-3208-445f-a00e-81057db89aa5 for instance 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b on hv-cinder-83538 Jul 20 20:05:09.045348 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [req-37273c9c-98e2-41b0-9607-40b37df7b451 req-12a3ebfa-1fe3-450e-803b-e70f250c323e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063351 Jul 20 20:05:09.046222 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1757/2388] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 20:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 20:05:09.791930 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-71cafa51-c177-403e-9718-174bb75cf1ce tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2066822338", "imageRef": "59575804-e013-4dec-af24-b6c2dbbce73a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1f29a5cb-67ca-4a0b-8479-a5dbe6d43f3d"}], "security_groups": [{"name": "tempest-securitygroup--906103034"}], "key_name": "tempest-keypair-504751825", "user_data": "}} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 20:05:09.891749 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.network.neutron [None req-71cafa51-c177-403e-9718-174bb75cf1ce tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] validate_networks() for [('1f29a5cb-67ca-4a0b-8479-a5dbe6d43f3d', None, None, None, None, None)] {{(pid=117761) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 20:05:10.255880 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.virt.hardware [None req-71cafa51-c177-403e-9718-174bb75cf1ce tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Flavor limits 0:0:0 {{(pid=117761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 20:05:10.256481 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.virt.hardware [None req-71cafa51-c177-403e-9718-174bb75cf1ce tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Image limits 0:0:0 {{(pid=117761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 20:05:10.257076 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.virt.hardware [None req-71cafa51-c177-403e-9718-174bb75cf1ce tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Flavor pref 0:0:0 {{(pid=117761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 20:05:10.257904 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.virt.hardware [None req-71cafa51-c177-403e-9718-174bb75cf1ce tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Image pref 0:0:0 {{(pid=117761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 20:05:10.258471 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.virt.hardware [None req-71cafa51-c177-403e-9718-174bb75cf1ce tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 20:05:10.268597 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-71cafa51-c177-403e-9718-174bb75cf1ce tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:10.269032 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-71cafa51-c177-403e-9718-174bb75cf1ce tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:10.269838 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-71cafa51-c177-403e-9718-174bb75cf1ce tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:10.270265 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-71cafa51-c177-403e-9718-174bb75cf1ce tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:10.287333 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.quota [None req-71cafa51-c177-403e-9718-174bb75cf1ce tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Getting quotas for project d0ab510f529d4442bd0e379056c4c3e5. Resources: {'cores', 'ram', 'instances'} {{(pid=117761) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 20:05:10.291233 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.quota [None req-71cafa51-c177-403e-9718-174bb75cf1ce tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Getting quotas for user 4d08da0ef69e4cf2abc6c18bbbc51a2f and project d0ab510f529d4442bd0e379056c4c3e5. Resources: {'cores', 'ram', 'instances'} {{(pid=117761) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 20:05:10.301920 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-71cafa51-c177-403e-9718-174bb75cf1ce tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Going to run 1 instances... {{(pid=117761) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 20:05:10.305143 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-71cafa51-c177-403e-9718-174bb75cf1ce tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: 6d8b0dac-fc05-4fc6-a99a-f17dc41b961e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='59575804-e013-4dec-af24-b6c2dbbce73a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117761) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 20:05:10.351056 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-71cafa51-c177-403e-9718-174bb75cf1ce tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.564374 Jul 20 20:05:10.351703 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1758/2389] 10.222.0.69 () {60 vars in 1146 bytes} [Wed Jul 20 20:05:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 20:05:10.356194 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-09cb8adf-7165-4f72-b119-9b19eb43e14d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:05:10.357049 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-09cb8adf-7165-4f72-b119-9b19eb43e14d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:05:10.363117 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-09cb8adf-7165-4f72-b119-9b19eb43e14d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:10.363556 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-09cb8adf-7165-4f72-b119-9b19eb43e14d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:10.364302 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-09cb8adf-7165-4f72-b119-9b19eb43e14d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:10.365270 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-09cb8adf-7165-4f72-b119-9b19eb43e14d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:10.509068 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-09cb8adf-7165-4f72-b119-9b19eb43e14d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:05:10.517179 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-09cb8adf-7165-4f72-b119-9b19eb43e14d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:05:10.518715 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-09cb8adf-7165-4f72-b119-9b19eb43e14d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:05:10.519831 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-09cb8adf-7165-4f72-b119-9b19eb43e14d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1406 microversion: 2.20 time: 0.167210 Jul 20 20:05:10.520385 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1759/2390] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:05:10 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 20:05:10.525049 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-dafa9f89-eb2c-4da2-aea8-f275dd09f560 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:05:10.525688 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-dafa9f89-eb2c-4da2-aea8-f275dd09f560 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: 6d8b0dac-fc05-4fc6-a99a-f17dc41b961e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:05:10.581733 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-dafa9f89-eb2c-4da2-aea8-f275dd09f560 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:05:10.589272 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-dafa9f89-eb2c-4da2-aea8-f275dd09f560 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/6d8b0dac-fc05-4fc6-a99a-f17dc41b961e" status: 200 len: 1237 microversion: 2.1 time: 0.067852 Jul 20 20:05:10.590092 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1760/2391] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:05:10 2022] GET /compute/v2.1/servers/6d8b0dac-fc05-4fc6-a99a-f17dc41b961e => generated 1237 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 20:05:11.539566 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-6fe0bd76-91cf-4ae7-a0a0-a798fe28a3fb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:05:11.540200 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-6fe0bd76-91cf-4ae7-a0a0-a798fe28a3fb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:05:11.546619 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6fe0bd76-91cf-4ae7-a0a0-a798fe28a3fb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:11.547066 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6fe0bd76-91cf-4ae7-a0a0-a798fe28a3fb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:11.547819 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6fe0bd76-91cf-4ae7-a0a0-a798fe28a3fb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:11.548251 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6fe0bd76-91cf-4ae7-a0a0-a798fe28a3fb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:11.567058 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=12,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 20:05:11.678880 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6fe0bd76-91cf-4ae7-a0a0-a798fe28a3fb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:05:11.686693 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6fe0bd76-91cf-4ae7-a0a0-a798fe28a3fb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:05:11.688167 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6fe0bd76-91cf-4ae7-a0a0-a798fe28a3fb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:05:11.689250 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-6fe0bd76-91cf-4ae7-a0a0-a798fe28a3fb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1406 microversion: 2.20 time: 0.154610 Jul 20 20:05:11.689826 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1761/2392] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:05:11 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 20:05:11.694218 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-076db5b6-6a9c-4415-b47a-c120895d17e4 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:05:11.694816 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-076db5b6-6a9c-4415-b47a-c120895d17e4 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: 6d8b0dac-fc05-4fc6-a99a-f17dc41b961e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:05:11.700416 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-076db5b6-6a9c-4415-b47a-c120895d17e4 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:11.700857 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-076db5b6-6a9c-4415-b47a-c120895d17e4 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:11.701701 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-076db5b6-6a9c-4415-b47a-c120895d17e4 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:11.702132 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-076db5b6-6a9c-4415-b47a-c120895d17e4 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:11.767543 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-076db5b6-6a9c-4415-b47a-c120895d17e4 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:05:11.775490 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-076db5b6-6a9c-4415-b47a-c120895d17e4 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/6d8b0dac-fc05-4fc6-a99a-f17dc41b961e" status: 200 len: 1241 microversion: 2.1 time: 0.084719 Jul 20 20:05:11.776049 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1762/2393] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:05:11 2022] GET /compute/v2.1/servers/6d8b0dac-fc05-4fc6-a99a-f17dc41b961e => generated 1241 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 20:05:12.709101 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-13a58c38-19b1-47c4-9300-b01587fa134e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:05:12.709633 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-13a58c38-19b1-47c4-9300-b01587fa134e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:05:12.718640 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-13a58c38-19b1-47c4-9300-b01587fa134e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:12.720397 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-13a58c38-19b1-47c4-9300-b01587fa134e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:12.720397 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-13a58c38-19b1-47c4-9300-b01587fa134e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:12.720704 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-13a58c38-19b1-47c4-9300-b01587fa134e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:13.017814 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-13a58c38-19b1-47c4-9300-b01587fa134e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:05:13.036151 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-13a58c38-19b1-47c4-9300-b01587fa134e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:05:13.043877 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-13a58c38-19b1-47c4-9300-b01587fa134e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:05:13.045298 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-13a58c38-19b1-47c4-9300-b01587fa134e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1406 microversion: 2.20 time: 0.341846 Jul 20 20:05:13.056391 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1763/2394] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:05:12 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1406 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 20:05:13.061156 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-29622eb8-2ba0-491a-abf5-5faf3b3c33c9 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:05:13.061918 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-29622eb8-2ba0-491a-abf5-5faf3b3c33c9 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: 6d8b0dac-fc05-4fc6-a99a-f17dc41b961e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:05:13.068239 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-29622eb8-2ba0-491a-abf5-5faf3b3c33c9 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:13.068968 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-29622eb8-2ba0-491a-abf5-5faf3b3c33c9 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:13.069775 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-29622eb8-2ba0-491a-abf5-5faf3b3c33c9 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:13.070331 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-29622eb8-2ba0-491a-abf5-5faf3b3c33c9 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:13.181190 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-29622eb8-2ba0-491a-abf5-5faf3b3c33c9 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:05:13.192346 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-29622eb8-2ba0-491a-abf5-5faf3b3c33c9 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/6d8b0dac-fc05-4fc6-a99a-f17dc41b961e" status: 200 len: 1295 microversion: 2.1 time: 0.134704 Jul 20 20:05:13.193463 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1764/2395] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:05:13 2022] GET /compute/v2.1/servers/6d8b0dac-fc05-4fc6-a99a-f17dc41b961e => generated 1295 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 20:05:14.064038 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-6f782337-f94e-4d32-8475-5979214ab4e0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:05:14.064713 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-6f782337-f94e-4d32-8475-5979214ab4e0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:05:14.071528 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6f782337-f94e-4d32-8475-5979214ab4e0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:14.071973 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6f782337-f94e-4d32-8475-5979214ab4e0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:14.072737 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6f782337-f94e-4d32-8475-5979214ab4e0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:14.073168 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6f782337-f94e-4d32-8475-5979214ab4e0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:14.294486 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6f782337-f94e-4d32-8475-5979214ab4e0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:05:14.303337 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6f782337-f94e-4d32-8475-5979214ab4e0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:05:14.304840 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6f782337-f94e-4d32-8475-5979214ab4e0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:05:14.306010 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-6f782337-f94e-4d32-8475-5979214ab4e0 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1406 microversion: 2.20 time: 0.246111 Jul 20 20:05:14.306600 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1765/2396] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:05:14 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1406 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 20:05:14.311401 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-eaf82c79-8d5a-48d9-8353-99ed6d7b3408 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:05:14.311734 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-eaf82c79-8d5a-48d9-8353-99ed6d7b3408 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: 6d8b0dac-fc05-4fc6-a99a-f17dc41b961e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:05:14.318937 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-eaf82c79-8d5a-48d9-8353-99ed6d7b3408 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:14.319541 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-eaf82c79-8d5a-48d9-8353-99ed6d7b3408 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:14.320319 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-eaf82c79-8d5a-48d9-8353-99ed6d7b3408 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:14.320746 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-eaf82c79-8d5a-48d9-8353-99ed6d7b3408 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:14.555686 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-eaf82c79-8d5a-48d9-8353-99ed6d7b3408 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:05:14.563526 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-eaf82c79-8d5a-48d9-8353-99ed6d7b3408 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/6d8b0dac-fc05-4fc6-a99a-f17dc41b961e" status: 200 len: 1362 microversion: 2.1 time: 0.255866 Jul 20 20:05:14.564631 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1766/2397] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:05:14 2022] GET /compute/v2.1/servers/6d8b0dac-fc05-4fc6-a99a-f17dc41b961e => generated 1362 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 20:05:14.708913 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [req-302ac15a-119e-400d-9a8f-e5feb0a0e456 req-5e97f6ef-4865-48cb-83ec-951d1fb693c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d8b0dac-fc05-4fc6-a99a-f17dc41b961e", "tag": "51489eef-9554-46e4-8f14-0ee91dc2feaf"}]} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 20:05:14.722724 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-302ac15a-119e-400d-9a8f-e5feb0a0e456 req-5e97f6ef-4865-48cb-83ec-951d1fb693c6 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:14.723376 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-302ac15a-119e-400d-9a8f-e5feb0a0e456 req-5e97f6ef-4865-48cb-83ec-951d1fb693c6 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:14.736417 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.compute.server_external_events [req-302ac15a-119e-400d-9a8f-e5feb0a0e456 req-5e97f6ef-4865-48cb-83ec-951d1fb693c6 service nova] Creating event network-changed:51489eef-9554-46e4-8f14-0ee91dc2feaf for instance 6d8b0dac-fc05-4fc6-a99a-f17dc41b961e on hv-cinder-83538 Jul 20 20:05:14.741667 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [req-302ac15a-119e-400d-9a8f-e5feb0a0e456 req-5e97f6ef-4865-48cb-83ec-951d1fb693c6 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036807 Jul 20 20:05:14.742308 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1767/2398] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 20:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 20:05:15.137391 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [req-e411964e-f4a1-4903-9808-cc8e27743e72 req-f088de01-473d-472f-967d-1cbf2a6c8745 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c5c0c16-97ac-46f6-8a3e-f5440a0d584b", "name": "network-vif-plugged", "status": "completed", "tag": "4d5fe51d-3208-445f-a00e-81057db89aa5"}]} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 20:05:15.147378 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-e411964e-f4a1-4903-9808-cc8e27743e72 req-f088de01-473d-472f-967d-1cbf2a6c8745 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:15.147378 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-e411964e-f4a1-4903-9808-cc8e27743e72 req-f088de01-473d-472f-967d-1cbf2a6c8745 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:15.158990 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.compute.server_external_events [req-e411964e-f4a1-4903-9808-cc8e27743e72 req-f088de01-473d-472f-967d-1cbf2a6c8745 service nova] Creating event network-vif-plugged:4d5fe51d-3208-445f-a00e-81057db89aa5 for instance 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b on hv-cinder-83538 Jul 20 20:05:15.164319 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [req-e411964e-f4a1-4903-9808-cc8e27743e72 req-f088de01-473d-472f-967d-1cbf2a6c8745 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031110 Jul 20 20:05:15.165078 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1768/2399] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 20:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 20:05:15.324480 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-92430b74-1445-498a-b75f-c2c0a63090a7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:05:15.325170 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-92430b74-1445-498a-b75f-c2c0a63090a7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:05:15.331461 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-92430b74-1445-498a-b75f-c2c0a63090a7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:15.331909 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-92430b74-1445-498a-b75f-c2c0a63090a7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:15.332668 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-92430b74-1445-498a-b75f-c2c0a63090a7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:15.333290 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-92430b74-1445-498a-b75f-c2c0a63090a7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:15.465006 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-92430b74-1445-498a-b75f-c2c0a63090a7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:05:15.473103 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-92430b74-1445-498a-b75f-c2c0a63090a7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:05:15.475294 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-92430b74-1445-498a-b75f-c2c0a63090a7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:05:15.476388 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-92430b74-1445-498a-b75f-c2c0a63090a7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1406 microversion: 2.20 time: 0.156137 Jul 20 20:05:15.476940 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1769/2400] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:05:15 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 20:05:15.581971 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-1392fbbd-fd48-4ad8-85b4-0167e12d3ff0 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:05:15.582580 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-1392fbbd-fd48-4ad8-85b4-0167e12d3ff0 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: 6d8b0dac-fc05-4fc6-a99a-f17dc41b961e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:05:15.589221 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1392fbbd-fd48-4ad8-85b4-0167e12d3ff0 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:15.589711 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1392fbbd-fd48-4ad8-85b4-0167e12d3ff0 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:15.590747 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1392fbbd-fd48-4ad8-85b4-0167e12d3ff0 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:15.591179 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1392fbbd-fd48-4ad8-85b4-0167e12d3ff0 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:15.721819 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1392fbbd-fd48-4ad8-85b4-0167e12d3ff0 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:05:15.729905 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-1392fbbd-fd48-4ad8-85b4-0167e12d3ff0 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/6d8b0dac-fc05-4fc6-a99a-f17dc41b961e" status: 200 len: 1362 microversion: 2.1 time: 0.151658 Jul 20 20:05:15.730466 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1770/2401] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:05:15 2022] GET /compute/v2.1/servers/6d8b0dac-fc05-4fc6-a99a-f17dc41b961e => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:05:16.494558 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-380488f1-632c-4770-80c4-026214d1f609 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:05:16.495176 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-380488f1-632c-4770-80c4-026214d1f609 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:05:16.501704 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-380488f1-632c-4770-80c4-026214d1f609 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:16.502156 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-380488f1-632c-4770-80c4-026214d1f609 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:16.502916 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-380488f1-632c-4770-80c4-026214d1f609 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:16.503352 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-380488f1-632c-4770-80c4-026214d1f609 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:16.635844 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-380488f1-632c-4770-80c4-026214d1f609 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:05:16.643662 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-380488f1-632c-4770-80c4-026214d1f609 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:05:16.645139 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-380488f1-632c-4770-80c4-026214d1f609 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:05:16.646360 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-380488f1-632c-4770-80c4-026214d1f609 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1406 microversion: 2.20 time: 0.155618 Jul 20 20:05:16.646918 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1771/2402] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:05:16 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 20:05:16.746596 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c526b9ed-5190-48d5-89f6-f00cbb6d3018 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:05:16.747203 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c526b9ed-5190-48d5-89f6-f00cbb6d3018 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: 6d8b0dac-fc05-4fc6-a99a-f17dc41b961e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:05:16.753157 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c526b9ed-5190-48d5-89f6-f00cbb6d3018 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:16.753672 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c526b9ed-5190-48d5-89f6-f00cbb6d3018 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:16.754445 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c526b9ed-5190-48d5-89f6-f00cbb6d3018 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:16.754907 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c526b9ed-5190-48d5-89f6-f00cbb6d3018 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:16.882392 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c526b9ed-5190-48d5-89f6-f00cbb6d3018 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:05:16.889830 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c526b9ed-5190-48d5-89f6-f00cbb6d3018 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/6d8b0dac-fc05-4fc6-a99a-f17dc41b961e" status: 200 len: 1362 microversion: 2.1 time: 0.147010 Jul 20 20:05:16.890397 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1772/2403] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:05:16 2022] GET /compute/v2.1/servers/6d8b0dac-fc05-4fc6-a99a-f17dc41b961e => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:05:17.664836 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e3735584-5e39-43aa-85bb-4a21493a42f7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:05:17.665661 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e3735584-5e39-43aa-85bb-4a21493a42f7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:05:17.672222 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e3735584-5e39-43aa-85bb-4a21493a42f7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:17.672673 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e3735584-5e39-43aa-85bb-4a21493a42f7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:17.673456 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e3735584-5e39-43aa-85bb-4a21493a42f7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:17.673919 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e3735584-5e39-43aa-85bb-4a21493a42f7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:17.941463 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e3735584-5e39-43aa-85bb-4a21493a42f7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:05:17.951678 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e3735584-5e39-43aa-85bb-4a21493a42f7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:05:17.953219 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e3735584-5e39-43aa-85bb-4a21493a42f7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:05:17.954874 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e3735584-5e39-43aa-85bb-4a21493a42f7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1406 microversion: 2.20 time: 0.295137 Jul 20 20:05:17.965250 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1773/2404] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:05:17 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1406 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 20:05:17.965250 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-fccdfa22-db9f-48ce-a89b-13d72e470e30 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:05:17.965250 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-fccdfa22-db9f-48ce-a89b-13d72e470e30 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: 6d8b0dac-fc05-4fc6-a99a-f17dc41b961e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:05:17.966821 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fccdfa22-db9f-48ce-a89b-13d72e470e30 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:17.967257 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fccdfa22-db9f-48ce-a89b-13d72e470e30 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:17.968014 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fccdfa22-db9f-48ce-a89b-13d72e470e30 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:17.968444 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fccdfa22-db9f-48ce-a89b-13d72e470e30 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:18.125528 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-fccdfa22-db9f-48ce-a89b-13d72e470e30 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:05:18.133105 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-fccdfa22-db9f-48ce-a89b-13d72e470e30 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/6d8b0dac-fc05-4fc6-a99a-f17dc41b961e" status: 200 len: 1362 microversion: 2.1 time: 0.176659 Jul 20 20:05:18.133802 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1774/2405] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:05:17 2022] GET /compute/v2.1/servers/6d8b0dac-fc05-4fc6-a99a-f17dc41b961e => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 20:05:18.972787 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-704ba549-ac35-499b-bc05-b72bb65d2b50 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:05:18.973450 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-704ba549-ac35-499b-bc05-b72bb65d2b50 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:05:18.980483 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-704ba549-ac35-499b-bc05-b72bb65d2b50 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:18.980932 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-704ba549-ac35-499b-bc05-b72bb65d2b50 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:18.981732 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-704ba549-ac35-499b-bc05-b72bb65d2b50 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:18.982167 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-704ba549-ac35-499b-bc05-b72bb65d2b50 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:19.114651 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-704ba549-ac35-499b-bc05-b72bb65d2b50 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:05:19.122747 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-704ba549-ac35-499b-bc05-b72bb65d2b50 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:05:19.124244 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-704ba549-ac35-499b-bc05-b72bb65d2b50 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:05:19.125341 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-704ba549-ac35-499b-bc05-b72bb65d2b50 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1406 microversion: 2.20 time: 0.156538 Jul 20 20:05:19.125954 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1775/2406] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:05:18 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 20:05:19.153658 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a9f23be6-e100-4a05-be7e-29832387b911 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:05:19.154541 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a9f23be6-e100-4a05-be7e-29832387b911 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: 6d8b0dac-fc05-4fc6-a99a-f17dc41b961e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:05:19.160819 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a9f23be6-e100-4a05-be7e-29832387b911 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:19.161387 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a9f23be6-e100-4a05-be7e-29832387b911 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:19.162369 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a9f23be6-e100-4a05-be7e-29832387b911 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:19.162811 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a9f23be6-e100-4a05-be7e-29832387b911 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:19.295420 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a9f23be6-e100-4a05-be7e-29832387b911 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:05:19.303463 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a9f23be6-e100-4a05-be7e-29832387b911 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/6d8b0dac-fc05-4fc6-a99a-f17dc41b961e" status: 200 len: 1362 microversion: 2.1 time: 0.155714 Jul 20 20:05:19.304029 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1776/2407] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:05:19 2022] GET /compute/v2.1/servers/6d8b0dac-fc05-4fc6-a99a-f17dc41b961e => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 20:05:20.143627 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-27fcd585-7ebb-4d47-bbae-f6049ae6af01 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:05:20.144306 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-27fcd585-7ebb-4d47-bbae-f6049ae6af01 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:05:20.151497 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-27fcd585-7ebb-4d47-bbae-f6049ae6af01 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:20.151947 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-27fcd585-7ebb-4d47-bbae-f6049ae6af01 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:20.152712 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-27fcd585-7ebb-4d47-bbae-f6049ae6af01 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:20.153149 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-27fcd585-7ebb-4d47-bbae-f6049ae6af01 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:20.278391 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell0:SELECT=4 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 20:05:20.286910 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-27fcd585-7ebb-4d47-bbae-f6049ae6af01 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:05:20.294699 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-27fcd585-7ebb-4d47-bbae-f6049ae6af01 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:05:20.296213 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-27fcd585-7ebb-4d47-bbae-f6049ae6af01 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:05:20.297317 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-27fcd585-7ebb-4d47-bbae-f6049ae6af01 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1406 microversion: 2.20 time: 0.157754 Jul 20 20:05:20.297907 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1777/2408] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:05:20 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 20:05:20.327213 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-aef64bbe-96b5-42dc-b53d-c9c37ec05ded tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:05:20.327866 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-aef64bbe-96b5-42dc-b53d-c9c37ec05ded tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: 6d8b0dac-fc05-4fc6-a99a-f17dc41b961e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:05:20.335012 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aef64bbe-96b5-42dc-b53d-c9c37ec05ded tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:20.335732 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aef64bbe-96b5-42dc-b53d-c9c37ec05ded tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:20.336623 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aef64bbe-96b5-42dc-b53d-c9c37ec05ded tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:20.337467 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aef64bbe-96b5-42dc-b53d-c9c37ec05ded tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:20.473128 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-aef64bbe-96b5-42dc-b53d-c9c37ec05ded tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:05:20.480657 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-aef64bbe-96b5-42dc-b53d-c9c37ec05ded tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/6d8b0dac-fc05-4fc6-a99a-f17dc41b961e" status: 200 len: 1362 microversion: 2.1 time: 0.157801 Jul 20 20:05:20.481220 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1778/2409] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:05:20 2022] GET /compute/v2.1/servers/6d8b0dac-fc05-4fc6-a99a-f17dc41b961e => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 20:05:21.177695 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [req-2db96757-90e1-439c-821a-47cc94a8dbe6 req-8aa6dd6f-ef52-43bb-bc31-ca48c0310200 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d8b0dac-fc05-4fc6-a99a-f17dc41b961e", "name": "network-vif-plugged", "status": "completed", "tag": "51489eef-9554-46e4-8f14-0ee91dc2feaf"}]} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 20:05:21.182123 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell0:SELECT=24 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 20:05:21.189445 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-2db96757-90e1-439c-821a-47cc94a8dbe6 req-8aa6dd6f-ef52-43bb-bc31-ca48c0310200 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:21.189915 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-2db96757-90e1-439c-821a-47cc94a8dbe6 req-8aa6dd6f-ef52-43bb-bc31-ca48c0310200 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:21.202096 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.compute.server_external_events [req-2db96757-90e1-439c-821a-47cc94a8dbe6 req-8aa6dd6f-ef52-43bb-bc31-ca48c0310200 service nova] Creating event network-vif-plugged:51489eef-9554-46e4-8f14-0ee91dc2feaf for instance 6d8b0dac-fc05-4fc6-a99a-f17dc41b961e on hv-cinder-83538 Jul 20 20:05:21.206826 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [req-2db96757-90e1-439c-821a-47cc94a8dbe6 req-8aa6dd6f-ef52-43bb-bc31-ca48c0310200 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033122 Jul 20 20:05:21.207590 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1779/2410] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 20:05:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 20:05:21.316508 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-2e81adbc-d1b8-4892-84a8-d6f8dfb5c394 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:05:21.317285 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-2e81adbc-d1b8-4892-84a8-d6f8dfb5c394 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:05:21.324979 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2e81adbc-d1b8-4892-84a8-d6f8dfb5c394 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:21.324979 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2e81adbc-d1b8-4892-84a8-d6f8dfb5c394 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:21.325620 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2e81adbc-d1b8-4892-84a8-d6f8dfb5c394 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:21.326059 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2e81adbc-d1b8-4892-84a8-d6f8dfb5c394 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:21.331125 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 20:05:21.509385 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-2e81adbc-d1b8-4892-84a8-d6f8dfb5c394 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:05:21.517240 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-2e81adbc-d1b8-4892-84a8-d6f8dfb5c394 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:05:21.518789 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-2e81adbc-d1b8-4892-84a8-d6f8dfb5c394 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:05:21.519937 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-2e81adbc-d1b8-4892-84a8-d6f8dfb5c394 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1598 microversion: 2.20 time: 0.207906 Jul 20 20:05:21.520494 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1780/2411] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:05:21 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1598 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 20:05:21.525780 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-7c77a678-50bb-4b53-9107-3bacfd85ac8e tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:05:21.526382 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-7c77a678-50bb-4b53-9107-3bacfd85ac8e tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: 6d8b0dac-fc05-4fc6-a99a-f17dc41b961e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:05:21.532026 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7c77a678-50bb-4b53-9107-3bacfd85ac8e tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:21.532476 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7c77a678-50bb-4b53-9107-3bacfd85ac8e tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:21.533273 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7c77a678-50bb-4b53-9107-3bacfd85ac8e tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:21.533747 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7c77a678-50bb-4b53-9107-3bacfd85ac8e tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:21.664680 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-7c77a678-50bb-4b53-9107-3bacfd85ac8e tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:05:21.671990 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-7c77a678-50bb-4b53-9107-3bacfd85ac8e tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/6d8b0dac-fc05-4fc6-a99a-f17dc41b961e" status: 200 len: 1362 microversion: 2.1 time: 0.150562 Jul 20 20:05:21.672552 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1781/2412] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:05:21 2022] GET /compute/v2.1/servers/6d8b0dac-fc05-4fc6-a99a-f17dc41b961e => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 20:05:21.676949 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-fe08f548-e1b0-42e6-b541-c5879659793e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:05:21.677966 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-fe08f548-e1b0-42e6-b541-c5879659793e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:05:21.683516 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fe08f548-e1b0-42e6-b541-c5879659793e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:21.683954 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fe08f548-e1b0-42e6-b541-c5879659793e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:21.684698 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fe08f548-e1b0-42e6-b541-c5879659793e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:21.685123 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fe08f548-e1b0-42e6-b541-c5879659793e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:21.762883 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-fe08f548-e1b0-42e6-b541-c5879659793e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.089229 Jul 20 20:05:21.763511 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1782/2413] 10.222.0.69 () {60 vars in 1315 bytes} [Wed Jul 20 20:05:21 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 20:05:22.690617 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-980158d7-5292-4343-a22b-0e637507c291 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:05:22.691296 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-980158d7-5292-4343-a22b-0e637507c291 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: 6d8b0dac-fc05-4fc6-a99a-f17dc41b961e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:05:22.698042 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-980158d7-5292-4343-a22b-0e637507c291 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:22.698496 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-980158d7-5292-4343-a22b-0e637507c291 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:22.699329 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-980158d7-5292-4343-a22b-0e637507c291 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:22.699767 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-980158d7-5292-4343-a22b-0e637507c291 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:23.018403 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-980158d7-5292-4343-a22b-0e637507c291 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:05:23.026720 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-980158d7-5292-4343-a22b-0e637507c291 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/6d8b0dac-fc05-4fc6-a99a-f17dc41b961e" status: 200 len: 1362 microversion: 2.1 time: 0.340475 Jul 20 20:05:23.027302 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1783/2414] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:05:22 2022] GET /compute/v2.1/servers/6d8b0dac-fc05-4fc6-a99a-f17dc41b961e => generated 1362 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:05:23.031852 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [req-2e2ae774-e3b8-40be-b4b5-83773b9a0ba0 req-44eada2d-73ea-425d-92cd-c9912c07f535 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c5c0c16-97ac-46f6-8a3e-f5440a0d584b", "tag": "4d5fe51d-3208-445f-a00e-81057db89aa5"}]} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 20:05:23.040391 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-2e2ae774-e3b8-40be-b4b5-83773b9a0ba0 req-44eada2d-73ea-425d-92cd-c9912c07f535 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:23.040836 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-2e2ae774-e3b8-40be-b4b5-83773b9a0ba0 req-44eada2d-73ea-425d-92cd-c9912c07f535 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:23.051994 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.compute.server_external_events [req-2e2ae774-e3b8-40be-b4b5-83773b9a0ba0 req-44eada2d-73ea-425d-92cd-c9912c07f535 service nova] Creating event network-changed:4d5fe51d-3208-445f-a00e-81057db89aa5 for instance 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b on hv-cinder-83538 Jul 20 20:05:23.057847 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [req-2e2ae774-e3b8-40be-b4b5-83773b9a0ba0 req-44eada2d-73ea-425d-92cd-c9912c07f535 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029387 Jul 20 20:05:23.058456 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1784/2415] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 20:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 20:05:24.044342 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-f2d39e30-bbdd-4238-be19-36bd0179c9c1 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:05:24.045019 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-f2d39e30-bbdd-4238-be19-36bd0179c9c1 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: 6d8b0dac-fc05-4fc6-a99a-f17dc41b961e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:05:24.051961 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f2d39e30-bbdd-4238-be19-36bd0179c9c1 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:24.053149 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f2d39e30-bbdd-4238-be19-36bd0179c9c1 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:24.054555 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f2d39e30-bbdd-4238-be19-36bd0179c9c1 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:24.055231 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f2d39e30-bbdd-4238-be19-36bd0179c9c1 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:24.192369 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-f2d39e30-bbdd-4238-be19-36bd0179c9c1 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:05:24.200495 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-f2d39e30-bbdd-4238-be19-36bd0179c9c1 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/6d8b0dac-fc05-4fc6-a99a-f17dc41b961e" status: 200 len: 1548 microversion: 2.1 time: 0.160371 Jul 20 20:05:24.201061 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1785/2416] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:05:24 2022] GET /compute/v2.1/servers/6d8b0dac-fc05-4fc6-a99a-f17dc41b961e => generated 1548 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:05:24.217202 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-89f4c52f-6244-4572-9759-bf29af8a078d tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:05:24.217723 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-89f4c52f-6244-4572-9759-bf29af8a078d tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: 6d8b0dac-fc05-4fc6-a99a-f17dc41b961e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:05:24.223430 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-89f4c52f-6244-4572-9759-bf29af8a078d tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:24.223875 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-89f4c52f-6244-4572-9759-bf29af8a078d tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:24.224839 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-89f4c52f-6244-4572-9759-bf29af8a078d tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:24.225284 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-89f4c52f-6244-4572-9759-bf29af8a078d tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:24.300974 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-89f4c52f-6244-4572-9759-bf29af8a078d tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/6d8b0dac-fc05-4fc6-a99a-f17dc41b961e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087514 Jul 20 20:05:24.301606 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1786/2417] 10.222.0.69 () {58 vars in 1274 bytes} [Wed Jul 20 20:05:24 2022] GET /compute/v2.1/servers/6d8b0dac-fc05-4fc6-a99a-f17dc41b961e/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 20:05:25.235129 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [req-e8043c91-0512-4a4c-8fd3-7ec48fa3266b req-336cfccb-1546-411d-bee5-0400c1273364 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d8b0dac-fc05-4fc6-a99a-f17dc41b961e", "tag": "51489eef-9554-46e4-8f14-0ee91dc2feaf"}]} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 20:05:25.244095 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-e8043c91-0512-4a4c-8fd3-7ec48fa3266b req-336cfccb-1546-411d-bee5-0400c1273364 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:05:25.244606 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-e8043c91-0512-4a4c-8fd3-7ec48fa3266b req-336cfccb-1546-411d-bee5-0400c1273364 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:05:25.256602 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.compute.server_external_events [req-e8043c91-0512-4a4c-8fd3-7ec48fa3266b req-336cfccb-1546-411d-bee5-0400c1273364 service nova] Creating event network-changed:51489eef-9554-46e4-8f14-0ee91dc2feaf for instance 6d8b0dac-fc05-4fc6-a99a-f17dc41b961e on hv-cinder-83538 Jul 20 20:05:25.262880 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [req-e8043c91-0512-4a4c-8fd3-7ec48fa3266b req-336cfccb-1546-411d-bee5-0400c1273364 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031470 Jul 20 20:05:25.263931 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1787/2418] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 20:05:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 20:06:59.721217 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=4 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 20:06:59.721970 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=34 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 20:06:59.849365 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-9680f103-d744-4354-898d-5182d89d7526 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:06:59.849987 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-9680f103-d744-4354-898d-5182d89d7526 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: dce310ab-07be-49b9-a207-5d3f22f7b679] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:06:59.856200 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9680f103-d744-4354-898d-5182d89d7526 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:06:59.856660 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9680f103-d744-4354-898d-5182d89d7526 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:06:59.857418 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9680f103-d744-4354-898d-5182d89d7526 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:06:59.857878 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9680f103-d744-4354-898d-5182d89d7526 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:06:59.881330 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-9680f103-d744-4354-898d-5182d89d7526 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/dce310ab-07be-49b9-a207-5d3f22f7b679/ips" status: 200 len: 149 microversion: 2.1 time: 0.162606 Jul 20 20:06:59.881910 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1788/2419] 10.222.0.69 () {58 vars in 1247 bytes} [Wed Jul 20 20:06:59 2022] GET /compute/v2.1/servers/dce310ab-07be-49b9-a207-5d3f22f7b679/ips => generated 149 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 20:07:01.200815 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-18a9e271-0685-4bb2-9fc4-e6f6d28946b6 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bfdcbb7a-ab91-49f1-ba3e-6ce9f57afbf7"}} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 20:07:01.201941 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-18a9e271-0685-4bb2-9fc4-e6f6d28946b6 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: dce310ab-07be-49b9-a207-5d3f22f7b679] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:01.208867 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-18a9e271-0685-4bb2-9fc4-e6f6d28946b6 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:01.209303 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-18a9e271-0685-4bb2-9fc4-e6f6d28946b6 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:01.210083 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-18a9e271-0685-4bb2-9fc4-e6f6d28946b6 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:01.210508 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-18a9e271-0685-4bb2-9fc4-e6f6d28946b6 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:01.526577 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-18a9e271-0685-4bb2-9fc4-e6f6d28946b6 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "POST /compute/v2.1/servers/dce310ab-07be-49b9-a207-5d3f22f7b679/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.329465 Jul 20 20:07:01.527370 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1789/2420] 10.222.0.69 () {60 vars in 1322 bytes} [Wed Jul 20 20:07:01 2022] POST /compute/v2.1/servers/dce310ab-07be-49b9-a207-5d3f22f7b679/os-volume_attachments => generated 194 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 20:07:09.016466 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-06b764d0-e8cc-421e-a244-0782cb4832f3 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bfdcbb7a-ab91-49f1-ba3e-6ce9f57afbf7"}} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 20:07:09.017640 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-06b764d0-e8cc-421e-a244-0782cb4832f3 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: dce310ab-07be-49b9-a207-5d3f22f7b679] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:09.024796 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-06b764d0-e8cc-421e-a244-0782cb4832f3 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:09.025241 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-06b764d0-e8cc-421e-a244-0782cb4832f3 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:09.026052 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-06b764d0-e8cc-421e-a244-0782cb4832f3 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:09.026484 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-06b764d0-e8cc-421e-a244-0782cb4832f3 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:09.106234 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.wsgi [None req-06b764d0-e8cc-421e-a244-0782cb4832f3 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] HTTP exception thrown: Invalid volume: volume bfdcbb7a-ab91-49f1-ba3e-6ce9f57afbf7 is already attached to instances: dce310ab-07be-49b9-a207-5d3f22f7b679 Jul 20 20:07:09.107957 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-06b764d0-e8cc-421e-a244-0782cb4832f3 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Request method failure captured: Jul 20 20:07:09.107957 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: POST /compute/v2.1/servers/dce310ab-07be-49b9-a207-5d3f22f7b679/os-volume_attachments HTTP/1.1 Jul 20 20:07:09.107957 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 20:07:09.107957 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 20:07:09.107957 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 20:07:09.107957 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 74 Jul 20 20:07:09.107957 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 20:07:09.107957 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 20:07:09.107957 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 20:07:09.107957 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 20:07:09.107957 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2F8F6Ge10hBXuhDa0NLuoIQGKdCbH_-0Qytzgx2TiuDpG5vxQ-IW-4WPHWLIEm2lkY4j4eRPFcsjkcnP9w_FRJ3X-P89qM9tliQWnJkm78fASQt3Z_jz-B1-QjBfFR7l1gMla2jtR2bkXlUlscrWVmnS7NtJkSS_8OjKqGZtvWPk5Iw Jul 20 20:07:09.107957 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 20:07:09.107957 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 20:07:09.107957 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 20:07:09.107957 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 20:07:09.107957 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 20:07:09.107957 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 20:07:09.107957 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: b2b576df300148ad8d8d7dd3f8335f8e Jul 20 20:07:09.107957 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-AttachVolumeNegativeTest-1904845904 Jul 20 20:07:09.107957 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 20:07:09.107957 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 20:07:09.109861 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b2b576df300148ad8d8d7dd3f8335f8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b2b576df300148ad8d8d7dd3f8335f8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_b2b576df300148ad8d8d7dd3f8335f8e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/b2b576df300148ad8d8d7dd3f8335f8e"}]}] Jul 20 20:07:09.109861 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-AttachVolumeNegativeTest-1904845904 Jul 20 20:07:09.109861 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: b2b576df300148ad8d8d7dd3f8335f8e Jul 20 20:07:09.109861 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1904845904 Jul 20 20:07:09.109861 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-AttachVolumeNegativeTest-1904845904-project Jul 20 20:07:09.109861 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 20:07:09.109861 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 20:07:09.109861 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: 0d1cf9b55ce04cf997bf23ad73222814 Jul 20 20:07:09.109861 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-AttachVolumeNegativeTest-1904845904-project Jul 20 20:07:09.109861 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Jul 20 20:07:09.109861 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {"volumeAttachment": {"volumeId": "bfdcbb7a-ab91-49f1-ba3e-6ce9f57afbf7"}} Jul 20 20:07:09.109861 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: > Jul 20 20:07:09.110889 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Invalid volume: volume bfdcbb7a-ab91-49f1-ba3e-6ce9f57afbf7 is already attached to instances: dce310ab-07be-49b9-a207-5d3f22f7b679 Jul 20 20:07:09.110889 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'server_id': 'dce310ab-07be-49b9-a207-5d3f22f7b679', 'body': {'volumeAttachment': {'volumeId': 'bfdcbb7a-ab91-49f1-ba3e-6ce9f57afbf7'}}} Jul 20 20:07:09.110889 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 20:07:09.110889 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:07:09.110889 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 20 20:07:09.110889 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 20 20:07:09.110889 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 20:07:09.110889 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 20:07:09.110889 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 20 20:07:09.110889 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 20:07:09.110889 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 20 20:07:09.110889 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 20 20:07:09.110889 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 20 20:07:09.110889 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 20 20:07:09.110889 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume bfdcbb7a-ab91-49f1-ba3e-6ce9f57afbf7 is already attached to instances: dce310ab-07be-49b9-a207-5d3f22f7b679 Jul 20 20:07:09.110889 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:07:09.110889 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:07:09.110889 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:07:09.110889 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:07:09.112364 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:07:09.112364 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:07:09.112364 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 20:07:09.112364 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 20:07:09.112364 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 20:07:09.112364 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 20:07:09.112364 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 20:07:09.112364 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 20:07:09.112364 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 20:07:09.112364 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 20:07:09.112364 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 20:07:09.112364 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 20:07:09.112364 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 20 20:07:09.112364 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 20 20:07:09.112364 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume bfdcbb7a-ab91-49f1-ba3e-6ce9f57afbf7 is already attached to instances: dce310ab-07be-49b9-a207-5d3f22f7b679 Jul 20 20:07:09.112364 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:07:09.112364 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:07:09.112364 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:07:09.112364 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:07:09.112364 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:07:09.113829 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:07:09.113829 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 20:07:09.113829 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 20:07:09.113829 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume bfdcbb7a-ab91-49f1-ba3e-6ce9f57afbf7 is already attached to instances: dce310ab-07be-49b9-a207-5d3f22f7b679 Jul 20 20:07:09.113829 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:07:09.113829 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-06b764d0-e8cc-421e-a244-0782cb4832f3 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Returning 400 to user: Invalid volume: volume bfdcbb7a-ab91-49f1-ba3e-6ce9f57afbf7 is already attached to instances: dce310ab-07be-49b9-a207-5d3f22f7b679 {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 20:07:09.113829 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-06b764d0-e8cc-421e-a244-0782cb4832f3 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "POST /compute/v2.1/servers/dce310ab-07be-49b9-a207-5d3f22f7b679/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097285 Jul 20 20:07:09.113829 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1790/2421] 10.222.0.69 () {60 vars in 1322 bytes} [Wed Jul 20 20:07:09 2022] POST /compute/v2.1/servers/dce310ab-07be-49b9-a207-5d3f22f7b679/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 20 20:07:09.169670 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-5f36438c-36ab-4f46-b078-54e17e15fc0a tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:09.170154 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-5f36438c-36ab-4f46-b078-54e17e15fc0a tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: dce310ab-07be-49b9-a207-5d3f22f7b679] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:09.176794 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5f36438c-36ab-4f46-b078-54e17e15fc0a tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:09.177231 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5f36438c-36ab-4f46-b078-54e17e15fc0a tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:09.178013 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5f36438c-36ab-4f46-b078-54e17e15fc0a tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:09.178439 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5f36438c-36ab-4f46-b078-54e17e15fc0a tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:09.257058 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.objects.instance [None req-5f36438c-36ab-4f46-b078-54e17e15fc0a tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lazy-loading 'services' on Instance uuid dce310ab-07be-49b9-a207-5d3f22f7b679 {{(pid=117761) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 20:07:09.331396 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-5f36438c-36ab-4f46-b078-54e17e15fc0a tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "DELETE /compute/v2.1/servers/dce310ab-07be-49b9-a207-5d3f22f7b679/os-volume_attachments/bfdcbb7a-ab91-49f1-ba3e-6ce9f57afbf7" status: 202 len: 0 microversion: 2.1 time: 0.164868 Jul 20 20:07:09.331984 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1791/2422] 10.222.0.69 () {58 vars in 1415 bytes} [Wed Jul 20 20:07:09 2022] DELETE /compute/v2.1/servers/dce310ab-07be-49b9-a207-5d3f22f7b679/os-volume_attachments/bfdcbb7a-ab91-49f1-ba3e-6ce9f57afbf7 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 20:07:09.340760 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-02475e07-c0b6-4e9c-818c-cc426513b53c tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:09.341866 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-02475e07-c0b6-4e9c-818c-cc426513b53c tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: dce310ab-07be-49b9-a207-5d3f22f7b679] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:09.348912 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-02475e07-c0b6-4e9c-818c-cc426513b53c tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:09.349351 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-02475e07-c0b6-4e9c-818c-cc426513b53c tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:09.350155 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-02475e07-c0b6-4e9c-818c-cc426513b53c tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:09.350583 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-02475e07-c0b6-4e9c-818c-cc426513b53c tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:09.380432 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-02475e07-c0b6-4e9c-818c-cc426513b53c tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/dce310ab-07be-49b9-a207-5d3f22f7b679/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043911 Jul 20 20:07:09.380927 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1792/2423] 10.222.0.69 () {58 vars in 1301 bytes} [Wed Jul 20 20:07:09 2022] GET /compute/v2.1/servers/dce310ab-07be-49b9-a207-5d3f22f7b679/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 20:07:10.392154 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-dba0b504-12aa-4d79-8fb0-659cdf644e99 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:10.393275 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-dba0b504-12aa-4d79-8fb0-659cdf644e99 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: dce310ab-07be-49b9-a207-5d3f22f7b679] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:10.399852 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-dba0b504-12aa-4d79-8fb0-659cdf644e99 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:10.400305 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-dba0b504-12aa-4d79-8fb0-659cdf644e99 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:10.401062 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-dba0b504-12aa-4d79-8fb0-659cdf644e99 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:10.401499 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-dba0b504-12aa-4d79-8fb0-659cdf644e99 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:10.429972 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-dba0b504-12aa-4d79-8fb0-659cdf644e99 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/dce310ab-07be-49b9-a207-5d3f22f7b679/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041704 Jul 20 20:07:10.430521 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1793/2424] 10.222.0.69 () {58 vars in 1301 bytes} [Wed Jul 20 20:07:10 2022] GET /compute/v2.1/servers/dce310ab-07be-49b9-a207-5d3f22f7b679/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 20:07:10.488567 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e78dab1c-c2f8-4360-acc3-7297c3198e7e tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:10.489091 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e78dab1c-c2f8-4360-acc3-7297c3198e7e tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: dce310ab-07be-49b9-a207-5d3f22f7b679] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:10.495021 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e78dab1c-c2f8-4360-acc3-7297c3198e7e tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:10.495467 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e78dab1c-c2f8-4360-acc3-7297c3198e7e tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:10.496220 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e78dab1c-c2f8-4360-acc3-7297c3198e7e tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:10.496653 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e78dab1c-c2f8-4360-acc3-7297c3198e7e tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:10.521818 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e78dab1c-c2f8-4360-acc3-7297c3198e7e tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: dce310ab-07be-49b9-a207-5d3f22f7b679] Going to try to terminate instance {{(pid=117761) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 20:07:10.594935 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e78dab1c-c2f8-4360-acc3-7297c3198e7e tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "DELETE /compute/v2.1/servers/dce310ab-07be-49b9-a207-5d3f22f7b679" status: 204 len: 0 microversion: 2.1 time: 0.110492 Jul 20 20:07:10.595417 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1794/2425] 10.222.0.69 () {58 vars in 1238 bytes} [Wed Jul 20 20:07:10 2022] DELETE /compute/v2.1/servers/dce310ab-07be-49b9-a207-5d3f22f7b679 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 20:07:10.604914 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-b3d74da8-aad8-4aaa-8dd6-9a1a0918809e tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:10.605622 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-b3d74da8-aad8-4aaa-8dd6-9a1a0918809e tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: dce310ab-07be-49b9-a207-5d3f22f7b679] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:10.611437 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b3d74da8-aad8-4aaa-8dd6-9a1a0918809e tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:10.612499 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b3d74da8-aad8-4aaa-8dd6-9a1a0918809e tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:10.613405 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b3d74da8-aad8-4aaa-8dd6-9a1a0918809e tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:10.613851 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b3d74da8-aad8-4aaa-8dd6-9a1a0918809e tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:10.743965 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-b3d74da8-aad8-4aaa-8dd6-9a1a0918809e tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1cf9b55ce04cf997bf23ad73222814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b576df300148ad8d8d7dd3f8335f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:10.751462 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-b3d74da8-aad8-4aaa-8dd6-9a1a0918809e tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/dce310ab-07be-49b9-a207-5d3f22f7b679" status: 200 len: 1682 microversion: 2.1 time: 0.150683 Jul 20 20:07:10.752028 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1795/2426] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:07:10 2022] GET /compute/v2.1/servers/dce310ab-07be-49b9-a207-5d3f22f7b679 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:07:11.768210 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-8037c973-d848-4fc1-9392-2cbb17acf9ea tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:11.768918 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-8037c973-d848-4fc1-9392-2cbb17acf9ea tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: dce310ab-07be-49b9-a207-5d3f22f7b679] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:11.775352 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8037c973-d848-4fc1-9392-2cbb17acf9ea tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:11.775804 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8037c973-d848-4fc1-9392-2cbb17acf9ea tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:11.776560 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8037c973-d848-4fc1-9392-2cbb17acf9ea tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:11.776992 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8037c973-d848-4fc1-9392-2cbb17acf9ea tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:11.909170 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8037c973-d848-4fc1-9392-2cbb17acf9ea tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1cf9b55ce04cf997bf23ad73222814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b576df300148ad8d8d7dd3f8335f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:11.916704 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-8037c973-d848-4fc1-9392-2cbb17acf9ea tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/dce310ab-07be-49b9-a207-5d3f22f7b679" status: 200 len: 1682 microversion: 2.1 time: 0.152331 Jul 20 20:07:11.917271 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1796/2427] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:07:11 2022] GET /compute/v2.1/servers/dce310ab-07be-49b9-a207-5d3f22f7b679 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:07:12.934783 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-738b3277-84a0-4339-8875-5be54b162f72 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:12.935492 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-738b3277-84a0-4339-8875-5be54b162f72 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: dce310ab-07be-49b9-a207-5d3f22f7b679] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:12.942013 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-738b3277-84a0-4339-8875-5be54b162f72 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:12.942463 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-738b3277-84a0-4339-8875-5be54b162f72 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:12.943234 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-738b3277-84a0-4339-8875-5be54b162f72 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:12.943764 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-738b3277-84a0-4339-8875-5be54b162f72 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:13.156534 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-738b3277-84a0-4339-8875-5be54b162f72 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1cf9b55ce04cf997bf23ad73222814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b576df300148ad8d8d7dd3f8335f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:13.165475 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-738b3277-84a0-4339-8875-5be54b162f72 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/dce310ab-07be-49b9-a207-5d3f22f7b679" status: 200 len: 1682 microversion: 2.1 time: 0.234495 Jul 20 20:07:13.166083 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1797/2428] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:07:12 2022] GET /compute/v2.1/servers/dce310ab-07be-49b9-a207-5d3f22f7b679 => generated 1682 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 20:07:13.863391 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [req-8edd9156-0d47-48a3-bb66-7031fb13fb7e req-0a86334a-e7c8-4d9e-afce-f6a2836b3425 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dce310ab-07be-49b9-a207-5d3f22f7b679", "name": "network-vif-deleted", "tag": "818a3272-6cb4-42f4-b1a1-5f62c12568c5"}]} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 20:07:13.873000 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-8edd9156-0d47-48a3-bb66-7031fb13fb7e req-0a86334a-e7c8-4d9e-afce-f6a2836b3425 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:13.873481 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-8edd9156-0d47-48a3-bb66-7031fb13fb7e req-0a86334a-e7c8-4d9e-afce-f6a2836b3425 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:13.887609 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.compute.server_external_events [req-8edd9156-0d47-48a3-bb66-7031fb13fb7e req-0a86334a-e7c8-4d9e-afce-f6a2836b3425 service nova] Creating event network-vif-deleted:818a3272-6cb4-42f4-b1a1-5f62c12568c5 for instance dce310ab-07be-49b9-a207-5d3f22f7b679 on hv-cinder-83538 Jul 20 20:07:13.893092 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [req-8edd9156-0d47-48a3-bb66-7031fb13fb7e req-0a86334a-e7c8-4d9e-afce-f6a2836b3425 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034287 Jul 20 20:07:13.894776 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1798/2429] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 20:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 20:07:14.184574 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-50741118-0935-48bf-858b-73595195f0ee tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:14.185430 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-50741118-0935-48bf-858b-73595195f0ee tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: dce310ab-07be-49b9-a207-5d3f22f7b679] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:14.192397 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-50741118-0935-48bf-858b-73595195f0ee tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:14.192905 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-50741118-0935-48bf-858b-73595195f0ee tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:14.193717 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-50741118-0935-48bf-858b-73595195f0ee tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:14.194157 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-50741118-0935-48bf-858b-73595195f0ee tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:14.226447 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-50741118-0935-48bf-858b-73595195f0ee tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:14.227763 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-50741118-0935-48bf-858b-73595195f0ee tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:14.228392 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.objects.instance [None req-50741118-0935-48bf-858b-73595195f0ee tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lazy-loading 'fault' on Instance uuid dce310ab-07be-49b9-a207-5d3f22f7b679 {{(pid=117761) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 20:07:14.274466 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-50741118-0935-48bf-858b-73595195f0ee tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1cf9b55ce04cf997bf23ad73222814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b576df300148ad8d8d7dd3f8335f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:14.281987 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-50741118-0935-48bf-858b-73595195f0ee tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/dce310ab-07be-49b9-a207-5d3f22f7b679" status: 200 len: 1332 microversion: 2.1 time: 0.101982 Jul 20 20:07:14.291828 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1799/2430] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:07:14 2022] GET /compute/v2.1/servers/dce310ab-07be-49b9-a207-5d3f22f7b679 => generated 1332 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:07:15.298704 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ede1e71b-6edf-4644-b46b-4746f5bf5703 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:15.299356 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ede1e71b-6edf-4644-b46b-4746f5bf5703 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: dce310ab-07be-49b9-a207-5d3f22f7b679] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:15.305799 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ede1e71b-6edf-4644-b46b-4746f5bf5703 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:15.306245 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ede1e71b-6edf-4644-b46b-4746f5bf5703 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:15.306989 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ede1e71b-6edf-4644-b46b-4746f5bf5703 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:15.307415 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ede1e71b-6edf-4644-b46b-4746f5bf5703 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:15.321487 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.wsgi [None req-ede1e71b-6edf-4644-b46b-4746f5bf5703 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] HTTP exception thrown: Instance dce310ab-07be-49b9-a207-5d3f22f7b679 could not be found. Jul 20 20:07:15.323274 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ede1e71b-6edf-4644-b46b-4746f5bf5703 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Request method failure captured: Jul 20 20:07:15.323274 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: GET /compute/v2.1/servers/dce310ab-07be-49b9-a207-5d3f22f7b679 HTTP/1.1 Jul 20 20:07:15.323274 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 20:07:15.323274 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 20:07:15.323274 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 20:07:15.323274 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 0 Jul 20 20:07:15.323274 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 20:07:15.323274 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 20:07:15.323274 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 20:07:15.323274 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 20:07:15.323274 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2F8F6Ge10hBXuhDa0NLuoIQGKdCbH_-0Qytzgx2TiuDpG5vxQ-IW-4WPHWLIEm2lkY4j4eRPFcsjkcnP9w_FRJ3X-P89qM9tliQWnJkm78fASQt3Z_jz-B1-QjBfFR7l1gMla2jtR2bkXlUlscrWVmnS7NtJkSS_8OjKqGZtvWPk5Iw Jul 20 20:07:15.323274 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 20:07:15.323274 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 20:07:15.323274 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 20:07:15.323274 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 20:07:15.323274 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 20:07:15.323274 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 20:07:15.323274 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: b2b576df300148ad8d8d7dd3f8335f8e Jul 20 20:07:15.323274 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-AttachVolumeNegativeTest-1904845904 Jul 20 20:07:15.323274 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 20:07:15.323274 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 20:07:15.325114 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b2b576df300148ad8d8d7dd3f8335f8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b2b576df300148ad8d8d7dd3f8335f8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_b2b576df300148ad8d8d7dd3f8335f8e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/b2b576df300148ad8d8d7dd3f8335f8e"}]}] Jul 20 20:07:15.325114 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-AttachVolumeNegativeTest-1904845904 Jul 20 20:07:15.325114 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: b2b576df300148ad8d8d7dd3f8335f8e Jul 20 20:07:15.325114 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1904845904 Jul 20 20:07:15.325114 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-AttachVolumeNegativeTest-1904845904-project Jul 20 20:07:15.325114 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 20:07:15.325114 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 20:07:15.325114 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: 0d1cf9b55ce04cf997bf23ad73222814 Jul 20 20:07:15.325114 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-AttachVolumeNegativeTest-1904845904-project Jul 20 20:07:15.325114 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: > Jul 20 20:07:15.325114 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Instance dce310ab-07be-49b9-a207-5d3f22f7b679 could not be found. Jul 20 20:07:15.325114 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'id': 'dce310ab-07be-49b9-a207-5d3f22f7b679'} Jul 20 20:07:15.326887 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 20:07:15.326887 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:07:15.326887 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 20:07:15.326887 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 20:07:15.326887 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 20:07:15.326887 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 20:07:15.326887 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 20:07:15.326887 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 20:07:15.326887 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 20:07:15.326887 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 20:07:15.326887 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dce310ab-07be-49b9-a207-5d3f22f7b679 could not be found. Jul 20 20:07:15.326887 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:07:15.326887 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:07:15.326887 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:07:15.326887 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:07:15.326887 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:07:15.326887 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:07:15.326887 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 20:07:15.326887 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 20:07:15.326887 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 20:07:15.328704 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 20:07:15.328704 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 20:07:15.328704 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 20:07:15.328704 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 20:07:15.328704 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 20:07:15.328704 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 20:07:15.328704 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 20:07:15.328704 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dce310ab-07be-49b9-a207-5d3f22f7b679 could not be found. Jul 20 20:07:15.328704 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:07:15.328704 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:07:15.328704 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:07:15.328704 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:07:15.328704 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:07:15.328704 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:07:15.328704 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 20:07:15.328704 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 20:07:15.328704 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dce310ab-07be-49b9-a207-5d3f22f7b679 could not be found. Jul 20 20:07:15.328704 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:07:15.330379 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ede1e71b-6edf-4644-b46b-4746f5bf5703 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Returning 404 to user: Instance dce310ab-07be-49b9-a207-5d3f22f7b679 could not be found. {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 20:07:15.330379 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ede1e71b-6edf-4644-b46b-4746f5bf5703 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/dce310ab-07be-49b9-a207-5d3f22f7b679" status: 404 len: 111 microversion: 2.1 time: 0.029729 Jul 20 20:07:15.330379 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1800/2431] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:07:15 2022] GET /compute/v2.1/servers/dce310ab-07be-49b9-a207-5d3f22f7b679 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 20:07:15.333988 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-977ca0e0-9ebc-4336-a86f-422b34a5bcc5 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '.version_select at 0x7ff609ff1ee0>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:15.351133 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-977ca0e0-9ebc-4336-a86f-422b34a5bcc5 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1051035546" status: 202 len: 0 microversion: 2.1 time: 0.021698 Jul 20 20:07:15.351694 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1801/2432] 10.222.0.69 () {58 vars in 1220 bytes} [Wed Jul 20 20:07:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1051035546 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 20:07:15.981222 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-307459f9-8b23-4fac-8d9e-443ac712d1ca tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Action: 'create', calling method: .version_select at 0x7ff609ff0820>, body: {"keypair": {"name": "tempest-keypair-1121810295", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsWGqd1RDpyQMb1pbLBe1nbZKIJaQ7mcBCI67uInB675BKWem0lB5BBBgVs62pX5q+OzpLFdRHf5bZiflCoSOGXUYTZkF1EQJ3E1odCoab51Gd5AQMu8VvoipPV18YwNQ=="}} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 20:07:15.996605 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.quota [None req-307459f9-8b23-4fac-8d9e-443ac712d1ca tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Getting quotas for project b2b576df300148ad8d8d7dd3f8335f8e. Resources: {'key_pairs'} {{(pid=117761) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 20:07:16.000473 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.quota [None req-307459f9-8b23-4fac-8d9e-443ac712d1ca tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Getting quotas for user 0d1cf9b55ce04cf997bf23ad73222814 and project b2b576df300148ad8d8d7dd3f8335f8e. Resources: {'key_pairs'} {{(pid=117761) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 20:07:16.024154 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-307459f9-8b23-4fac-8d9e-443ac712d1ca tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046531 Jul 20 20:07:16.025188 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1802/2433] 10.222.0.69 () {60 vars in 1158 bytes} [Wed Jul 20 20:07:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 20:07:17.272347 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-f3195b6b-0986-410f-bc39-404e95bf4ac9 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1202980619", "imageRef": "59575804-e013-4dec-af24-b6c2dbbce73a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "78c100cc-b222-4c1f-ade0-f8cea14841c5"}], "security_groups": [{"name": "tempest-securitygroup--127584086"}], "key_name": "tempest-keypair-1121810295", "user_data": "}} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 20:07:17.374213 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.network.neutron [None req-f3195b6b-0986-410f-bc39-404e95bf4ac9 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] validate_networks() for [('78c100cc-b222-4c1f-ade0-f8cea14841c5', None, None, None, None, None)] {{(pid=117761) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 20:07:17.887719 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.virt.hardware [None req-f3195b6b-0986-410f-bc39-404e95bf4ac9 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Flavor limits 0:0:0 {{(pid=117761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 20:07:17.888144 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.virt.hardware [None req-f3195b6b-0986-410f-bc39-404e95bf4ac9 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Image limits 0:0:0 {{(pid=117761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 20:07:17.889047 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.virt.hardware [None req-f3195b6b-0986-410f-bc39-404e95bf4ac9 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Flavor pref 0:0:0 {{(pid=117761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 20:07:17.889226 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.virt.hardware [None req-f3195b6b-0986-410f-bc39-404e95bf4ac9 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Image pref 0:0:0 {{(pid=117761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 20:07:17.889571 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.virt.hardware [None req-f3195b6b-0986-410f-bc39-404e95bf4ac9 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 20:07:17.899658 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f3195b6b-0986-410f-bc39-404e95bf4ac9 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:17.900109 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f3195b6b-0986-410f-bc39-404e95bf4ac9 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:17.900904 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f3195b6b-0986-410f-bc39-404e95bf4ac9 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:17.901338 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f3195b6b-0986-410f-bc39-404e95bf4ac9 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:17.918454 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.quota [None req-f3195b6b-0986-410f-bc39-404e95bf4ac9 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Getting quotas for project b2b576df300148ad8d8d7dd3f8335f8e. Resources: {'cores', 'ram', 'instances'} {{(pid=117761) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 20:07:17.922434 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.quota [None req-f3195b6b-0986-410f-bc39-404e95bf4ac9 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Getting quotas for user 0d1cf9b55ce04cf997bf23ad73222814 and project b2b576df300148ad8d8d7dd3f8335f8e. Resources: {'cores', 'ram', 'instances'} {{(pid=117761) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 20:07:17.933622 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-f3195b6b-0986-410f-bc39-404e95bf4ac9 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Going to run 1 instances... {{(pid=117761) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 20:07:17.935894 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-f3195b6b-0986-410f-bc39-404e95bf4ac9 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: a3e49f4d-dcea-4c1a-a023-0885718d2e54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='59575804-e013-4dec-af24-b6c2dbbce73a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117761) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 20:07:17.982736 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-f3195b6b-0986-410f-bc39-404e95bf4ac9 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.715149 Jul 20 20:07:17.983298 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1803/2434] 10.222.0.69 () {60 vars in 1146 bytes} [Wed Jul 20 20:07:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 20:07:17.993579 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-29e938f4-389b-4469-bac9-911043505682 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:17.994199 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-29e938f4-389b-4469-bac9-911043505682 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: a3e49f4d-dcea-4c1a-a023-0885718d2e54] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:18.078105 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-29e938f4-389b-4469-bac9-911043505682 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1cf9b55ce04cf997bf23ad73222814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b576df300148ad8d8d7dd3f8335f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:18.086544 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-29e938f4-389b-4469-bac9-911043505682 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/a3e49f4d-dcea-4c1a-a023-0885718d2e54" status: 200 len: 1242 microversion: 2.1 time: 0.097061 Jul 20 20:07:18.087292 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1804/2435] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:07:17 2022] GET /compute/v2.1/servers/a3e49f4d-dcea-4c1a-a023-0885718d2e54 => generated 1242 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:07:18.778168 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-90821394-6c93-4e0b-8848-7368e71a3270 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:18.778758 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-90821394-6c93-4e0b-8848-7368e71a3270 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:18.785230 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-90821394-6c93-4e0b-8848-7368e71a3270 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:18.785715 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-90821394-6c93-4e0b-8848-7368e71a3270 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:18.786473 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-90821394-6c93-4e0b-8848-7368e71a3270 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:18.786912 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-90821394-6c93-4e0b-8848-7368e71a3270 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:18.809333 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-90821394-6c93-4e0b-8848-7368e71a3270 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b/ips" status: 200 len: 152 microversion: 2.20 time: 0.107636 Jul 20 20:07:18.809910 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1805/2436] 10.222.0.69 () {60 vars in 1288 bytes} [Wed Jul 20 20:07:18 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b/ips => generated 152 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 20:07:19.105417 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-62d34265-10fb-482c-ae68-6d24f0ba7d6d tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:19.107630 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-62d34265-10fb-482c-ae68-6d24f0ba7d6d tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: a3e49f4d-dcea-4c1a-a023-0885718d2e54] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:19.122899 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-62d34265-10fb-482c-ae68-6d24f0ba7d6d tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:19.123704 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-62d34265-10fb-482c-ae68-6d24f0ba7d6d tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:19.124730 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-62d34265-10fb-482c-ae68-6d24f0ba7d6d tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:19.125376 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-62d34265-10fb-482c-ae68-6d24f0ba7d6d tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:19.131737 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 20:07:19.218177 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-62d34265-10fb-482c-ae68-6d24f0ba7d6d tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1cf9b55ce04cf997bf23ad73222814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b576df300148ad8d8d7dd3f8335f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:19.226315 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-62d34265-10fb-482c-ae68-6d24f0ba7d6d tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/a3e49f4d-dcea-4c1a-a023-0885718d2e54" status: 200 len: 1300 microversion: 2.1 time: 0.124643 Jul 20 20:07:19.226893 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1806/2437] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:07:19 2022] GET /compute/v2.1/servers/a3e49f4d-dcea-4c1a-a023-0885718d2e54 => generated 1300 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:07:20.243983 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-f2879c22-664a-4b66-9a14-b117d59421ee tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:20.244649 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-f2879c22-664a-4b66-9a14-b117d59421ee tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: a3e49f4d-dcea-4c1a-a023-0885718d2e54] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:20.251589 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f2879c22-664a-4b66-9a14-b117d59421ee tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:20.252224 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f2879c22-664a-4b66-9a14-b117d59421ee tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:20.253135 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f2879c22-664a-4b66-9a14-b117d59421ee tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:20.253810 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f2879c22-664a-4b66-9a14-b117d59421ee tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:20.485727 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-f2879c22-664a-4b66-9a14-b117d59421ee tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1cf9b55ce04cf997bf23ad73222814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b576df300148ad8d8d7dd3f8335f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:20.496760 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-f2879c22-664a-4b66-9a14-b117d59421ee tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/a3e49f4d-dcea-4c1a-a023-0885718d2e54" status: 200 len: 1367 microversion: 2.1 time: 0.256194 Jul 20 20:07:20.508887 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1807/2438] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:07:20 2022] GET /compute/v2.1/servers/a3e49f4d-dcea-4c1a-a023-0885718d2e54 => generated 1367 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:07:20.516441 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [req-9e8b3ad5-b12d-49c9-a27f-a105d4bb1b0a req-51a27035-194d-49f6-8aae-d2b1db5de02a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3e49f4d-dcea-4c1a-a023-0885718d2e54", "tag": "43e2539a-bd3e-42cc-9cd3-24dd413449cf"}]} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 20:07:20.527494 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-9e8b3ad5-b12d-49c9-a27f-a105d4bb1b0a req-51a27035-194d-49f6-8aae-d2b1db5de02a service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:20.528027 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-9e8b3ad5-b12d-49c9-a27f-a105d4bb1b0a req-51a27035-194d-49f6-8aae-d2b1db5de02a service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:20.542109 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.compute.server_external_events [req-9e8b3ad5-b12d-49c9-a27f-a105d4bb1b0a req-51a27035-194d-49f6-8aae-d2b1db5de02a service nova] Creating event network-changed:43e2539a-bd3e-42cc-9cd3-24dd413449cf for instance a3e49f4d-dcea-4c1a-a023-0885718d2e54 on hv-cinder-83538 Jul 20 20:07:20.546698 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [req-9e8b3ad5-b12d-49c9-a27f-a105d4bb1b0a req-51a27035-194d-49f6-8aae-d2b1db5de02a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036136 Jul 20 20:07:20.547612 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1808/2439] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 20:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 20:07:20.663404 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-03950e7d-1a3c-4054-8160-5c9189a9904e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 20:07:20.664103 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-03950e7d-1a3c-4054-8160-5c9189a9904e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:20.671431 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-03950e7d-1a3c-4054-8160-5c9189a9904e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:20.671906 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-03950e7d-1a3c-4054-8160-5c9189a9904e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:20.672830 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-03950e7d-1a3c-4054-8160-5c9189a9904e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:20.673331 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-03950e7d-1a3c-4054-8160-5c9189a9904e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:20.697183 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.objects.instance [None req-03950e7d-1a3c-4054-8160-5c9189a9904e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lazy-loading 'flavor' on Instance uuid 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b {{(pid=117761) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 20:07:20.967162 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-03950e7d-1a3c-4054-8160-5c9189a9904e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "POST /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b/action" status: 202 len: 0 microversion: 2.20 time: 0.308873 Jul 20 20:07:20.967793 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1809/2440] 10.222.0.69 () {62 vars in 1318 bytes} [Wed Jul 20 20:07:20 2022] POST /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b/action => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 20 20:07:20.973337 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-17f9e8cb-42ea-4262-9014-0d77367fc220 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:20.973928 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-17f9e8cb-42ea-4262-9014-0d77367fc220 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: 6d8b0dac-fc05-4fc6-a99a-f17dc41b961e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:20.980101 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-17f9e8cb-42ea-4262-9014-0d77367fc220 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:20.980539 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-17f9e8cb-42ea-4262-9014-0d77367fc220 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:20.981281 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-17f9e8cb-42ea-4262-9014-0d77367fc220 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:20.981737 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-17f9e8cb-42ea-4262-9014-0d77367fc220 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:21.004310 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-17f9e8cb-42ea-4262-9014-0d77367fc220 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/6d8b0dac-fc05-4fc6-a99a-f17dc41b961e/ips" status: 200 len: 146 microversion: 2.1 time: 0.035382 Jul 20 20:07:21.004889 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1810/2441] 10.222.0.69 () {58 vars in 1247 bytes} [Wed Jul 20 20:07:20 2022] GET /compute/v2.1/servers/6d8b0dac-fc05-4fc6-a99a-f17dc41b961e/ips => generated 146 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 20:07:21.009113 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-8dfea46b-5761-44fc-b945-d0557f6a4b07 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:21.010832 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-8dfea46b-5761-44fc-b945-d0557f6a4b07 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:21.024043 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8dfea46b-5761-44fc-b945-d0557f6a4b07 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:21.024529 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8dfea46b-5761-44fc-b945-d0557f6a4b07 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:21.025331 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8dfea46b-5761-44fc-b945-d0557f6a4b07 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:21.025810 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8dfea46b-5761-44fc-b945-d0557f6a4b07 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:21.160515 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8dfea46b-5761-44fc-b945-d0557f6a4b07 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:21.168615 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8dfea46b-5761-44fc-b945-d0557f6a4b07 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:21.170167 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8dfea46b-5761-44fc-b945-d0557f6a4b07 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:21.171328 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-8dfea46b-5761-44fc-b945-d0557f6a4b07 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1723 microversion: 2.20 time: 0.165551 Jul 20 20:07:21.171884 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1811/2442] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:07:21 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 20:07:21.514534 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a189b0dc-61c2-4abe-ba08-d2d0fb8dcaea tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:21.515170 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a189b0dc-61c2-4abe-ba08-d2d0fb8dcaea tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: a3e49f4d-dcea-4c1a-a023-0885718d2e54] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:21.522187 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a189b0dc-61c2-4abe-ba08-d2d0fb8dcaea tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:21.522633 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a189b0dc-61c2-4abe-ba08-d2d0fb8dcaea tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:21.523386 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a189b0dc-61c2-4abe-ba08-d2d0fb8dcaea tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:21.523817 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a189b0dc-61c2-4abe-ba08-d2d0fb8dcaea tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:21.655738 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a189b0dc-61c2-4abe-ba08-d2d0fb8dcaea tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1cf9b55ce04cf997bf23ad73222814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b576df300148ad8d8d7dd3f8335f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:21.663785 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a189b0dc-61c2-4abe-ba08-d2d0fb8dcaea tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/a3e49f4d-dcea-4c1a-a023-0885718d2e54" status: 200 len: 1367 microversion: 2.1 time: 0.153014 Jul 20 20:07:21.664360 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1812/2443] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:07:21 2022] GET /compute/v2.1/servers/a3e49f4d-dcea-4c1a-a023-0885718d2e54 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:07:22.189911 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-2fb47a58-c8c9-4cc0-a230-4328f59d4b97 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:22.190515 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-2fb47a58-c8c9-4cc0-a230-4328f59d4b97 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:22.197260 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2fb47a58-c8c9-4cc0-a230-4328f59d4b97 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:22.197729 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2fb47a58-c8c9-4cc0-a230-4328f59d4b97 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:22.198488 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2fb47a58-c8c9-4cc0-a230-4328f59d4b97 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:22.198919 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2fb47a58-c8c9-4cc0-a230-4328f59d4b97 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:22.330908 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-2fb47a58-c8c9-4cc0-a230-4328f59d4b97 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:22.338940 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-2fb47a58-c8c9-4cc0-a230-4328f59d4b97 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:22.340427 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-2fb47a58-c8c9-4cc0-a230-4328f59d4b97 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:22.341871 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-2fb47a58-c8c9-4cc0-a230-4328f59d4b97 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1723 microversion: 2.20 time: 0.155839 Jul 20 20:07:22.342431 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1813/2444] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:07:22 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 20:07:22.681222 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a989e519-0e2f-42dd-8f0f-dcc78942430e tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:22.681918 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a989e519-0e2f-42dd-8f0f-dcc78942430e tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: a3e49f4d-dcea-4c1a-a023-0885718d2e54] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:22.688515 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a989e519-0e2f-42dd-8f0f-dcc78942430e tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:22.688970 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a989e519-0e2f-42dd-8f0f-dcc78942430e tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:22.689761 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a989e519-0e2f-42dd-8f0f-dcc78942430e tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:22.690196 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a989e519-0e2f-42dd-8f0f-dcc78942430e tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:22.821411 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a989e519-0e2f-42dd-8f0f-dcc78942430e tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1cf9b55ce04cf997bf23ad73222814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b576df300148ad8d8d7dd3f8335f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:22.828839 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a989e519-0e2f-42dd-8f0f-dcc78942430e tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/a3e49f4d-dcea-4c1a-a023-0885718d2e54" status: 200 len: 1367 microversion: 2.1 time: 0.151442 Jul 20 20:07:22.829403 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1814/2445] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:07:22 2022] GET /compute/v2.1/servers/a3e49f4d-dcea-4c1a-a023-0885718d2e54 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:07:23.360601 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-41a4e700-2c98-41f7-a79e-4f7203f6b1c3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:23.361235 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-41a4e700-2c98-41f7-a79e-4f7203f6b1c3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:23.368112 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-41a4e700-2c98-41f7-a79e-4f7203f6b1c3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:23.368563 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-41a4e700-2c98-41f7-a79e-4f7203f6b1c3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:23.369337 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-41a4e700-2c98-41f7-a79e-4f7203f6b1c3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:23.369799 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-41a4e700-2c98-41f7-a79e-4f7203f6b1c3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:23.505484 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-41a4e700-2c98-41f7-a79e-4f7203f6b1c3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:23.513347 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-41a4e700-2c98-41f7-a79e-4f7203f6b1c3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:23.514871 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-41a4e700-2c98-41f7-a79e-4f7203f6b1c3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:23.516018 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-41a4e700-2c98-41f7-a79e-4f7203f6b1c3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1723 microversion: 2.20 time: 0.159856 Jul 20 20:07:23.516568 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1815/2446] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:07:23 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 20:07:23.521640 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-8ef1f471-a0f0-4543-88a4-e143267b0389 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a49817bc-7cd1-4cb7-9946-0c88ed6d6504"}} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 20:07:23.522726 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-8ef1f471-a0f0-4543-88a4-e143267b0389 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: 6d8b0dac-fc05-4fc6-a99a-f17dc41b961e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:23.528422 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8ef1f471-a0f0-4543-88a4-e143267b0389 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:23.528867 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8ef1f471-a0f0-4543-88a4-e143267b0389 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:23.529642 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8ef1f471-a0f0-4543-88a4-e143267b0389 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:23.530075 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8ef1f471-a0f0-4543-88a4-e143267b0389 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:24.519805 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-8ef1f471-a0f0-4543-88a4-e143267b0389 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "POST /compute/v2.1/servers/6d8b0dac-fc05-4fc6-a99a-f17dc41b961e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.001225 Jul 20 20:07:24.520524 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1816/2447] 10.222.0.69 () {60 vars in 1322 bytes} [Wed Jul 20 20:07:23 2022] POST /compute/v2.1/servers/6d8b0dac-fc05-4fc6-a99a-f17dc41b961e/os-volume_attachments => generated 194 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 20:07:24.525989 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-9f778aa2-11cd-4bcf-9dc6-c284614fe895 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:24.526751 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-9f778aa2-11cd-4bcf-9dc6-c284614fe895 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: a3e49f4d-dcea-4c1a-a023-0885718d2e54] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:24.535731 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9f778aa2-11cd-4bcf-9dc6-c284614fe895 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:24.536331 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9f778aa2-11cd-4bcf-9dc6-c284614fe895 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:24.537226 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9f778aa2-11cd-4bcf-9dc6-c284614fe895 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:24.538039 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9f778aa2-11cd-4bcf-9dc6-c284614fe895 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:24.737032 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-9f778aa2-11cd-4bcf-9dc6-c284614fe895 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1cf9b55ce04cf997bf23ad73222814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b576df300148ad8d8d7dd3f8335f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:24.744642 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-9f778aa2-11cd-4bcf-9dc6-c284614fe895 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/a3e49f4d-dcea-4c1a-a023-0885718d2e54" status: 200 len: 1367 microversion: 2.1 time: 0.223059 Jul 20 20:07:24.745209 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1817/2448] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:07:24 2022] GET /compute/v2.1/servers/a3e49f4d-dcea-4c1a-a023-0885718d2e54 => generated 1367 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 20:07:24.749610 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4d199cc1-d593-4de9-9343-6e91b68b983c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:24.750395 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-4d199cc1-d593-4de9-9343-6e91b68b983c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:24.753167 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 20:07:24.757572 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4d199cc1-d593-4de9-9343-6e91b68b983c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:24.758022 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4d199cc1-d593-4de9-9343-6e91b68b983c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:24.758786 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4d199cc1-d593-4de9-9343-6e91b68b983c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:24.759213 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4d199cc1-d593-4de9-9343-6e91b68b983c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:24.984268 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-4d199cc1-d593-4de9-9343-6e91b68b983c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:24.994506 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-4d199cc1-d593-4de9-9343-6e91b68b983c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:24.996185 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-4d199cc1-d593-4de9-9343-6e91b68b983c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:24.997349 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-4d199cc1-d593-4de9-9343-6e91b68b983c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1723 microversion: 2.20 time: 0.251206 Jul 20 20:07:24.997955 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1818/2449] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:07:24 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1723 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 20:07:25.760788 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a8a8cd29-4e34-4087-b534-90f6681e7006 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:25.761418 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a8a8cd29-4e34-4087-b534-90f6681e7006 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: a3e49f4d-dcea-4c1a-a023-0885718d2e54] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:25.768926 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a8a8cd29-4e34-4087-b534-90f6681e7006 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:25.769418 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a8a8cd29-4e34-4087-b534-90f6681e7006 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:25.770292 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a8a8cd29-4e34-4087-b534-90f6681e7006 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:25.770727 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a8a8cd29-4e34-4087-b534-90f6681e7006 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:25.905075 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a8a8cd29-4e34-4087-b534-90f6681e7006 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1cf9b55ce04cf997bf23ad73222814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b576df300148ad8d8d7dd3f8335f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:25.913029 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a8a8cd29-4e34-4087-b534-90f6681e7006 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/a3e49f4d-dcea-4c1a-a023-0885718d2e54" status: 200 len: 1367 microversion: 2.1 time: 0.156201 Jul 20 20:07:25.913611 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1819/2450] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:07:25 2022] GET /compute/v2.1/servers/a3e49f4d-dcea-4c1a-a023-0885718d2e54 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:07:26.016097 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-f6eca6ef-cf74-4ff4-b568-b3d99daca28b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:26.016697 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-f6eca6ef-cf74-4ff4-b568-b3d99daca28b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:26.023323 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f6eca6ef-cf74-4ff4-b568-b3d99daca28b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:26.023762 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f6eca6ef-cf74-4ff4-b568-b3d99daca28b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:26.024508 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f6eca6ef-cf74-4ff4-b568-b3d99daca28b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:26.024934 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f6eca6ef-cf74-4ff4-b568-b3d99daca28b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:26.043144 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 20:07:26.157001 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-f6eca6ef-cf74-4ff4-b568-b3d99daca28b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:26.165416 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-f6eca6ef-cf74-4ff4-b568-b3d99daca28b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:26.166928 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-f6eca6ef-cf74-4ff4-b568-b3d99daca28b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:26.168061 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-f6eca6ef-cf74-4ff4-b568-b3d99daca28b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1723 microversion: 2.20 time: 0.155809 Jul 20 20:07:26.168642 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1820/2451] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:07:26 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 20:07:26.930955 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-44390e1c-f119-4c6f-a692-1bffb9f39dd4 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:26.931564 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-44390e1c-f119-4c6f-a692-1bffb9f39dd4 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: a3e49f4d-dcea-4c1a-a023-0885718d2e54] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:26.938019 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-44390e1c-f119-4c6f-a692-1bffb9f39dd4 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:26.938466 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-44390e1c-f119-4c6f-a692-1bffb9f39dd4 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:26.939223 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-44390e1c-f119-4c6f-a692-1bffb9f39dd4 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:26.939656 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-44390e1c-f119-4c6f-a692-1bffb9f39dd4 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:27.071290 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-44390e1c-f119-4c6f-a692-1bffb9f39dd4 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1cf9b55ce04cf997bf23ad73222814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b576df300148ad8d8d7dd3f8335f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:27.078580 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-44390e1c-f119-4c6f-a692-1bffb9f39dd4 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/a3e49f4d-dcea-4c1a-a023-0885718d2e54" status: 200 len: 1367 microversion: 2.1 time: 0.152240 Jul 20 20:07:27.079141 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1821/2452] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:07:26 2022] GET /compute/v2.1/servers/a3e49f4d-dcea-4c1a-a023-0885718d2e54 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:07:27.186830 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ba0d4582-93be-46e3-be68-9aeca91047d8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:27.187345 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ba0d4582-93be-46e3-be68-9aeca91047d8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:27.194156 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ba0d4582-93be-46e3-be68-9aeca91047d8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:27.194601 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ba0d4582-93be-46e3-be68-9aeca91047d8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:27.195339 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ba0d4582-93be-46e3-be68-9aeca91047d8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:27.195766 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ba0d4582-93be-46e3-be68-9aeca91047d8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:27.322853 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ba0d4582-93be-46e3-be68-9aeca91047d8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:27.330916 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ba0d4582-93be-46e3-be68-9aeca91047d8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:27.333131 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ba0d4582-93be-46e3-be68-9aeca91047d8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:27.334317 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ba0d4582-93be-46e3-be68-9aeca91047d8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1723 microversion: 2.20 time: 0.151668 Jul 20 20:07:27.334874 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1822/2453] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:07:27 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 20:07:27.770367 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [req-ef977f6b-a5f2-42da-942f-8fa5bebe06c1 req-f071ddaa-89b6-433d-a5cc-1c278b5b7090 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3e49f4d-dcea-4c1a-a023-0885718d2e54", "name": "network-vif-plugged", "status": "completed", "tag": "43e2539a-bd3e-42cc-9cd3-24dd413449cf"}]} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 20:07:27.778447 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-ef977f6b-a5f2-42da-942f-8fa5bebe06c1 req-f071ddaa-89b6-433d-a5cc-1c278b5b7090 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:27.778888 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-ef977f6b-a5f2-42da-942f-8fa5bebe06c1 req-f071ddaa-89b6-433d-a5cc-1c278b5b7090 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:27.789796 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.compute.server_external_events [req-ef977f6b-a5f2-42da-942f-8fa5bebe06c1 req-f071ddaa-89b6-433d-a5cc-1c278b5b7090 service nova] Creating event network-vif-plugged:43e2539a-bd3e-42cc-9cd3-24dd413449cf for instance a3e49f4d-dcea-4c1a-a023-0885718d2e54 on hv-cinder-83538 Jul 20 20:07:27.794566 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [req-ef977f6b-a5f2-42da-942f-8fa5bebe06c1 req-f071ddaa-89b6-433d-a5cc-1c278b5b7090 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093428 Jul 20 20:07:27.795143 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1823/2454] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 20:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 20:07:28.093773 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell0:SELECT=2 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 20:07:28.095170 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell0:SELECT=12 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 20:07:28.100356 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4d981fbe-8053-4251-a25e-1e015f23afd1 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:28.101050 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-4d981fbe-8053-4251-a25e-1e015f23afd1 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: a3e49f4d-dcea-4c1a-a023-0885718d2e54] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:28.108081 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4d981fbe-8053-4251-a25e-1e015f23afd1 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:28.108524 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4d981fbe-8053-4251-a25e-1e015f23afd1 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:28.109280 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4d981fbe-8053-4251-a25e-1e015f23afd1 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:28.109741 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4d981fbe-8053-4251-a25e-1e015f23afd1 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:28.239612 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-4d981fbe-8053-4251-a25e-1e015f23afd1 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1cf9b55ce04cf997bf23ad73222814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b576df300148ad8d8d7dd3f8335f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:28.247261 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-4d981fbe-8053-4251-a25e-1e015f23afd1 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/a3e49f4d-dcea-4c1a-a023-0885718d2e54" status: 200 len: 1367 microversion: 2.1 time: 0.154363 Jul 20 20:07:28.247838 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1824/2455] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:07:28 2022] GET /compute/v2.1/servers/a3e49f4d-dcea-4c1a-a023-0885718d2e54 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:07:28.352722 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-1ad953a8-aa83-4230-961e-55c6099f4ff5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:28.353319 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-1ad953a8-aa83-4230-961e-55c6099f4ff5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:28.359429 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1ad953a8-aa83-4230-961e-55c6099f4ff5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:28.359876 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1ad953a8-aa83-4230-961e-55c6099f4ff5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:28.360709 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1ad953a8-aa83-4230-961e-55c6099f4ff5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:28.361104 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1ad953a8-aa83-4230-961e-55c6099f4ff5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:28.492877 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1ad953a8-aa83-4230-961e-55c6099f4ff5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:28.500713 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1ad953a8-aa83-4230-961e-55c6099f4ff5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:28.502250 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1ad953a8-aa83-4230-961e-55c6099f4ff5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:28.503405 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-1ad953a8-aa83-4230-961e-55c6099f4ff5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1723 microversion: 2.20 time: 0.154603 Jul 20 20:07:28.504022 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1825/2456] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:07:28 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 20:07:29.264664 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-f147f556-218d-4890-93b2-e466dce7c781 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:29.265396 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-f147f556-218d-4890-93b2-e466dce7c781 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: a3e49f4d-dcea-4c1a-a023-0885718d2e54] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:29.272045 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f147f556-218d-4890-93b2-e466dce7c781 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:29.272496 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f147f556-218d-4890-93b2-e466dce7c781 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:29.273259 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f147f556-218d-4890-93b2-e466dce7c781 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:29.273730 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f147f556-218d-4890-93b2-e466dce7c781 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:29.402430 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-f147f556-218d-4890-93b2-e466dce7c781 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1cf9b55ce04cf997bf23ad73222814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b576df300148ad8d8d7dd3f8335f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:29.409836 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-f147f556-218d-4890-93b2-e466dce7c781 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/a3e49f4d-dcea-4c1a-a023-0885718d2e54" status: 200 len: 1367 microversion: 2.1 time: 0.148931 Jul 20 20:07:29.410935 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1826/2457] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:07:29 2022] GET /compute/v2.1/servers/a3e49f4d-dcea-4c1a-a023-0885718d2e54 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:07:29.522401 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-6127eca7-13a4-4fee-a0a6-3d944605e434 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:29.523035 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-6127eca7-13a4-4fee-a0a6-3d944605e434 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:29.528948 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6127eca7-13a4-4fee-a0a6-3d944605e434 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:29.529570 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6127eca7-13a4-4fee-a0a6-3d944605e434 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:29.530366 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6127eca7-13a4-4fee-a0a6-3d944605e434 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:29.530911 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6127eca7-13a4-4fee-a0a6-3d944605e434 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:29.664074 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6127eca7-13a4-4fee-a0a6-3d944605e434 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:29.671946 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6127eca7-13a4-4fee-a0a6-3d944605e434 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:29.673443 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6127eca7-13a4-4fee-a0a6-3d944605e434 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:29.674664 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-6127eca7-13a4-4fee-a0a6-3d944605e434 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1723 microversion: 2.20 time: 0.157184 Jul 20 20:07:29.675224 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1827/2458] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:07:29 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 20:07:30.427967 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-3f86493e-9d0a-48a7-bcb5-a37da1887736 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:30.428607 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-3f86493e-9d0a-48a7-bcb5-a37da1887736 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: a3e49f4d-dcea-4c1a-a023-0885718d2e54] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:30.434970 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3f86493e-9d0a-48a7-bcb5-a37da1887736 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:30.435408 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3f86493e-9d0a-48a7-bcb5-a37da1887736 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:30.436147 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3f86493e-9d0a-48a7-bcb5-a37da1887736 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:30.436573 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3f86493e-9d0a-48a7-bcb5-a37da1887736 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:30.566668 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3f86493e-9d0a-48a7-bcb5-a37da1887736 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1cf9b55ce04cf997bf23ad73222814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b576df300148ad8d8d7dd3f8335f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:30.574276 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-3f86493e-9d0a-48a7-bcb5-a37da1887736 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/a3e49f4d-dcea-4c1a-a023-0885718d2e54" status: 200 len: 1558 microversion: 2.1 time: 0.150821 Jul 20 20:07:30.574777 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1828/2459] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:07:30 2022] GET /compute/v2.1/servers/a3e49f4d-dcea-4c1a-a023-0885718d2e54 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:07:30.590641 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-fc5771d7-5afd-4536-a337-f290f6d39f56 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:30.591131 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-fc5771d7-5afd-4536-a337-f290f6d39f56 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: a3e49f4d-dcea-4c1a-a023-0885718d2e54] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:30.597193 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fc5771d7-5afd-4536-a337-f290f6d39f56 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:30.597711 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fc5771d7-5afd-4536-a337-f290f6d39f56 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:30.599460 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fc5771d7-5afd-4536-a337-f290f6d39f56 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:30.600211 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fc5771d7-5afd-4536-a337-f290f6d39f56 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:30.679973 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-fc5771d7-5afd-4536-a337-f290f6d39f56 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/a3e49f4d-dcea-4c1a-a023-0885718d2e54/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092967 Jul 20 20:07:30.680572 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1829/2460] 10.222.0.69 () {58 vars in 1274 bytes} [Wed Jul 20 20:07:30 2022] GET /compute/v2.1/servers/a3e49f4d-dcea-4c1a-a023-0885718d2e54/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 20:07:30.694108 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a05f7421-fc7e-4e57-883b-1d6f22a26967 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:30.695031 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a05f7421-fc7e-4e57-883b-1d6f22a26967 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:30.701670 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a05f7421-fc7e-4e57-883b-1d6f22a26967 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:30.702119 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a05f7421-fc7e-4e57-883b-1d6f22a26967 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:30.702908 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a05f7421-fc7e-4e57-883b-1d6f22a26967 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:30.703349 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a05f7421-fc7e-4e57-883b-1d6f22a26967 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:30.961024 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a05f7421-fc7e-4e57-883b-1d6f22a26967 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:30.969280 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a05f7421-fc7e-4e57-883b-1d6f22a26967 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:30.970830 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a05f7421-fc7e-4e57-883b-1d6f22a26967 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:30.971982 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a05f7421-fc7e-4e57-883b-1d6f22a26967 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1723 microversion: 2.20 time: 0.282331 Jul 20 20:07:30.972577 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1830/2461] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:07:30 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1723 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 20:07:31.963779 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [req-1d7e1d7f-5a8c-4b81-ad9a-614fd2767ed1 req-d3ff0066-9032-4d64-a90a-e1476c9cff1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3e49f4d-dcea-4c1a-a023-0885718d2e54", "tag": "43e2539a-bd3e-42cc-9cd3-24dd413449cf"}]} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 20:07:31.975061 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-1d7e1d7f-5a8c-4b81-ad9a-614fd2767ed1 req-d3ff0066-9032-4d64-a90a-e1476c9cff1d service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:31.975507 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-1d7e1d7f-5a8c-4b81-ad9a-614fd2767ed1 req-d3ff0066-9032-4d64-a90a-e1476c9cff1d service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:31.988739 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.compute.server_external_events [req-1d7e1d7f-5a8c-4b81-ad9a-614fd2767ed1 req-d3ff0066-9032-4d64-a90a-e1476c9cff1d service nova] Creating event network-changed:43e2539a-bd3e-42cc-9cd3-24dd413449cf for instance a3e49f4d-dcea-4c1a-a023-0885718d2e54 on hv-cinder-83538 Jul 20 20:07:31.994123 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [req-1d7e1d7f-5a8c-4b81-ad9a-614fd2767ed1 req-d3ff0066-9032-4d64-a90a-e1476c9cff1d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034542 Jul 20 20:07:31.995087 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1831/2462] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 20:07:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 20:07:32.000552 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c7f72714-ca61-47f4-988f-61270f77d25f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:32.001251 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c7f72714-ca61-47f4-988f-61270f77d25f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:32.008473 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c7f72714-ca61-47f4-988f-61270f77d25f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:32.008930 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c7f72714-ca61-47f4-988f-61270f77d25f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:32.009750 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c7f72714-ca61-47f4-988f-61270f77d25f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:32.010180 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c7f72714-ca61-47f4-988f-61270f77d25f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:32.233491 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c7f72714-ca61-47f4-988f-61270f77d25f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:32.242955 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c7f72714-ca61-47f4-988f-61270f77d25f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:32.244545 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c7f72714-ca61-47f4-988f-61270f77d25f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:32.245814 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c7f72714-ca61-47f4-988f-61270f77d25f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1723 microversion: 2.20 time: 0.249636 Jul 20 20:07:32.246460 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1832/2463] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:07:31 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1723 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 20:07:32.251088 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-2316a3fb-93c5-49ff-b88e-9c10f8222ed4 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:32.252075 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-2316a3fb-93c5-49ff-b88e-9c10f8222ed4 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: 6d8b0dac-fc05-4fc6-a99a-f17dc41b961e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:32.258953 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2316a3fb-93c5-49ff-b88e-9c10f8222ed4 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:32.259506 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2316a3fb-93c5-49ff-b88e-9c10f8222ed4 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:32.260354 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2316a3fb-93c5-49ff-b88e-9c10f8222ed4 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:32.260877 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2316a3fb-93c5-49ff-b88e-9c10f8222ed4 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:32.293972 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-2316a3fb-93c5-49ff-b88e-9c10f8222ed4 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/6d8b0dac-fc05-4fc6-a99a-f17dc41b961e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046218 Jul 20 20:07:32.299426 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1833/2464] 10.222.0.69 () {58 vars in 1301 bytes} [Wed Jul 20 20:07:32 2022] GET /compute/v2.1/servers/6d8b0dac-fc05-4fc6-a99a-f17dc41b961e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 20:07:32.307325 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-f9091e96-12d2-4b84-8e71-7a507fc14816 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:32.307927 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-f9091e96-12d2-4b84-8e71-7a507fc14816 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: 6d8b0dac-fc05-4fc6-a99a-f17dc41b961e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:32.315930 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f9091e96-12d2-4b84-8e71-7a507fc14816 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:32.316613 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f9091e96-12d2-4b84-8e71-7a507fc14816 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:32.318197 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f9091e96-12d2-4b84-8e71-7a507fc14816 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:32.318929 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f9091e96-12d2-4b84-8e71-7a507fc14816 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:32.350212 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-f9091e96-12d2-4b84-8e71-7a507fc14816 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/6d8b0dac-fc05-4fc6-a99a-f17dc41b961e/os-volume_attachments/a49817bc-7cd1-4cb7-9946-0c88ed6d6504" status: 200 len: 194 microversion: 2.1 time: 0.049367 Jul 20 20:07:32.350734 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1834/2465] 10.222.0.69 () {58 vars in 1412 bytes} [Wed Jul 20 20:07:32 2022] GET /compute/v2.1/servers/6d8b0dac-fc05-4fc6-a99a-f17dc41b961e/os-volume_attachments/a49817bc-7cd1-4cb7-9946-0c88ed6d6504 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 20:07:33.264142 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-bb3d4eb1-5b77-4fe0-aa54-b82922d3b5c9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:33.264801 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-bb3d4eb1-5b77-4fe0-aa54-b82922d3b5c9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:33.272069 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bb3d4eb1-5b77-4fe0-aa54-b82922d3b5c9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:33.272539 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bb3d4eb1-5b77-4fe0-aa54-b82922d3b5c9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:33.273290 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bb3d4eb1-5b77-4fe0-aa54-b82922d3b5c9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:33.273723 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bb3d4eb1-5b77-4fe0-aa54-b82922d3b5c9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:33.405069 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-bb3d4eb1-5b77-4fe0-aa54-b82922d3b5c9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:33.413530 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-bb3d4eb1-5b77-4fe0-aa54-b82922d3b5c9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:33.415061 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-bb3d4eb1-5b77-4fe0-aa54-b82922d3b5c9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:33.416224 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-bb3d4eb1-5b77-4fe0-aa54-b82922d3b5c9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1723 microversion: 2.20 time: 0.156056 Jul 20 20:07:33.416779 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1835/2466] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:07:33 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 20:07:33.715813 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-88d78f45-3913-4b16-86e1-5c871d05ab0c tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7c34dcfb-8298-445a-8742-25d152fee26a"}} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 20:07:33.716861 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-88d78f45-3913-4b16-86e1-5c871d05ab0c tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: 6d8b0dac-fc05-4fc6-a99a-f17dc41b961e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:33.723127 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-88d78f45-3913-4b16-86e1-5c871d05ab0c tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:33.724130 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-88d78f45-3913-4b16-86e1-5c871d05ab0c tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:33.724891 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-88d78f45-3913-4b16-86e1-5c871d05ab0c tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:33.725327 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-88d78f45-3913-4b16-86e1-5c871d05ab0c tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:33.978015 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-88d78f45-3913-4b16-86e1-5c871d05ab0c tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "POST /compute/v2.1/servers/6d8b0dac-fc05-4fc6-a99a-f17dc41b961e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265508 Jul 20 20:07:33.978628 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1836/2467] 10.222.0.69 () {60 vars in 1322 bytes} [Wed Jul 20 20:07:33 2022] POST /compute/v2.1/servers/6d8b0dac-fc05-4fc6-a99a-f17dc41b961e/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 20:07:34.435756 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-0339939e-bb2f-4f11-8883-1d5e3e13a2ed tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:34.436481 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-0339939e-bb2f-4f11-8883-1d5e3e13a2ed tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:34.442814 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0339939e-bb2f-4f11-8883-1d5e3e13a2ed tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:34.443257 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0339939e-bb2f-4f11-8883-1d5e3e13a2ed tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:34.444009 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0339939e-bb2f-4f11-8883-1d5e3e13a2ed tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:34.444437 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0339939e-bb2f-4f11-8883-1d5e3e13a2ed tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:34.462728 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 20:07:34.582214 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0339939e-bb2f-4f11-8883-1d5e3e13a2ed tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:34.590786 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0339939e-bb2f-4f11-8883-1d5e3e13a2ed tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:34.592568 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0339939e-bb2f-4f11-8883-1d5e3e13a2ed tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:34.593751 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-0339939e-bb2f-4f11-8883-1d5e3e13a2ed tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1723 microversion: 2.20 time: 0.162830 Jul 20 20:07:34.594316 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1837/2468] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:07:34 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 20:07:35.612050 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-b3cb3437-692a-4cc2-8243-7700b305ed05 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:35.612742 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-b3cb3437-692a-4cc2-8243-7700b305ed05 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:35.619888 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b3cb3437-692a-4cc2-8243-7700b305ed05 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:35.620336 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b3cb3437-692a-4cc2-8243-7700b305ed05 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:35.621099 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b3cb3437-692a-4cc2-8243-7700b305ed05 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:35.621555 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b3cb3437-692a-4cc2-8243-7700b305ed05 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:35.749092 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-b3cb3437-692a-4cc2-8243-7700b305ed05 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:35.757086 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-b3cb3437-692a-4cc2-8243-7700b305ed05 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:35.758625 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-b3cb3437-692a-4cc2-8243-7700b305ed05 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:35.759776 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-b3cb3437-692a-4cc2-8243-7700b305ed05 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1723 microversion: 2.20 time: 0.151884 Jul 20 20:07:35.760347 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1838/2469] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:07:35 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 20:07:36.777815 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-6e729af5-93b0-4d32-a776-96e83dd8b1a9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:36.778514 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-6e729af5-93b0-4d32-a776-96e83dd8b1a9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:36.784854 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6e729af5-93b0-4d32-a776-96e83dd8b1a9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:36.785297 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6e729af5-93b0-4d32-a776-96e83dd8b1a9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:36.786753 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6e729af5-93b0-4d32-a776-96e83dd8b1a9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:36.787183 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6e729af5-93b0-4d32-a776-96e83dd8b1a9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:36.914874 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6e729af5-93b0-4d32-a776-96e83dd8b1a9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:36.922731 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6e729af5-93b0-4d32-a776-96e83dd8b1a9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:36.924227 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6e729af5-93b0-4d32-a776-96e83dd8b1a9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:36.925365 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-6e729af5-93b0-4d32-a776-96e83dd8b1a9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1723 microversion: 2.20 time: 0.151500 Jul 20 20:07:36.926102 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1839/2470] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:07:36 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 20:07:37.943701 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-5d0d567d-82b8-4ba5-935c-acc1cc171db1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:37.944396 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-5d0d567d-82b8-4ba5-935c-acc1cc171db1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:37.950874 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5d0d567d-82b8-4ba5-935c-acc1cc171db1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:37.951319 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5d0d567d-82b8-4ba5-935c-acc1cc171db1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:37.952072 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5d0d567d-82b8-4ba5-935c-acc1cc171db1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:37.952502 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5d0d567d-82b8-4ba5-935c-acc1cc171db1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:38.086169 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-5d0d567d-82b8-4ba5-935c-acc1cc171db1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:38.094290 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-5d0d567d-82b8-4ba5-935c-acc1cc171db1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:38.095791 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-5d0d567d-82b8-4ba5-935c-acc1cc171db1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:38.096943 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-5d0d567d-82b8-4ba5-935c-acc1cc171db1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1723 microversion: 2.20 time: 0.157795 Jul 20 20:07:38.097502 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1840/2471] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:07:37 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 20:07:39.115790 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4dd54b85-6aa0-4fad-b290-aa2edd4a3bdb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:39.116472 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-4dd54b85-6aa0-4fad-b290-aa2edd4a3bdb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:39.122947 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4dd54b85-6aa0-4fad-b290-aa2edd4a3bdb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:39.123391 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4dd54b85-6aa0-4fad-b290-aa2edd4a3bdb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:39.124147 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4dd54b85-6aa0-4fad-b290-aa2edd4a3bdb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:39.124577 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4dd54b85-6aa0-4fad-b290-aa2edd4a3bdb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:39.253311 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-4dd54b85-6aa0-4fad-b290-aa2edd4a3bdb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:39.262975 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-4dd54b85-6aa0-4fad-b290-aa2edd4a3bdb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:39.265352 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-4dd54b85-6aa0-4fad-b290-aa2edd4a3bdb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:39.265352 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-4dd54b85-6aa0-4fad-b290-aa2edd4a3bdb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1723 microversion: 2.20 time: 0.153186 Jul 20 20:07:39.275981 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1841/2472] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:07:39 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 20:07:40.285586 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-1795b512-c40d-4332-a81a-ea91762deed1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:40.286272 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-1795b512-c40d-4332-a81a-ea91762deed1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:40.292689 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1795b512-c40d-4332-a81a-ea91762deed1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:40.293158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1795b512-c40d-4332-a81a-ea91762deed1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:40.293935 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1795b512-c40d-4332-a81a-ea91762deed1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:40.294368 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1795b512-c40d-4332-a81a-ea91762deed1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:40.442292 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1795b512-c40d-4332-a81a-ea91762deed1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:40.450824 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1795b512-c40d-4332-a81a-ea91762deed1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:40.452322 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1795b512-c40d-4332-a81a-ea91762deed1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:40.453457 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-1795b512-c40d-4332-a81a-ea91762deed1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1723 microversion: 2.20 time: 0.171747 Jul 20 20:07:40.454583 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1842/2473] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:07:40 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 20:07:41.472511 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-0e0d3193-3d8e-45f2-968b-91a7afcef0eb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:41.473213 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-0e0d3193-3d8e-45f2-968b-91a7afcef0eb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:41.480783 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0e0d3193-3d8e-45f2-968b-91a7afcef0eb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:41.481322 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0e0d3193-3d8e-45f2-968b-91a7afcef0eb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:41.482183 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0e0d3193-3d8e-45f2-968b-91a7afcef0eb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:41.482703 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0e0d3193-3d8e-45f2-968b-91a7afcef0eb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:41.618256 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0e0d3193-3d8e-45f2-968b-91a7afcef0eb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:41.626061 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0e0d3193-3d8e-45f2-968b-91a7afcef0eb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:41.627552 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0e0d3193-3d8e-45f2-968b-91a7afcef0eb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:41.628989 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-0e0d3193-3d8e-45f2-968b-91a7afcef0eb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1744 microversion: 2.20 time: 0.160324 Jul 20 20:07:41.629576 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1843/2474] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:07:41 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1744 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 20:07:42.535022 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-7dffa31c-a4fb-4fa3-8b60-b9aa37a3e091 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:42.535996 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-7dffa31c-a4fb-4fa3-8b60-b9aa37a3e091 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: 6d8b0dac-fc05-4fc6-a99a-f17dc41b961e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:42.543307 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7dffa31c-a4fb-4fa3-8b60-b9aa37a3e091 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:42.543757 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7dffa31c-a4fb-4fa3-8b60-b9aa37a3e091 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:42.544520 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7dffa31c-a4fb-4fa3-8b60-b9aa37a3e091 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:42.544953 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7dffa31c-a4fb-4fa3-8b60-b9aa37a3e091 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:42.574173 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-7dffa31c-a4fb-4fa3-8b60-b9aa37a3e091 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/6d8b0dac-fc05-4fc6-a99a-f17dc41b961e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043316 Jul 20 20:07:42.574737 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1844/2475] 10.222.0.69 () {58 vars in 1301 bytes} [Wed Jul 20 20:07:42 2022] GET /compute/v2.1/servers/6d8b0dac-fc05-4fc6-a99a-f17dc41b961e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 20:07:42.647738 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-225286c2-a311-442a-8974-7536ccc69d4c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:42.648349 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-225286c2-a311-442a-8974-7536ccc69d4c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:42.655187 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-225286c2-a311-442a-8974-7536ccc69d4c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:42.655636 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-225286c2-a311-442a-8974-7536ccc69d4c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:42.656394 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-225286c2-a311-442a-8974-7536ccc69d4c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:42.656836 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-225286c2-a311-442a-8974-7536ccc69d4c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:42.788577 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-225286c2-a311-442a-8974-7536ccc69d4c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:42.796315 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-225286c2-a311-442a-8974-7536ccc69d4c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:42.797825 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-225286c2-a311-442a-8974-7536ccc69d4c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:42.798969 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-225286c2-a311-442a-8974-7536ccc69d4c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1744 microversion: 2.20 time: 0.155343 Jul 20 20:07:42.799519 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1845/2476] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:07:42 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 20:07:42.804678 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-1e5f0a58-c98e-47df-9522-341ea1b18b74 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:42.805154 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-1e5f0a58-c98e-47df-9522-341ea1b18b74 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: 6d8b0dac-fc05-4fc6-a99a-f17dc41b961e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:42.810816 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1e5f0a58-c98e-47df-9522-341ea1b18b74 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:42.811255 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1e5f0a58-c98e-47df-9522-341ea1b18b74 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:42.811999 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1e5f0a58-c98e-47df-9522-341ea1b18b74 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:42.812426 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1e5f0a58-c98e-47df-9522-341ea1b18b74 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:42.840786 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-1e5f0a58-c98e-47df-9522-341ea1b18b74 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/6d8b0dac-fc05-4fc6-a99a-f17dc41b961e/os-volume_attachments/a49817bc-7cd1-4cb7-9946-0c88ed6d6504" status: 200 len: 194 microversion: 2.1 time: 0.040269 Jul 20 20:07:42.841671 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1846/2477] 10.222.0.69 () {58 vars in 1412 bytes} [Wed Jul 20 20:07:42 2022] GET /compute/v2.1/servers/6d8b0dac-fc05-4fc6-a99a-f17dc41b961e/os-volume_attachments/a49817bc-7cd1-4cb7-9946-0c88ed6d6504 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 20:07:42.851590 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-34406170-bbb8-43b6-b5db-deb9c414198a tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:42.852065 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-34406170-bbb8-43b6-b5db-deb9c414198a tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: 6d8b0dac-fc05-4fc6-a99a-f17dc41b961e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:42.857672 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-34406170-bbb8-43b6-b5db-deb9c414198a tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:42.858111 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-34406170-bbb8-43b6-b5db-deb9c414198a tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:42.858854 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-34406170-bbb8-43b6-b5db-deb9c414198a tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:42.859279 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-34406170-bbb8-43b6-b5db-deb9c414198a tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:42.937621 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.objects.instance [None req-34406170-bbb8-43b6-b5db-deb9c414198a tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lazy-loading 'services' on Instance uuid 6d8b0dac-fc05-4fc6-a99a-f17dc41b961e {{(pid=117761) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 20:07:43.007645 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-34406170-bbb8-43b6-b5db-deb9c414198a tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "DELETE /compute/v2.1/servers/6d8b0dac-fc05-4fc6-a99a-f17dc41b961e/os-volume_attachments/a49817bc-7cd1-4cb7-9946-0c88ed6d6504" status: 202 len: 0 microversion: 2.1 time: 0.160079 Jul 20 20:07:43.008278 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1847/2478] 10.222.0.69 () {58 vars in 1415 bytes} [Wed Jul 20 20:07:42 2022] DELETE /compute/v2.1/servers/6d8b0dac-fc05-4fc6-a99a-f17dc41b961e/os-volume_attachments/a49817bc-7cd1-4cb7-9946-0c88ed6d6504 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 20:07:43.819315 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-6569dd61-06f9-464b-8750-99abfc90fa55 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:43.820062 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-6569dd61-06f9-464b-8750-99abfc90fa55 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:43.826347 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6569dd61-06f9-464b-8750-99abfc90fa55 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:43.826802 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6569dd61-06f9-464b-8750-99abfc90fa55 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:43.827572 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6569dd61-06f9-464b-8750-99abfc90fa55 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:43.828007 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6569dd61-06f9-464b-8750-99abfc90fa55 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:43.968817 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6569dd61-06f9-464b-8750-99abfc90fa55 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:43.977696 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6569dd61-06f9-464b-8750-99abfc90fa55 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:43.979210 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6569dd61-06f9-464b-8750-99abfc90fa55 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:43.980382 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-6569dd61-06f9-464b-8750-99abfc90fa55 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1744 microversion: 2.20 time: 0.166549 Jul 20 20:07:43.980974 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1848/2479] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:07:43 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1744 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 20:07:44.998983 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-01266e75-e0ad-4ad0-927b-25651c9313b7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:44.999653 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-01266e75-e0ad-4ad0-927b-25651c9313b7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:45.006556 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-01266e75-e0ad-4ad0-927b-25651c9313b7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:45.007094 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-01266e75-e0ad-4ad0-927b-25651c9313b7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:45.007871 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-01266e75-e0ad-4ad0-927b-25651c9313b7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:45.008302 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-01266e75-e0ad-4ad0-927b-25651c9313b7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:45.138025 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-01266e75-e0ad-4ad0-927b-25651c9313b7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:45.146064 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-01266e75-e0ad-4ad0-927b-25651c9313b7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:45.147588 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-01266e75-e0ad-4ad0-927b-25651c9313b7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:45.149009 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-01266e75-e0ad-4ad0-927b-25651c9313b7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1744 microversion: 2.20 time: 0.153928 Jul 20 20:07:45.149607 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1849/2480] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:07:44 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 20:07:45.173942 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-9a42e0f9-cf0a-43ee-a7ae-1e6c511ecc93 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:45.174438 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-9a42e0f9-cf0a-43ee-a7ae-1e6c511ecc93 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: 6d8b0dac-fc05-4fc6-a99a-f17dc41b961e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:45.181007 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9a42e0f9-cf0a-43ee-a7ae-1e6c511ecc93 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:45.181457 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9a42e0f9-cf0a-43ee-a7ae-1e6c511ecc93 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:45.182237 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9a42e0f9-cf0a-43ee-a7ae-1e6c511ecc93 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:45.182685 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9a42e0f9-cf0a-43ee-a7ae-1e6c511ecc93 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:45.210762 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-9a42e0f9-cf0a-43ee-a7ae-1e6c511ecc93 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/6d8b0dac-fc05-4fc6-a99a-f17dc41b961e/os-volume_attachments/7c34dcfb-8298-445a-8742-25d152fee26a" status: 200 len: 194 microversion: 2.1 time: 0.040831 Jul 20 20:07:45.211357 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1850/2481] 10.222.0.69 () {58 vars in 1412 bytes} [Wed Jul 20 20:07:45 2022] GET /compute/v2.1/servers/6d8b0dac-fc05-4fc6-a99a-f17dc41b961e/os-volume_attachments/7c34dcfb-8298-445a-8742-25d152fee26a => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 20:07:45.220871 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-29b9c746-a1da-4ff4-a649-fada11163c1b tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:45.221356 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-29b9c746-a1da-4ff4-a649-fada11163c1b tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: 6d8b0dac-fc05-4fc6-a99a-f17dc41b961e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:45.227212 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-29b9c746-a1da-4ff4-a649-fada11163c1b tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:45.227667 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-29b9c746-a1da-4ff4-a649-fada11163c1b tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:45.228420 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-29b9c746-a1da-4ff4-a649-fada11163c1b tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:45.228859 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-29b9c746-a1da-4ff4-a649-fada11163c1b tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:45.309597 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.objects.instance [None req-29b9c746-a1da-4ff4-a649-fada11163c1b tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lazy-loading 'services' on Instance uuid 6d8b0dac-fc05-4fc6-a99a-f17dc41b961e {{(pid=117761) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 20:07:45.388888 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-29b9c746-a1da-4ff4-a649-fada11163c1b tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "DELETE /compute/v2.1/servers/6d8b0dac-fc05-4fc6-a99a-f17dc41b961e/os-volume_attachments/7c34dcfb-8298-445a-8742-25d152fee26a" status: 202 len: 0 microversion: 2.1 time: 0.171673 Jul 20 20:07:45.389549 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1851/2482] 10.222.0.69 () {58 vars in 1415 bytes} [Wed Jul 20 20:07:45 2022] DELETE /compute/v2.1/servers/6d8b0dac-fc05-4fc6-a99a-f17dc41b961e/os-volume_attachments/7c34dcfb-8298-445a-8742-25d152fee26a => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 20:07:45.831861 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [req-453eb1c1-c1ed-471c-ad65-67d0c95840d8 req-92662053-bd6f-403e-8240-b4df8adeff69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c5c0c16-97ac-46f6-8a3e-f5440a0d584b", "name": "network-vif-plugged", "status": "completed", "tag": "4d5fe51d-3208-445f-a00e-81057db89aa5"}]} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 20:07:45.841589 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-453eb1c1-c1ed-471c-ad65-67d0c95840d8 req-92662053-bd6f-403e-8240-b4df8adeff69 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:45.842029 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-453eb1c1-c1ed-471c-ad65-67d0c95840d8 req-92662053-bd6f-403e-8240-b4df8adeff69 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:45.855349 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.compute.server_external_events [req-453eb1c1-c1ed-471c-ad65-67d0c95840d8 req-92662053-bd6f-403e-8240-b4df8adeff69 service nova] Creating event network-vif-plugged:4d5fe51d-3208-445f-a00e-81057db89aa5 for instance 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b on hv-cinder-83538 Jul 20 20:07:45.860100 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [req-453eb1c1-c1ed-471c-ad65-67d0c95840d8 req-92662053-bd6f-403e-8240-b4df8adeff69 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032269 Jul 20 20:07:45.860686 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1852/2483] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 20:07:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 20:07:46.168696 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e86e83e8-6f61-4b38-8d9b-8c5f5b901d05 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:46.169393 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e86e83e8-6f61-4b38-8d9b-8c5f5b901d05 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:46.175430 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e86e83e8-6f61-4b38-8d9b-8c5f5b901d05 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:46.175877 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e86e83e8-6f61-4b38-8d9b-8c5f5b901d05 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:46.176631 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e86e83e8-6f61-4b38-8d9b-8c5f5b901d05 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:46.177059 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e86e83e8-6f61-4b38-8d9b-8c5f5b901d05 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:46.195903 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 20:07:46.323348 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e86e83e8-6f61-4b38-8d9b-8c5f5b901d05 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:46.331136 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e86e83e8-6f61-4b38-8d9b-8c5f5b901d05 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:46.332619 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e86e83e8-6f61-4b38-8d9b-8c5f5b901d05 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:46.333780 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e86e83e8-6f61-4b38-8d9b-8c5f5b901d05 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1744 microversion: 2.20 time: 0.169906 Jul 20 20:07:46.335006 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1853/2484] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:07:46 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1744 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 20:07:46.551567 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-afaced08-e1f5-47ce-89a6-34ea92dc829e tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:46.552532 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-afaced08-e1f5-47ce-89a6-34ea92dc829e tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: 6d8b0dac-fc05-4fc6-a99a-f17dc41b961e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:46.559166 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-afaced08-e1f5-47ce-89a6-34ea92dc829e tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:46.559616 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-afaced08-e1f5-47ce-89a6-34ea92dc829e tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:46.560376 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-afaced08-e1f5-47ce-89a6-34ea92dc829e tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:46.560811 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-afaced08-e1f5-47ce-89a6-34ea92dc829e tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:46.589937 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-afaced08-e1f5-47ce-89a6-34ea92dc829e tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/6d8b0dac-fc05-4fc6-a99a-f17dc41b961e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042176 Jul 20 20:07:46.590496 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1854/2485] 10.222.0.69 () {58 vars in 1301 bytes} [Wed Jul 20 20:07:46 2022] GET /compute/v2.1/servers/6d8b0dac-fc05-4fc6-a99a-f17dc41b961e/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 20:07:46.695271 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a1ae8041-4a5a-4043-8d94-0bb3de35bbc9 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:46.696191 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a1ae8041-4a5a-4043-8d94-0bb3de35bbc9 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: 6d8b0dac-fc05-4fc6-a99a-f17dc41b961e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:46.702272 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a1ae8041-4a5a-4043-8d94-0bb3de35bbc9 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:46.702756 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a1ae8041-4a5a-4043-8d94-0bb3de35bbc9 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:46.703516 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a1ae8041-4a5a-4043-8d94-0bb3de35bbc9 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:46.703973 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a1ae8041-4a5a-4043-8d94-0bb3de35bbc9 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:46.732980 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a1ae8041-4a5a-4043-8d94-0bb3de35bbc9 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/6d8b0dac-fc05-4fc6-a99a-f17dc41b961e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041691 Jul 20 20:07:46.733549 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1855/2486] 10.222.0.69 () {58 vars in 1301 bytes} [Wed Jul 20 20:07:46 2022] GET /compute/v2.1/servers/6d8b0dac-fc05-4fc6-a99a-f17dc41b961e/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 20:07:46.790696 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ad0dfa87-8eda-4854-a7ce-f14f01d57eff tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:46.791192 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ad0dfa87-8eda-4854-a7ce-f14f01d57eff tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: 6d8b0dac-fc05-4fc6-a99a-f17dc41b961e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:46.797189 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ad0dfa87-8eda-4854-a7ce-f14f01d57eff tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:46.797681 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ad0dfa87-8eda-4854-a7ce-f14f01d57eff tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:46.798442 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ad0dfa87-8eda-4854-a7ce-f14f01d57eff tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:46.798880 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ad0dfa87-8eda-4854-a7ce-f14f01d57eff tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:46.822896 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ad0dfa87-8eda-4854-a7ce-f14f01d57eff tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: 6d8b0dac-fc05-4fc6-a99a-f17dc41b961e] Going to try to terminate instance {{(pid=117761) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 20:07:46.899623 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ad0dfa87-8eda-4854-a7ce-f14f01d57eff tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "DELETE /compute/v2.1/servers/6d8b0dac-fc05-4fc6-a99a-f17dc41b961e" status: 204 len: 0 microversion: 2.1 time: 0.113123 Jul 20 20:07:46.900321 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1856/2487] 10.222.0.69 () {58 vars in 1238 bytes} [Wed Jul 20 20:07:46 2022] DELETE /compute/v2.1/servers/6d8b0dac-fc05-4fc6-a99a-f17dc41b961e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 20:07:46.908724 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-3a4c35bc-7df1-43a2-aa4e-3d572a33c463 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:46.909417 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-3a4c35bc-7df1-43a2-aa4e-3d572a33c463 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: 6d8b0dac-fc05-4fc6-a99a-f17dc41b961e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:46.916148 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3a4c35bc-7df1-43a2-aa4e-3d572a33c463 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:46.916613 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3a4c35bc-7df1-43a2-aa4e-3d572a33c463 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:46.917374 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3a4c35bc-7df1-43a2-aa4e-3d572a33c463 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:46.917825 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3a4c35bc-7df1-43a2-aa4e-3d572a33c463 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:47.047480 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3a4c35bc-7df1-43a2-aa4e-3d572a33c463 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:47.055116 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-3a4c35bc-7df1-43a2-aa4e-3d572a33c463 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/6d8b0dac-fc05-4fc6-a99a-f17dc41b961e" status: 200 len: 1673 microversion: 2.1 time: 0.150392 Jul 20 20:07:47.055686 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1857/2488] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:07:46 2022] GET /compute/v2.1/servers/6d8b0dac-fc05-4fc6-a99a-f17dc41b961e => generated 1673 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:07:47.353074 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-82f21e3f-8ecf-4a10-b714-a0164d5f2692 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:47.353749 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-82f21e3f-8ecf-4a10-b714-a0164d5f2692 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:47.360146 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-82f21e3f-8ecf-4a10-b714-a0164d5f2692 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:47.360593 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-82f21e3f-8ecf-4a10-b714-a0164d5f2692 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:47.361343 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-82f21e3f-8ecf-4a10-b714-a0164d5f2692 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:47.361800 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-82f21e3f-8ecf-4a10-b714-a0164d5f2692 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:47.490155 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-82f21e3f-8ecf-4a10-b714-a0164d5f2692 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:47.499166 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-82f21e3f-8ecf-4a10-b714-a0164d5f2692 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:47.500670 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-82f21e3f-8ecf-4a10-b714-a0164d5f2692 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:47.501864 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-82f21e3f-8ecf-4a10-b714-a0164d5f2692 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1744 microversion: 2.20 time: 0.153303 Jul 20 20:07:47.502424 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1858/2489] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:07:47 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 20:07:48.072895 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-2ad3a415-34db-4e6c-977a-b76bf294e191 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:48.073543 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-2ad3a415-34db-4e6c-977a-b76bf294e191 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: 6d8b0dac-fc05-4fc6-a99a-f17dc41b961e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:48.080477 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2ad3a415-34db-4e6c-977a-b76bf294e191 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:48.080927 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2ad3a415-34db-4e6c-977a-b76bf294e191 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:48.081706 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2ad3a415-34db-4e6c-977a-b76bf294e191 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:48.082147 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2ad3a415-34db-4e6c-977a-b76bf294e191 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:48.214249 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-2ad3a415-34db-4e6c-977a-b76bf294e191 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:48.221904 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-2ad3a415-34db-4e6c-977a-b76bf294e191 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/6d8b0dac-fc05-4fc6-a99a-f17dc41b961e" status: 200 len: 1673 microversion: 2.1 time: 0.153442 Jul 20 20:07:48.222471 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1859/2490] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:07:48 2022] GET /compute/v2.1/servers/6d8b0dac-fc05-4fc6-a99a-f17dc41b961e => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:07:48.520610 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-3e2a3b22-b24a-434e-ba06-53ac575ec134 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:48.521434 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-3e2a3b22-b24a-434e-ba06-53ac575ec134 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:48.528720 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3e2a3b22-b24a-434e-ba06-53ac575ec134 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:48.529161 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3e2a3b22-b24a-434e-ba06-53ac575ec134 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:48.529947 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3e2a3b22-b24a-434e-ba06-53ac575ec134 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:48.530374 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3e2a3b22-b24a-434e-ba06-53ac575ec134 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:48.667090 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3e2a3b22-b24a-434e-ba06-53ac575ec134 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:48.676022 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3e2a3b22-b24a-434e-ba06-53ac575ec134 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:48.677529 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3e2a3b22-b24a-434e-ba06-53ac575ec134 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:48.678875 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-3e2a3b22-b24a-434e-ba06-53ac575ec134 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1744 microversion: 2.20 time: 0.162237 Jul 20 20:07:48.679432 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1860/2491] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:07:48 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 20:07:49.239956 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4f8afc6b-ff91-45a1-bc25-1d4a65eefef6 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:49.241284 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-4f8afc6b-ff91-45a1-bc25-1d4a65eefef6 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: 6d8b0dac-fc05-4fc6-a99a-f17dc41b961e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:49.247422 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4f8afc6b-ff91-45a1-bc25-1d4a65eefef6 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:49.247868 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4f8afc6b-ff91-45a1-bc25-1d4a65eefef6 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:49.248613 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4f8afc6b-ff91-45a1-bc25-1d4a65eefef6 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:49.249038 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4f8afc6b-ff91-45a1-bc25-1d4a65eefef6 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:49.409638 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-4f8afc6b-ff91-45a1-bc25-1d4a65eefef6 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:49.417616 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-4f8afc6b-ff91-45a1-bc25-1d4a65eefef6 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/6d8b0dac-fc05-4fc6-a99a-f17dc41b961e" status: 200 len: 1673 microversion: 2.1 time: 0.181477 Jul 20 20:07:49.418396 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1861/2492] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:07:49 2022] GET /compute/v2.1/servers/6d8b0dac-fc05-4fc6-a99a-f17dc41b961e => generated 1673 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:07:49.697787 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-8c20f5d4-6790-41b9-bf28-ec75a213a35a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:49.698498 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-8c20f5d4-6790-41b9-bf28-ec75a213a35a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:49.704682 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8c20f5d4-6790-41b9-bf28-ec75a213a35a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:49.705135 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8c20f5d4-6790-41b9-bf28-ec75a213a35a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:49.705929 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8c20f5d4-6790-41b9-bf28-ec75a213a35a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:49.706365 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8c20f5d4-6790-41b9-bf28-ec75a213a35a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:49.912157 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8c20f5d4-6790-41b9-bf28-ec75a213a35a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:49.921856 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8c20f5d4-6790-41b9-bf28-ec75a213a35a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:49.923837 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8c20f5d4-6790-41b9-bf28-ec75a213a35a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:49.925067 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-8c20f5d4-6790-41b9-bf28-ec75a213a35a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1744 microversion: 2.20 time: 0.231310 Jul 20 20:07:49.925596 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1862/2493] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:07:49 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1744 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 20:07:50.312079 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [req-b8942a1b-a4a2-4265-89ed-f7e075715d3b req-bfaf189b-8582-47c3-860e-ab2eba8f6f23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d8b0dac-fc05-4fc6-a99a-f17dc41b961e", "name": "network-vif-deleted", "tag": "51489eef-9554-46e4-8f14-0ee91dc2feaf"}]} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 20:07:50.333987 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-b8942a1b-a4a2-4265-89ed-f7e075715d3b req-bfaf189b-8582-47c3-860e-ab2eba8f6f23 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:50.334367 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-b8942a1b-a4a2-4265-89ed-f7e075715d3b req-bfaf189b-8582-47c3-860e-ab2eba8f6f23 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:50.348695 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.compute.server_external_events [req-b8942a1b-a4a2-4265-89ed-f7e075715d3b req-bfaf189b-8582-47c3-860e-ab2eba8f6f23 service nova] Creating event network-vif-deleted:51489eef-9554-46e4-8f14-0ee91dc2feaf for instance 6d8b0dac-fc05-4fc6-a99a-f17dc41b961e on hv-cinder-83538 Jul 20 20:07:50.356850 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [req-b8942a1b-a4a2-4265-89ed-f7e075715d3b req-bfaf189b-8582-47c3-860e-ab2eba8f6f23 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047830 Jul 20 20:07:50.358320 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1863/2494] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 20:07:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 20:07:50.436302 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d1c0b740-707a-4ad5-8616-2973ddfde405 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:50.437212 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d1c0b740-707a-4ad5-8616-2973ddfde405 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: 6d8b0dac-fc05-4fc6-a99a-f17dc41b961e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:50.446670 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d1c0b740-707a-4ad5-8616-2973ddfde405 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:50.447648 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d1c0b740-707a-4ad5-8616-2973ddfde405 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:50.448652 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d1c0b740-707a-4ad5-8616-2973ddfde405 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:50.449371 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d1c0b740-707a-4ad5-8616-2973ddfde405 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:50.486821 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 20:07:50.497874 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d1c0b740-707a-4ad5-8616-2973ddfde405 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:50.498839 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d1c0b740-707a-4ad5-8616-2973ddfde405 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:50.499655 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.objects.instance [None req-d1c0b740-707a-4ad5-8616-2973ddfde405 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lazy-loading 'fault' on Instance uuid 6d8b0dac-fc05-4fc6-a99a-f17dc41b961e {{(pid=117761) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 20:07:50.552710 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d1c0b740-707a-4ad5-8616-2973ddfde405 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d08da0ef69e4cf2abc6c18bbbc51a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab510f529d4442bd0e379056c4c3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:50.566515 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d1c0b740-707a-4ad5-8616-2973ddfde405 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/6d8b0dac-fc05-4fc6-a99a-f17dc41b961e" status: 200 len: 1327 microversion: 2.1 time: 0.134645 Jul 20 20:07:50.577408 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1864/2495] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:07:50 2022] GET /compute/v2.1/servers/6d8b0dac-fc05-4fc6-a99a-f17dc41b961e => generated 1327 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 20:07:50.944669 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-cb7453e0-f390-43e3-8163-67dfc20946d3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:50.946354 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-cb7453e0-f390-43e3-8163-67dfc20946d3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:50.954693 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cb7453e0-f390-43e3-8163-67dfc20946d3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:50.955616 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cb7453e0-f390-43e3-8163-67dfc20946d3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:50.956679 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cb7453e0-f390-43e3-8163-67dfc20946d3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:50.957212 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cb7453e0-f390-43e3-8163-67dfc20946d3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:51.138496 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-cb7453e0-f390-43e3-8163-67dfc20946d3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:51.148334 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-cb7453e0-f390-43e3-8163-67dfc20946d3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:51.151700 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-cb7453e0-f390-43e3-8163-67dfc20946d3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:51.153758 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-cb7453e0-f390-43e3-8163-67dfc20946d3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1739 microversion: 2.20 time: 0.213435 Jul 20 20:07:51.165780 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1865/2496] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:07:50 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1739 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 20:07:51.584207 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-cd7664fc-be7f-4208-9fb2-2a1827429bcb tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:51.585662 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-cd7664fc-be7f-4208-9fb2-2a1827429bcb tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: 6d8b0dac-fc05-4fc6-a99a-f17dc41b961e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:51.592184 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cd7664fc-be7f-4208-9fb2-2a1827429bcb tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:51.592633 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cd7664fc-be7f-4208-9fb2-2a1827429bcb tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:51.593372 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cd7664fc-be7f-4208-9fb2-2a1827429bcb tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:51.594145 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cd7664fc-be7f-4208-9fb2-2a1827429bcb tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:51.608059 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.wsgi [None req-cd7664fc-be7f-4208-9fb2-2a1827429bcb tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] HTTP exception thrown: Instance 6d8b0dac-fc05-4fc6-a99a-f17dc41b961e could not be found. Jul 20 20:07:51.609742 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-cd7664fc-be7f-4208-9fb2-2a1827429bcb tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Request method failure captured: Jul 20 20:07:51.609742 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: GET /compute/v2.1/servers/6d8b0dac-fc05-4fc6-a99a-f17dc41b961e HTTP/1.1 Jul 20 20:07:51.609742 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 20:07:51.609742 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 20:07:51.609742 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 20:07:51.609742 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 0 Jul 20 20:07:51.609742 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 20:07:51.609742 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 20:07:51.609742 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 20:07:51.609742 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 20:07:51.609742 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2FZGo6-HVFVhR6OjPhJxZ1gh94do_O6d8P7kPPvbPDILEmBb1jM0xfV5m7JhTQt5sdz1iJC9fqY_tpPN-uIZZ_wcPYLmcsGaNA7u_2CgAPkrxbvTi4CqkH4xaTggAZoiITrtn1JA6v7LpNRqp8UVLC0NuMxUIRQmnj3pK9LvM26JN6A Jul 20 20:07:51.609742 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 20:07:51.609742 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 20:07:51.609742 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 20:07:51.609742 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 20:07:51.609742 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 20:07:51.609742 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 20:07:51.609742 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: d0ab510f529d4442bd0e379056c4c3e5 Jul 20 20:07:51.609742 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-AttachVolumeTestJSON-1160958235 Jul 20 20:07:51.609742 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 20:07:51.609742 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 20:07:51.611480 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d0ab510f529d4442bd0e379056c4c3e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d0ab510f529d4442bd0e379056c4c3e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_d0ab510f529d4442bd0e379056c4c3e5", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/d0ab510f529d4442bd0e379056c4c3e5"}]}] Jul 20 20:07:51.611480 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-AttachVolumeTestJSON-1160958235 Jul 20 20:07:51.611480 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: d0ab510f529d4442bd0e379056c4c3e5 Jul 20 20:07:51.611480 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1160958235 Jul 20 20:07:51.611480 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-AttachVolumeTestJSON-1160958235-project Jul 20 20:07:51.611480 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 20:07:51.611480 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 20:07:51.611480 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: 4d08da0ef69e4cf2abc6c18bbbc51a2f Jul 20 20:07:51.611480 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-AttachVolumeTestJSON-1160958235-project Jul 20 20:07:51.611480 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: > Jul 20 20:07:51.611480 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Instance 6d8b0dac-fc05-4fc6-a99a-f17dc41b961e could not be found. Jul 20 20:07:51.611480 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'id': '6d8b0dac-fc05-4fc6-a99a-f17dc41b961e'} Jul 20 20:07:51.612851 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 20:07:51.612851 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:07:51.612851 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 20:07:51.612851 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 20:07:51.612851 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 20:07:51.612851 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 20:07:51.612851 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 20:07:51.612851 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 20:07:51.612851 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 20:07:51.612851 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 20:07:51.612851 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d8b0dac-fc05-4fc6-a99a-f17dc41b961e could not be found. Jul 20 20:07:51.612851 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:07:51.612851 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:07:51.612851 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:07:51.612851 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:07:51.612851 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:07:51.612851 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:07:51.612851 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 20:07:51.612851 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 20:07:51.612851 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 20:07:51.614656 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 20:07:51.614656 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 20:07:51.614656 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 20:07:51.614656 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 20:07:51.614656 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 20:07:51.614656 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 20:07:51.614656 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 20:07:51.614656 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d8b0dac-fc05-4fc6-a99a-f17dc41b961e could not be found. Jul 20 20:07:51.614656 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:07:51.614656 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:07:51.614656 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:07:51.614656 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:07:51.614656 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:07:51.614656 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:07:51.614656 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 20:07:51.614656 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 20:07:51.614656 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d8b0dac-fc05-4fc6-a99a-f17dc41b961e could not be found. Jul 20 20:07:51.614656 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:07:51.616792 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-cd7664fc-be7f-4208-9fb2-2a1827429bcb tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Returning 404 to user: Instance 6d8b0dac-fc05-4fc6-a99a-f17dc41b961e could not be found. {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 20:07:51.616792 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-cd7664fc-be7f-4208-9fb2-2a1827429bcb tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/6d8b0dac-fc05-4fc6-a99a-f17dc41b961e" status: 404 len: 111 microversion: 2.1 time: 0.030831 Jul 20 20:07:51.616792 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1866/2497] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:07:51 2022] GET /compute/v2.1/servers/6d8b0dac-fc05-4fc6-a99a-f17dc41b961e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 20:07:51.620112 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-45ae7e39-6926-4923-afd4-94bf52a0ff3d tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '.version_select at 0x7ff60e973700>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:51.641146 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-45ae7e39-6926-4923-afd4-94bf52a0ff3d tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-504751825" status: 202 len: 0 microversion: 2.1 time: 0.024462 Jul 20 20:07:51.642071 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1867/2498] 10.222.0.69 () {58 vars in 1217 bytes} [Wed Jul 20 20:07:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-504751825 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 20:07:52.172646 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d8a26eb0-ceb6-4dd9-857a-2ecdcafa9f05 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:52.174025 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d8a26eb0-ceb6-4dd9-857a-2ecdcafa9f05 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:52.183670 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d8a26eb0-ceb6-4dd9-857a-2ecdcafa9f05 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:52.184124 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d8a26eb0-ceb6-4dd9-857a-2ecdcafa9f05 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:52.184892 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d8a26eb0-ceb6-4dd9-857a-2ecdcafa9f05 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:52.185325 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d8a26eb0-ceb6-4dd9-857a-2ecdcafa9f05 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:52.402658 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d8a26eb0-ceb6-4dd9-857a-2ecdcafa9f05 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:52.413685 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d8a26eb0-ceb6-4dd9-857a-2ecdcafa9f05 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:52.415818 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d8a26eb0-ceb6-4dd9-857a-2ecdcafa9f05 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:52.417115 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d8a26eb0-ceb6-4dd9-857a-2ecdcafa9f05 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1739 microversion: 2.20 time: 0.248896 Jul 20 20:07:52.417891 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1868/2499] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:07:52 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1739 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 20:07:53.435434 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a1078f20-cecb-471a-93ae-f3da32759ce1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:53.437445 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a1078f20-cecb-471a-93ae-f3da32759ce1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:53.445843 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a1078f20-cecb-471a-93ae-f3da32759ce1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:53.446337 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a1078f20-cecb-471a-93ae-f3da32759ce1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:53.447539 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a1078f20-cecb-471a-93ae-f3da32759ce1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:53.448268 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a1078f20-cecb-471a-93ae-f3da32759ce1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:53.923899 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a1078f20-cecb-471a-93ae-f3da32759ce1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:53.940415 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a1078f20-cecb-471a-93ae-f3da32759ce1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:53.942700 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a1078f20-cecb-471a-93ae-f3da32759ce1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:53.944367 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a1078f20-cecb-471a-93ae-f3da32759ce1 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1739 microversion: 2.20 time: 0.512794 Jul 20 20:07:53.945225 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1869/2500] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:07:53 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1739 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 20:07:54.758215 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-eb73acfa-66be-42dd-9817-c44659395c07 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:54.760220 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-eb73acfa-66be-42dd-9817-c44659395c07 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: 6d8b0dac-fc05-4fc6-a99a-f17dc41b961e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:54.767602 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-eb73acfa-66be-42dd-9817-c44659395c07 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:54.768393 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-eb73acfa-66be-42dd-9817-c44659395c07 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:54.769323 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-eb73acfa-66be-42dd-9817-c44659395c07 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:54.770095 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-eb73acfa-66be-42dd-9817-c44659395c07 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:54.785572 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.wsgi [None req-eb73acfa-66be-42dd-9817-c44659395c07 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] HTTP exception thrown: Instance 6d8b0dac-fc05-4fc6-a99a-f17dc41b961e could not be found. Jul 20 20:07:54.787289 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-eb73acfa-66be-42dd-9817-c44659395c07 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Request method failure captured: Jul 20 20:07:54.787289 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: DELETE /compute/v2.1/servers/6d8b0dac-fc05-4fc6-a99a-f17dc41b961e HTTP/1.1 Jul 20 20:07:54.787289 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 20:07:54.787289 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 20:07:54.787289 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 20:07:54.787289 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 0 Jul 20 20:07:54.787289 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 20:07:54.787289 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 20:07:54.787289 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 20:07:54.787289 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 20:07:54.787289 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2FZGo6-HVFVhR6OjPhJxZ1gh94do_O6d8P7kPPvbPDILEmBb1jM0xfV5m7JhTQt5sdz1iJC9fqY_tpPN-uIZZ_wcPYLmcsGaNA7u_2CgAPkrxbvTi4CqkH4xaTggAZoiITrtn1JA6v7LpNRqp8UVLC0NuMxUIRQmnj3pK9LvM26JN6A Jul 20 20:07:54.787289 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 20:07:54.787289 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 20:07:54.787289 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 20:07:54.787289 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 20:07:54.787289 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 20:07:54.787289 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 20:07:54.787289 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: d0ab510f529d4442bd0e379056c4c3e5 Jul 20 20:07:54.787289 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-AttachVolumeTestJSON-1160958235 Jul 20 20:07:54.787289 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 20:07:54.787289 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 20:07:54.789554 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d0ab510f529d4442bd0e379056c4c3e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d0ab510f529d4442bd0e379056c4c3e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_d0ab510f529d4442bd0e379056c4c3e5", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/d0ab510f529d4442bd0e379056c4c3e5"}]}] Jul 20 20:07:54.789554 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-AttachVolumeTestJSON-1160958235 Jul 20 20:07:54.789554 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: d0ab510f529d4442bd0e379056c4c3e5 Jul 20 20:07:54.789554 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1160958235 Jul 20 20:07:54.789554 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-AttachVolumeTestJSON-1160958235-project Jul 20 20:07:54.789554 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 20:07:54.789554 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 20:07:54.789554 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: 4d08da0ef69e4cf2abc6c18bbbc51a2f Jul 20 20:07:54.789554 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-AttachVolumeTestJSON-1160958235-project Jul 20 20:07:54.789554 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: > Jul 20 20:07:54.789554 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Instance 6d8b0dac-fc05-4fc6-a99a-f17dc41b961e could not be found. Jul 20 20:07:54.789554 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'id': '6d8b0dac-fc05-4fc6-a99a-f17dc41b961e'} Jul 20 20:07:54.790624 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 20:07:54.790624 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:07:54.790624 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 20:07:54.790624 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 20:07:54.790624 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 20:07:54.790624 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 20:07:54.790624 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 20:07:54.790624 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 20:07:54.790624 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 20:07:54.790624 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 20:07:54.790624 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d8b0dac-fc05-4fc6-a99a-f17dc41b961e could not be found. Jul 20 20:07:54.790624 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:07:54.790624 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:07:54.790624 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:07:54.790624 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:07:54.790624 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:07:54.790624 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:07:54.790624 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 20:07:54.790624 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 20:07:54.790624 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 20:07:54.795545 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 20:07:54.795545 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 20:07:54.795545 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 20:07:54.795545 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 20:07:54.795545 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 20:07:54.795545 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 20:07:54.795545 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 20:07:54.795545 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 20:07:54.795545 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 20:07:54.795545 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d8b0dac-fc05-4fc6-a99a-f17dc41b961e could not be found. Jul 20 20:07:54.795545 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:07:54.795545 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:07:54.795545 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:07:54.795545 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:07:54.795545 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:07:54.795545 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:07:54.795545 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 20:07:54.795545 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 20:07:54.795545 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d8b0dac-fc05-4fc6-a99a-f17dc41b961e could not be found. Jul 20 20:07:54.795545 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:07:54.797243 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-eb73acfa-66be-42dd-9817-c44659395c07 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Returning 404 to user: Instance 6d8b0dac-fc05-4fc6-a99a-f17dc41b961e could not be found. {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 20:07:54.797243 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-eb73acfa-66be-42dd-9817-c44659395c07 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "DELETE /compute/v2.1/servers/6d8b0dac-fc05-4fc6-a99a-f17dc41b961e" status: 404 len: 111 microversion: 2.1 time: 0.036324 Jul 20 20:07:54.797243 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1870/2501] 10.222.0.69 () {58 vars in 1238 bytes} [Wed Jul 20 20:07:54 2022] DELETE /compute/v2.1/servers/6d8b0dac-fc05-4fc6-a99a-f17dc41b961e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 20:07:54.802170 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c50e3768-070f-4d1a-a1f1-185c5265a3ca tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:54.804008 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c50e3768-070f-4d1a-a1f1-185c5265a3ca tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: 6d8b0dac-fc05-4fc6-a99a-f17dc41b961e] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:54.811660 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c50e3768-070f-4d1a-a1f1-185c5265a3ca tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:54.812346 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c50e3768-070f-4d1a-a1f1-185c5265a3ca tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:54.813210 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c50e3768-070f-4d1a-a1f1-185c5265a3ca tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:54.813748 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c50e3768-070f-4d1a-a1f1-185c5265a3ca tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:54.818421 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 20:07:54.830976 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.wsgi [None req-c50e3768-070f-4d1a-a1f1-185c5265a3ca tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] HTTP exception thrown: Instance 6d8b0dac-fc05-4fc6-a99a-f17dc41b961e could not be found. Jul 20 20:07:54.832829 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c50e3768-070f-4d1a-a1f1-185c5265a3ca tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Request method failure captured: Jul 20 20:07:54.832829 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: GET /compute/v2.1/servers/6d8b0dac-fc05-4fc6-a99a-f17dc41b961e HTTP/1.1 Jul 20 20:07:54.832829 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 20:07:54.832829 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 20:07:54.832829 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 20:07:54.832829 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 0 Jul 20 20:07:54.832829 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 20:07:54.832829 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 20:07:54.832829 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 20:07:54.832829 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 20:07:54.832829 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2FZGo6-HVFVhR6OjPhJxZ1gh94do_O6d8P7kPPvbPDILEmBb1jM0xfV5m7JhTQt5sdz1iJC9fqY_tpPN-uIZZ_wcPYLmcsGaNA7u_2CgAPkrxbvTi4CqkH4xaTggAZoiITrtn1JA6v7LpNRqp8UVLC0NuMxUIRQmnj3pK9LvM26JN6A Jul 20 20:07:54.832829 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 20:07:54.832829 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 20:07:54.832829 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 20:07:54.832829 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 20:07:54.832829 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 20:07:54.832829 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 20:07:54.832829 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: d0ab510f529d4442bd0e379056c4c3e5 Jul 20 20:07:54.832829 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-AttachVolumeTestJSON-1160958235 Jul 20 20:07:54.832829 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 20:07:54.832829 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 20:07:54.834974 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d0ab510f529d4442bd0e379056c4c3e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d0ab510f529d4442bd0e379056c4c3e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_d0ab510f529d4442bd0e379056c4c3e5", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/d0ab510f529d4442bd0e379056c4c3e5"}]}] Jul 20 20:07:54.834974 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-AttachVolumeTestJSON-1160958235 Jul 20 20:07:54.834974 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: d0ab510f529d4442bd0e379056c4c3e5 Jul 20 20:07:54.834974 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1160958235 Jul 20 20:07:54.834974 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-AttachVolumeTestJSON-1160958235-project Jul 20 20:07:54.834974 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 20:07:54.834974 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 20:07:54.834974 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: 4d08da0ef69e4cf2abc6c18bbbc51a2f Jul 20 20:07:54.834974 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-AttachVolumeTestJSON-1160958235-project Jul 20 20:07:54.834974 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: > Jul 20 20:07:54.834974 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Instance 6d8b0dac-fc05-4fc6-a99a-f17dc41b961e could not be found. Jul 20 20:07:54.834974 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'id': '6d8b0dac-fc05-4fc6-a99a-f17dc41b961e'} Jul 20 20:07:54.836158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 20:07:54.836158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:07:54.836158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 20:07:54.836158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 20:07:54.836158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 20:07:54.836158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 20:07:54.836158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 20:07:54.836158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 20:07:54.836158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 20:07:54.836158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 20:07:54.836158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d8b0dac-fc05-4fc6-a99a-f17dc41b961e could not be found. Jul 20 20:07:54.836158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:07:54.836158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:07:54.836158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:07:54.836158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:07:54.836158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:07:54.836158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:07:54.836158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 20:07:54.836158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 20:07:54.836158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 20:07:54.837886 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 20:07:54.837886 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 20:07:54.837886 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 20:07:54.837886 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 20:07:54.837886 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 20:07:54.837886 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 20:07:54.837886 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 20:07:54.837886 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d8b0dac-fc05-4fc6-a99a-f17dc41b961e could not be found. Jul 20 20:07:54.837886 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:07:54.837886 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:07:54.837886 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:07:54.837886 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:07:54.837886 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:07:54.837886 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:07:54.837886 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 20:07:54.837886 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 20:07:54.837886 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d8b0dac-fc05-4fc6-a99a-f17dc41b961e could not be found. Jul 20 20:07:54.837886 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:07:54.839396 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c50e3768-070f-4d1a-a1f1-185c5265a3ca tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Returning 404 to user: Instance 6d8b0dac-fc05-4fc6-a99a-f17dc41b961e could not be found. {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 20:07:54.839396 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c50e3768-070f-4d1a-a1f1-185c5265a3ca tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/6d8b0dac-fc05-4fc6-a99a-f17dc41b961e" status: 404 len: 111 microversion: 2.1 time: 0.040907 Jul 20 20:07:54.839599 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1871/2502] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:07:54 2022] GET /compute/v2.1/servers/6d8b0dac-fc05-4fc6-a99a-f17dc41b961e => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 20:07:54.968826 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-8a018c31-8819-4ddb-aaf5-376832c70a6e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:54.970190 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-8a018c31-8819-4ddb-aaf5-376832c70a6e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:54.977622 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8a018c31-8819-4ddb-aaf5-376832c70a6e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:54.978376 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8a018c31-8819-4ddb-aaf5-376832c70a6e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:54.979482 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8a018c31-8819-4ddb-aaf5-376832c70a6e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:54.980237 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8a018c31-8819-4ddb-aaf5-376832c70a6e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:55.135960 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8a018c31-8819-4ddb-aaf5-376832c70a6e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:55.146691 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8a018c31-8819-4ddb-aaf5-376832c70a6e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:55.149432 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8a018c31-8819-4ddb-aaf5-376832c70a6e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:55.150903 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-8a018c31-8819-4ddb-aaf5-376832c70a6e tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1739 microversion: 2.20 time: 0.186550 Jul 20 20:07:55.151456 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1872/2503] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:07:54 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1739 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 20:07:56.021304 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-f9c43bcf-85b1-458c-981c-2ee6352a48d4 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:56.022156 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-f9c43bcf-85b1-458c-981c-2ee6352a48d4 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:56.029099 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f9c43bcf-85b1-458c-981c-2ee6352a48d4 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:56.029572 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f9c43bcf-85b1-458c-981c-2ee6352a48d4 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:56.030329 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f9c43bcf-85b1-458c-981c-2ee6352a48d4 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:56.030759 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f9c43bcf-85b1-458c-981c-2ee6352a48d4 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:56.043686 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.wsgi [None req-f9c43bcf-85b1-458c-981c-2ee6352a48d4 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] HTTP exception thrown: Instance c33037ed-7b36-43aa-85ad-e48920801b0a could not be found. Jul 20 20:07:56.045237 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-f9c43bcf-85b1-458c-981c-2ee6352a48d4 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Request method failure captured: Jul 20 20:07:56.045237 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: DELETE /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a HTTP/1.1 Jul 20 20:07:56.045237 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 20:07:56.045237 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 20:07:56.045237 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 20:07:56.045237 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 0 Jul 20 20:07:56.045237 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 20:07:56.045237 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 20:07:56.045237 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 20:07:56.045237 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 20:07:56.045237 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2FZGo6-HVFVhR6OjPhJxZ1gh94do_O6d8P7kPPvbPDILEmBb1jM0xfV5m7JhTQt5sdz1iJC9fqY_tpPN-uIZZ_wcPYLmcsGaNA7u_2CgAPkrxbvTi4CqkH4xaTggAZoiITrtn1JA6v7LpNRqp8UVLC0NuMxUIRQmnj3pK9LvM26JN6A Jul 20 20:07:56.045237 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 20:07:56.045237 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 20:07:56.045237 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 20:07:56.045237 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 20:07:56.045237 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 20:07:56.045237 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 20:07:56.045237 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: d0ab510f529d4442bd0e379056c4c3e5 Jul 20 20:07:56.045237 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-AttachVolumeTestJSON-1160958235 Jul 20 20:07:56.045237 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 20:07:56.045237 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 20:07:56.047015 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d0ab510f529d4442bd0e379056c4c3e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d0ab510f529d4442bd0e379056c4c3e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_d0ab510f529d4442bd0e379056c4c3e5", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/d0ab510f529d4442bd0e379056c4c3e5"}]}] Jul 20 20:07:56.047015 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-AttachVolumeTestJSON-1160958235 Jul 20 20:07:56.047015 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: d0ab510f529d4442bd0e379056c4c3e5 Jul 20 20:07:56.047015 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1160958235 Jul 20 20:07:56.047015 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-AttachVolumeTestJSON-1160958235-project Jul 20 20:07:56.047015 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 20:07:56.047015 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 20:07:56.047015 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: 4d08da0ef69e4cf2abc6c18bbbc51a2f Jul 20 20:07:56.047015 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-AttachVolumeTestJSON-1160958235-project Jul 20 20:07:56.047015 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: > Jul 20 20:07:56.047015 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Instance c33037ed-7b36-43aa-85ad-e48920801b0a could not be found. Jul 20 20:07:56.047015 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'id': 'c33037ed-7b36-43aa-85ad-e48920801b0a'} Jul 20 20:07:56.048175 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 20:07:56.048175 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:07:56.048175 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 20:07:56.048175 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 20:07:56.048175 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 20:07:56.048175 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 20:07:56.048175 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 20:07:56.048175 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 20:07:56.048175 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 20:07:56.048175 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 20:07:56.048175 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c33037ed-7b36-43aa-85ad-e48920801b0a could not be found. Jul 20 20:07:56.048175 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:07:56.048175 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:07:56.048175 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:07:56.048175 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:07:56.048175 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:07:56.048175 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:07:56.048175 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 20:07:56.048175 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 20:07:56.048175 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 20:07:56.050227 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 20:07:56.050227 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 20:07:56.050227 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 20:07:56.050227 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 20:07:56.050227 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 20:07:56.050227 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 20:07:56.050227 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 20:07:56.050227 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 20:07:56.050227 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 20:07:56.050227 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c33037ed-7b36-43aa-85ad-e48920801b0a could not be found. Jul 20 20:07:56.050227 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:07:56.050227 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:07:56.050227 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:07:56.050227 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:07:56.050227 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:07:56.050227 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:07:56.050227 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 20:07:56.050227 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 20:07:56.050227 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c33037ed-7b36-43aa-85ad-e48920801b0a could not be found. Jul 20 20:07:56.050227 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:07:56.052126 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-f9c43bcf-85b1-458c-981c-2ee6352a48d4 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Returning 404 to user: Instance c33037ed-7b36-43aa-85ad-e48920801b0a could not be found. {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 20:07:56.052126 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-f9c43bcf-85b1-458c-981c-2ee6352a48d4 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "DELETE /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a" status: 404 len: 111 microversion: 2.1 time: 0.029130 Jul 20 20:07:56.052126 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1873/2504] 10.222.0.69 () {58 vars in 1238 bytes} [Wed Jul 20 20:07:56 2022] DELETE /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 20:07:56.054977 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-92c592f7-8c21-4a20-827c-d89bf64e6203 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:56.055663 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-92c592f7-8c21-4a20-827c-d89bf64e6203 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] [instance: c33037ed-7b36-43aa-85ad-e48920801b0a] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:56.064449 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-92c592f7-8c21-4a20-827c-d89bf64e6203 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:56.065146 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-92c592f7-8c21-4a20-827c-d89bf64e6203 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:56.065877 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-92c592f7-8c21-4a20-827c-d89bf64e6203 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:56.066314 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-92c592f7-8c21-4a20-827c-d89bf64e6203 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:56.086528 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.wsgi [None req-92c592f7-8c21-4a20-827c-d89bf64e6203 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] HTTP exception thrown: Instance c33037ed-7b36-43aa-85ad-e48920801b0a could not be found. Jul 20 20:07:56.088110 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-92c592f7-8c21-4a20-827c-d89bf64e6203 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Request method failure captured: Jul 20 20:07:56.088110 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a HTTP/1.1 Jul 20 20:07:56.088110 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 20:07:56.088110 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 20:07:56.088110 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 20:07:56.088110 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 0 Jul 20 20:07:56.088110 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 20:07:56.088110 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 20:07:56.088110 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 20:07:56.088110 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 20:07:56.088110 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2FZGo6-HVFVhR6OjPhJxZ1gh94do_O6d8P7kPPvbPDILEmBb1jM0xfV5m7JhTQt5sdz1iJC9fqY_tpPN-uIZZ_wcPYLmcsGaNA7u_2CgAPkrxbvTi4CqkH4xaTggAZoiITrtn1JA6v7LpNRqp8UVLC0NuMxUIRQmnj3pK9LvM26JN6A Jul 20 20:07:56.088110 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 20:07:56.088110 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 20:07:56.088110 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 20:07:56.088110 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 20:07:56.088110 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 20:07:56.088110 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 20:07:56.088110 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: d0ab510f529d4442bd0e379056c4c3e5 Jul 20 20:07:56.088110 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-AttachVolumeTestJSON-1160958235 Jul 20 20:07:56.088110 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 20:07:56.088110 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 20:07:56.090266 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d0ab510f529d4442bd0e379056c4c3e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d0ab510f529d4442bd0e379056c4c3e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_d0ab510f529d4442bd0e379056c4c3e5", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/d0ab510f529d4442bd0e379056c4c3e5"}]}] Jul 20 20:07:56.090266 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-AttachVolumeTestJSON-1160958235 Jul 20 20:07:56.090266 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: d0ab510f529d4442bd0e379056c4c3e5 Jul 20 20:07:56.090266 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1160958235 Jul 20 20:07:56.090266 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-AttachVolumeTestJSON-1160958235-project Jul 20 20:07:56.090266 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 20:07:56.090266 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 20:07:56.090266 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: 4d08da0ef69e4cf2abc6c18bbbc51a2f Jul 20 20:07:56.090266 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-AttachVolumeTestJSON-1160958235-project Jul 20 20:07:56.090266 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: > Jul 20 20:07:56.090266 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Instance c33037ed-7b36-43aa-85ad-e48920801b0a could not be found. Jul 20 20:07:56.090266 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'id': 'c33037ed-7b36-43aa-85ad-e48920801b0a'} Jul 20 20:07:56.091296 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 20:07:56.091296 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:07:56.091296 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 20:07:56.091296 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 20:07:56.091296 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 20:07:56.091296 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 20:07:56.091296 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 20:07:56.091296 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 20:07:56.091296 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 20:07:56.091296 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 20:07:56.091296 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c33037ed-7b36-43aa-85ad-e48920801b0a could not be found. Jul 20 20:07:56.091296 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:07:56.091296 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:07:56.091296 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:07:56.091296 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:07:56.091296 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:07:56.091296 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:07:56.091296 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 20:07:56.091296 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 20:07:56.091296 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 20:07:56.092696 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 20:07:56.092696 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 20:07:56.092696 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 20:07:56.092696 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 20:07:56.092696 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 20:07:56.092696 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 20:07:56.092696 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 20:07:56.092696 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c33037ed-7b36-43aa-85ad-e48920801b0a could not be found. Jul 20 20:07:56.092696 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:07:56.092696 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:07:56.092696 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:07:56.092696 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:07:56.092696 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:07:56.092696 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:07:56.092696 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 20:07:56.092696 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 20:07:56.092696 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c33037ed-7b36-43aa-85ad-e48920801b0a could not be found. Jul 20 20:07:56.092696 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:07:56.094310 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-92c592f7-8c21-4a20-827c-d89bf64e6203 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] Returning 404 to user: Instance c33037ed-7b36-43aa-85ad-e48920801b0a could not be found. {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 20:07:56.094310 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-92c592f7-8c21-4a20-827c-d89bf64e6203 tempest-AttachVolumeTestJSON-1160958235 tempest-AttachVolumeTestJSON-1160958235-project] 10.222.0.69 "GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a" status: 404 len: 111 microversion: 2.1 time: 0.038181 Jul 20 20:07:56.094310 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1874/2505] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:07:56 2022] GET /compute/v2.1/servers/c33037ed-7b36-43aa-85ad-e48920801b0a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 20:07:56.170182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-fe5430a2-370a-4128-a3e9-98458836c527 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:56.171182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-fe5430a2-370a-4128-a3e9-98458836c527 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:56.177625 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fe5430a2-370a-4128-a3e9-98458836c527 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:56.178081 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fe5430a2-370a-4128-a3e9-98458836c527 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:56.179156 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fe5430a2-370a-4128-a3e9-98458836c527 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:56.179788 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fe5430a2-370a-4128-a3e9-98458836c527 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:56.429773 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-fe5430a2-370a-4128-a3e9-98458836c527 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:56.451551 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-fe5430a2-370a-4128-a3e9-98458836c527 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:56.454018 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-fe5430a2-370a-4128-a3e9-98458836c527 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:56.455775 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-fe5430a2-370a-4128-a3e9-98458836c527 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1739 microversion: 2.20 time: 0.290603 Jul 20 20:07:56.466080 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1875/2506] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:07:56 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1739 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 20:07:57.489241 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d2fe2633-b2a0-4152-8618-dc1e0d835e1b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:57.489968 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d2fe2633-b2a0-4152-8618-dc1e0d835e1b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:57.512745 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d2fe2633-b2a0-4152-8618-dc1e0d835e1b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:57.513659 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d2fe2633-b2a0-4152-8618-dc1e0d835e1b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:57.515123 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d2fe2633-b2a0-4152-8618-dc1e0d835e1b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:57.515741 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d2fe2633-b2a0-4152-8618-dc1e0d835e1b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:57.772021 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d2fe2633-b2a0-4152-8618-dc1e0d835e1b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:57.781853 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d2fe2633-b2a0-4152-8618-dc1e0d835e1b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:57.788334 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d2fe2633-b2a0-4152-8618-dc1e0d835e1b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:57.789715 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d2fe2633-b2a0-4152-8618-dc1e0d835e1b tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1739 microversion: 2.20 time: 0.305577 Jul 20 20:07:57.800236 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1876/2507] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:07:57 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1739 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 20:07:58.808371 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-6e6c0cfd-6f94-48fa-a272-d3c212cf86ae tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:07:58.809863 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-6e6c0cfd-6f94-48fa-a272-d3c212cf86ae tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:07:58.819523 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6e6c0cfd-6f94-48fa-a272-d3c212cf86ae tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:58.822270 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6e6c0cfd-6f94-48fa-a272-d3c212cf86ae tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:58.823313 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6e6c0cfd-6f94-48fa-a272-d3c212cf86ae tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:07:58.823946 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6e6c0cfd-6f94-48fa-a272-d3c212cf86ae tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:07:59.028284 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6e6c0cfd-6f94-48fa-a272-d3c212cf86ae tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:59.054405 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6e6c0cfd-6f94-48fa-a272-d3c212cf86ae tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:59.056186 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6e6c0cfd-6f94-48fa-a272-d3c212cf86ae tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:07:59.060115 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-6e6c0cfd-6f94-48fa-a272-d3c212cf86ae tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1739 microversion: 2.20 time: 0.255517 Jul 20 20:07:59.068791 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1877/2508] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:07:58 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1739 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 20:08:00.078136 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ed755bff-50da-4a57-b139-aa727cc0fc83 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:08:00.078829 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ed755bff-50da-4a57-b139-aa727cc0fc83 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:08:00.090197 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ed755bff-50da-4a57-b139-aa727cc0fc83 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:00.091029 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ed755bff-50da-4a57-b139-aa727cc0fc83 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:00.092196 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ed755bff-50da-4a57-b139-aa727cc0fc83 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:00.092841 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ed755bff-50da-4a57-b139-aa727cc0fc83 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:00.258851 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ed755bff-50da-4a57-b139-aa727cc0fc83 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:00.273642 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ed755bff-50da-4a57-b139-aa727cc0fc83 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:00.276305 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ed755bff-50da-4a57-b139-aa727cc0fc83 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:00.277794 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ed755bff-50da-4a57-b139-aa727cc0fc83 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1739 microversion: 2.20 time: 0.203471 Jul 20 20:08:00.278549 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1878/2509] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:08:00 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1739 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 20:08:01.424215 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-22ccd38a-05f1-438c-8d94-49176702a837 tempest-VolumesNegativeTest-716029449 tempest-VolumesNegativeTest-716029449-project] Action: 'create', calling method: .version_select at 0x7ff60a232ca0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1872125869", "metadata": {"Type": "work"}}} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 20:08:01.447574 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-22ccd38a-05f1-438c-8d94-49176702a837 tempest-VolumesNegativeTest-716029449 tempest-VolumesNegativeTest-716029449-project] Request method failure captured: Jul 20 20:08:01.447574 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 20 20:08:01.447574 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 20:08:01.447574 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 20:08:01.447574 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 20:08:01.447574 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 122 Jul 20 20:08:01.447574 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 20:08:01.447574 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 20:08:01.447574 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 20:08:01.447574 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 20:08:01.447574 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2GChSGQYXMPR1EMr5YTy1TMmmoFtZreIjP4pqj8Y4fAN0QeA3Q-dBO7z2urfWOuiCmx6FmfC5t6ze33Xx35JEUfgHM-eCQzcZwZRYh1aHJMaJRhH5lkEuP_tGRSNJMqc3Os4TlceoLcawKRiav_AndZJWNHUApcywMxrg_7tOiWsjAE Jul 20 20:08:01.447574 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 20:08:01.447574 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 20:08:01.447574 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 20:08:01.447574 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 20:08:01.447574 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 20:08:01.447574 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 20:08:01.447574 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: 6e2ed32e0b2745ceb5e6a01bb21b3ac6 Jul 20 20:08:01.447574 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-VolumesNegativeTest-716029449 Jul 20 20:08:01.447574 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 20:08:01.447574 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 20:08:01.449828 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/6e2ed32e0b2745ceb5e6a01bb21b3ac6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/6e2ed32e0b2745ceb5e6a01bb21b3ac6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_6e2ed32e0b2745ceb5e6a01bb21b3ac6", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/6e2ed32e0b2745ceb5e6a01bb21b3ac6"}]}] Jul 20 20:08:01.449828 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-VolumesNegativeTest-716029449 Jul 20 20:08:01.449828 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: 6e2ed32e0b2745ceb5e6a01bb21b3ac6 Jul 20 20:08:01.449828 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-VolumesNegativeTest-716029449 Jul 20 20:08:01.449828 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-VolumesNegativeTest-716029449-project Jul 20 20:08:01.449828 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 20:08:01.449828 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 20:08:01.449828 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: 9cda52391eb44481811d8578ef7b13a8 Jul 20 20:08:01.449828 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-VolumesNegativeTest-716029449-project Jul 20 20:08:01.449828 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Jul 20 20:08:01.449828 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1872125869", "metadata": {"Type": "work"}}} Jul 20 20:08:01.449828 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: Jul 20 20:08:01.449828 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 20 20:08:01.451016 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1872125869', 'metadata': {'Type': 'work'}}}} Jul 20 20:08:01.451016 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 20:08:01.451016 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:08:01.451016 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 20:08:01.451016 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 20:08:01.451016 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 20:08:01.451016 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise error Jul 20 20:08:01.451016 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 20 20:08:01.451016 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:08:01.451016 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 20 20:08:01.451016 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 20 20:08:01.451016 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:08:01.451016 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 20 20:08:01.451016 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi '#$%' Jul 20 20:08:01.451016 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:08:01.451016 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:08:01.451016 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:08:01.451016 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:08:01.451016 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:08:01.451016 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:08:01.451016 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 20:08:01.451016 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 20:08:01.454014 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 20:08:01.454014 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 20:08:01.454014 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 20:08:01.454014 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 20:08:01.454014 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 20:08:01.454014 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 20:08:01.454014 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 20:08:01.454014 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 20:08:01.454014 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 20:08:01.454014 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 20:08:01.454014 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 20 20:08:01.454014 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:08:01.454014 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:08:01.454014 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:08:01.454014 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:08:01.454014 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:08:01.454014 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:08:01.454014 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 20:08:01.454014 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 20:08:01.456757 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 20 20:08:01.456757 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:08:01.458724 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-22ccd38a-05f1-438c-8d94-49176702a837 tempest-VolumesNegativeTest-716029449 tempest-VolumesNegativeTest-716029449-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 20:08:01.465066 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-22ccd38a-05f1-438c-8d94-49176702a837 tempest-VolumesNegativeTest-716029449 tempest-VolumesNegativeTest-716029449-project] 10.222.0.69 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.197255 Jul 20 20:08:01.466129 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1879/2510] 10.222.0.69 () {60 vars in 1155 bytes} [Wed Jul 20 20:08:01 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 199 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 20 20:08:01.476868 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ea0846ae-baaa-488f-9139-d35b43b56f36 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:08:01.482353 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ea0846ae-baaa-488f-9139-d35b43b56f36 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:08:01.492575 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ea0846ae-baaa-488f-9139-d35b43b56f36 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:01.493386 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ea0846ae-baaa-488f-9139-d35b43b56f36 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:01.496832 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ea0846ae-baaa-488f-9139-d35b43b56f36 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:01.497299 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ea0846ae-baaa-488f-9139-d35b43b56f36 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:01.654155 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ea0846ae-baaa-488f-9139-d35b43b56f36 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:01.664347 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ea0846ae-baaa-488f-9139-d35b43b56f36 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:01.665879 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ea0846ae-baaa-488f-9139-d35b43b56f36 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:01.667497 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ea0846ae-baaa-488f-9139-d35b43b56f36 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1739 microversion: 2.20 time: 0.199775 Jul 20 20:08:01.668367 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1880/2511] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:08:01 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1739 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 20:08:01.672740 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-5b7bd23a-bca4-4a2a-9653-6714765b360c tempest-VolumesNegativeTest-716029449 tempest-VolumesNegativeTest-716029449-project] Action: 'create', calling method: .version_select at 0x7ff60e9650d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1734794427", "metadata": {"Type": "work"}}} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 20:08:01.675242 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-5b7bd23a-bca4-4a2a-9653-6714765b360c tempest-VolumesNegativeTest-716029449 tempest-VolumesNegativeTest-716029449-project] Request method failure captured: Jul 20 20:08:01.675242 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 20 20:08:01.675242 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 20:08:01.675242 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 20:08:01.675242 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 20:08:01.675242 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 120 Jul 20 20:08:01.675242 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 20:08:01.675242 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 20:08:01.675242 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 20:08:01.675242 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 20:08:01.675242 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2GChSGQYXMPR1EMr5YTy1TMmmoFtZreIjP4pqj8Y4fAN0QeA3Q-dBO7z2urfWOuiCmx6FmfC5t6ze33Xx35JEUfgHM-eCQzcZwZRYh1aHJMaJRhH5lkEuP_tGRSNJMqc3Os4TlceoLcawKRiav_AndZJWNHUApcywMxrg_7tOiWsjAE Jul 20 20:08:01.675242 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 20:08:01.675242 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 20:08:01.675242 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 20:08:01.675242 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 20:08:01.675242 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 20:08:01.675242 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 20:08:01.675242 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: 6e2ed32e0b2745ceb5e6a01bb21b3ac6 Jul 20 20:08:01.675242 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-VolumesNegativeTest-716029449 Jul 20 20:08:01.675242 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 20:08:01.675242 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 20:08:01.677138 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/6e2ed32e0b2745ceb5e6a01bb21b3ac6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/6e2ed32e0b2745ceb5e6a01bb21b3ac6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_6e2ed32e0b2745ceb5e6a01bb21b3ac6", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/6e2ed32e0b2745ceb5e6a01bb21b3ac6"}]}] Jul 20 20:08:01.677138 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-VolumesNegativeTest-716029449 Jul 20 20:08:01.677138 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: 6e2ed32e0b2745ceb5e6a01bb21b3ac6 Jul 20 20:08:01.677138 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-VolumesNegativeTest-716029449 Jul 20 20:08:01.677138 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-VolumesNegativeTest-716029449-project Jul 20 20:08:01.677138 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 20:08:01.677138 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 20:08:01.677138 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: 9cda52391eb44481811d8578ef7b13a8 Jul 20 20:08:01.677138 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-VolumesNegativeTest-716029449-project Jul 20 20:08:01.677138 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Jul 20 20:08:01.677138 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1734794427", "metadata": {"Type": "work"}}} Jul 20 20:08:01.677138 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: Jul 20 20:08:01.677138 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 20 20:08:01.678377 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1734794427', 'metadata': {'Type': 'work'}}}} Jul 20 20:08:01.678377 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 20:08:01.678377 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:08:01.678377 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 20:08:01.678377 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 20:08:01.678377 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 20:08:01.678377 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise error Jul 20 20:08:01.678377 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 20 20:08:01.678377 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:08:01.678377 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 20 20:08:01.678377 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 20 20:08:01.678377 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:08:01.678377 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 20 20:08:01.678377 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi '0' Jul 20 20:08:01.678377 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:08:01.678377 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:08:01.678377 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:08:01.678377 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:08:01.678377 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:08:01.678377 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:08:01.678377 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 20:08:01.678377 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 20:08:01.680921 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 20:08:01.680921 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 20:08:01.680921 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 20:08:01.680921 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 20:08:01.680921 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 20:08:01.680921 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 20:08:01.680921 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 20:08:01.680921 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 20:08:01.680921 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 20:08:01.680921 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 20:08:01.680921 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 20 20:08:01.680921 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:08:01.680921 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:08:01.680921 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:08:01.680921 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:08:01.680921 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:08:01.680921 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:08:01.680921 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 20:08:01.680921 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 20:08:01.682556 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 20 20:08:01.682556 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:08:01.682556 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-5b7bd23a-bca4-4a2a-9653-6714765b360c tempest-VolumesNegativeTest-716029449 tempest-VolumesNegativeTest-716029449-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 20:08:01.682556 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-5b7bd23a-bca4-4a2a-9653-6714765b360c tempest-VolumesNegativeTest-716029449 tempest-VolumesNegativeTest-716029449-project] 10.222.0.69 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.007221 Jul 20 20:08:01.683377 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1881/2512] 10.222.0.69 () {60 vars in 1155 bytes} [Wed Jul 20 20:08:01 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 20:08:01.688337 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d2225574-be63-4513-8ea4-e90ee9bbb0db tempest-VolumesNegativeTest-716029449 tempest-VolumesNegativeTest-716029449-project] Action: 'create', calling method: .version_select at 0x7ff60e936e50>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-504697976", "metadata": {"Type": "work"}}} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 20:08:01.691295 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d2225574-be63-4513-8ea4-e90ee9bbb0db tempest-VolumesNegativeTest-716029449 tempest-VolumesNegativeTest-716029449-project] Request method failure captured: Jul 20 20:08:01.691295 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 20 20:08:01.691295 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 20:08:01.691295 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 20:08:01.691295 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 20:08:01.691295 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 118 Jul 20 20:08:01.691295 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 20:08:01.691295 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 20:08:01.691295 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 20:08:01.691295 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 20:08:01.691295 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2GChSGQYXMPR1EMr5YTy1TMmmoFtZreIjP4pqj8Y4fAN0QeA3Q-dBO7z2urfWOuiCmx6FmfC5t6ze33Xx35JEUfgHM-eCQzcZwZRYh1aHJMaJRhH5lkEuP_tGRSNJMqc3Os4TlceoLcawKRiav_AndZJWNHUApcywMxrg_7tOiWsjAE Jul 20 20:08:01.691295 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 20:08:01.691295 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 20:08:01.691295 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 20:08:01.691295 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 20:08:01.691295 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 20:08:01.691295 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 20:08:01.691295 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: 6e2ed32e0b2745ceb5e6a01bb21b3ac6 Jul 20 20:08:01.691295 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-VolumesNegativeTest-716029449 Jul 20 20:08:01.691295 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 20:08:01.691295 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 20:08:01.693217 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/6e2ed32e0b2745ceb5e6a01bb21b3ac6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/6e2ed32e0b2745ceb5e6a01bb21b3ac6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_6e2ed32e0b2745ceb5e6a01bb21b3ac6", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/6e2ed32e0b2745ceb5e6a01bb21b3ac6"}]}] Jul 20 20:08:01.693217 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-VolumesNegativeTest-716029449 Jul 20 20:08:01.693217 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: 6e2ed32e0b2745ceb5e6a01bb21b3ac6 Jul 20 20:08:01.693217 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-VolumesNegativeTest-716029449 Jul 20 20:08:01.693217 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-VolumesNegativeTest-716029449-project Jul 20 20:08:01.693217 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 20:08:01.693217 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 20:08:01.693217 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: 9cda52391eb44481811d8578ef7b13a8 Jul 20 20:08:01.693217 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-VolumesNegativeTest-716029449-project Jul 20 20:08:01.693217 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Jul 20 20:08:01.693217 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-504697976", "metadata": {"Type": "work"}}} Jul 20 20:08:01.693217 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: Jul 20 20:08:01.693217 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 20 20:08:01.694697 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-504697976', 'metadata': {'Type': 'work'}}}} Jul 20 20:08:01.694697 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 20:08:01.694697 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:08:01.694697 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 20:08:01.694697 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 20:08:01.694697 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 20:08:01.694697 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise error Jul 20 20:08:01.694697 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 20 20:08:01.694697 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:08:01.694697 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 20 20:08:01.694697 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 20 20:08:01.694697 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:08:01.694697 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 20 20:08:01.694697 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi '' Jul 20 20:08:01.694697 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:08:01.694697 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:08:01.694697 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:08:01.694697 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:08:01.694697 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:08:01.694697 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:08:01.694697 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 20:08:01.694697 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 20:08:01.696919 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 20:08:01.696919 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 20:08:01.696919 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 20:08:01.696919 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 20:08:01.696919 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 20:08:01.696919 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 20:08:01.696919 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 20:08:01.696919 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 20:08:01.696919 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 20:08:01.696919 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 20:08:01.696919 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 20 20:08:01.696919 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:08:01.696919 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:08:01.696919 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:08:01.696919 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:08:01.696919 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:08:01.696919 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:08:01.696919 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 20:08:01.696919 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 20:08:01.698576 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 20 20:08:01.698576 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:08:01.698576 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d2225574-be63-4513-8ea4-e90ee9bbb0db tempest-VolumesNegativeTest-716029449 tempest-VolumesNegativeTest-716029449-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 20:08:01.698576 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d2225574-be63-4513-8ea4-e90ee9bbb0db tempest-VolumesNegativeTest-716029449 tempest-VolumesNegativeTest-716029449-project] 10.222.0.69 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008206 Jul 20 20:08:01.699907 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1882/2513] 10.222.0.69 () {60 vars in 1155 bytes} [Wed Jul 20 20:08:01 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 20:08:01.706138 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-caaf9c92-540a-41c4-be0f-b89f996fc5f4 tempest-VolumesNegativeTest-716029449 tempest-VolumesNegativeTest-716029449-project] Calling method '.version_select at 0x7ff60e97a3a0>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:08:01.741153 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.wsgi [None req-caaf9c92-540a-41c4-be0f-b89f996fc5f4 tempest-VolumesNegativeTest-716029449 tempest-VolumesNegativeTest-716029449-project] HTTP exception thrown: Volume tempest-invalid-647100982 could not be found. Jul 20 20:08:01.743148 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-caaf9c92-540a-41c4-be0f-b89f996fc5f4 tempest-VolumesNegativeTest-716029449 tempest-VolumesNegativeTest-716029449-project] Request method failure captured: Jul 20 20:08:01.743148 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-647100982 HTTP/1.1 Jul 20 20:08:01.743148 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 20:08:01.743148 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 20:08:01.743148 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 20:08:01.743148 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 0 Jul 20 20:08:01.743148 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 20:08:01.743148 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 20:08:01.743148 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 20:08:01.743148 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 20:08:01.743148 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2GChSGQYXMPR1EMr5YTy1TMmmoFtZreIjP4pqj8Y4fAN0QeA3Q-dBO7z2urfWOuiCmx6FmfC5t6ze33Xx35JEUfgHM-eCQzcZwZRYh1aHJMaJRhH5lkEuP_tGRSNJMqc3Os4TlceoLcawKRiav_AndZJWNHUApcywMxrg_7tOiWsjAE Jul 20 20:08:01.743148 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 20:08:01.743148 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 20:08:01.743148 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 20:08:01.743148 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 20:08:01.743148 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 20:08:01.743148 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 20:08:01.743148 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: 6e2ed32e0b2745ceb5e6a01bb21b3ac6 Jul 20 20:08:01.743148 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-VolumesNegativeTest-716029449 Jul 20 20:08:01.743148 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 20:08:01.743148 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 20:08:01.744976 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/6e2ed32e0b2745ceb5e6a01bb21b3ac6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/6e2ed32e0b2745ceb5e6a01bb21b3ac6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_6e2ed32e0b2745ceb5e6a01bb21b3ac6", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/6e2ed32e0b2745ceb5e6a01bb21b3ac6"}]}] Jul 20 20:08:01.744976 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-VolumesNegativeTest-716029449 Jul 20 20:08:01.744976 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: 6e2ed32e0b2745ceb5e6a01bb21b3ac6 Jul 20 20:08:01.744976 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-VolumesNegativeTest-716029449 Jul 20 20:08:01.744976 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-VolumesNegativeTest-716029449-project Jul 20 20:08:01.744976 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 20:08:01.744976 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 20:08:01.744976 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: 9cda52391eb44481811d8578ef7b13a8 Jul 20 20:08:01.744976 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-VolumesNegativeTest-716029449-project Jul 20 20:08:01.744976 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: Jul 20 20:08:01.744976 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Volume tempest-invalid-647100982 could not be found. Jul 20 20:08:01.744976 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'id': 'tempest-invalid-647100982'} Jul 20 20:08:01.744976 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 20:08:01.746138 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:08:01.746138 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 20:08:01.746138 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 20:08:01.746138 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 20:08:01.746138 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 20:08:01.746138 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 20:08:01.746138 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 20:08:01.746138 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 20:08:01.746138 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 20:08:01.746138 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 20:08:01.746138 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 20:08:01.746138 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 20:08:01.746138 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 20:08:01.746138 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 20:08:01.746138 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 20:08:01.746138 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-647100982 could not be found. (HTTP 404) (Request-ID: req-499f539b-ae5f-4fc3-b938-b75ed227b699) Jul 20 20:08:01.746138 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:08:01.746138 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:08:01.746138 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:08:01.748169 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:08:01.748169 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 20 20:08:01.748169 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 20 20:08:01.748169 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 20:08:01.748169 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 20:08:01.748169 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 20:08:01.748169 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 20:08:01.748169 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 20:08:01.748169 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 20:08:01.748169 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 20:08:01.748169 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 20:08:01.748169 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 20:08:01.748169 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 20:08:01.748169 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 20:08:01.748169 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 20:08:01.748169 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 20:08:01.748169 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 20:08:01.748169 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 20:08:01.748169 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 20:08:01.749835 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 20:08:01.749835 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 20:08:01.749835 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 20:08:01.749835 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 20:08:01.749835 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-647100982 could not be found. Jul 20 20:08:01.749835 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:08:01.749835 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:08:01.749835 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:08:01.749835 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:08:01.749835 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:08:01.749835 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:08:01.749835 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 20:08:01.749835 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 20:08:01.749835 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 20:08:01.749835 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 20:08:01.749835 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 20:08:01.749835 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 20:08:01.749835 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 20 20:08:01.749835 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 20:08:01.749835 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-647100982 could not be found. Jul 20 20:08:01.751825 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:08:01.751825 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:08:01.751825 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:08:01.751825 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:08:01.751825 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:08:01.751825 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:08:01.751825 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 20:08:01.751825 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 20:08:01.751825 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-647100982 could not be found. Jul 20 20:08:01.751825 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:08:01.751825 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-caaf9c92-540a-41c4-be0f-b89f996fc5f4 tempest-VolumesNegativeTest-716029449 tempest-VolumesNegativeTest-716029449-project] Returning 404 to user: Volume tempest-invalid-647100982 could not be found. {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 20:08:01.751825 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-caaf9c92-540a-41c4-be0f-b89f996fc5f4 tempest-VolumesNegativeTest-716029449 tempest-VolumesNegativeTest-716029449-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/tempest-invalid-647100982" status: 404 len: 98 microversion: 2.1 time: 0.043498 Jul 20 20:08:01.751825 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1883/2514] 10.222.0.69 () {58 vars in 1214 bytes} [Wed Jul 20 20:08:01 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-647100982 => generated 98 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 20:08:01.754519 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-2aa7fbcd-902d-4805-b4b9-f96cc6646263 tempest-VolumesNegativeTest-716029449 tempest-VolumesNegativeTest-716029449-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003826 Jul 20 20:08:01.755010 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1884/2515] 10.222.0.69 () {58 vars in 1139 bytes} [Wed Jul 20 20:08:01 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jul 20 20:08:01.763710 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-58fd9d6f-55c1-4414-8599-6d72b75674cf tempest-VolumesNegativeTest-716029449 tempest-VolumesNegativeTest-716029449-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003489 Jul 20 20:08:01.764203 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1885/2516] 10.222.0.69 () {58 vars in 1136 bytes} [Wed Jul 20 20:08:01 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 4 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 20 20:08:01.772244 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-b23d6d43-7b3b-4804-95fb-fff132bd331f tempest-VolumesNegativeTest-716029449 tempest-VolumesNegativeTest-716029449-project] Calling method '.version_select at 0x7ff60a232ca0>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:08:01.801827 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.wsgi [None req-b23d6d43-7b3b-4804-95fb-fff132bd331f tempest-VolumesNegativeTest-716029449 tempest-VolumesNegativeTest-716029449-project] HTTP exception thrown: Volume b254a4bf-a776-4bf4-ba43-2cae28eb25ea could not be found. Jul 20 20:08:01.804456 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-b23d6d43-7b3b-4804-95fb-fff132bd331f tempest-VolumesNegativeTest-716029449 tempest-VolumesNegativeTest-716029449-project] Request method failure captured: Jul 20 20:08:01.804456 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: DELETE /compute/v2.1/os-volumes/b254a4bf-a776-4bf4-ba43-2cae28eb25ea HTTP/1.1 Jul 20 20:08:01.804456 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 20:08:01.804456 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 20:08:01.804456 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 20:08:01.804456 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 0 Jul 20 20:08:01.804456 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 20:08:01.804456 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 20:08:01.804456 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 20:08:01.804456 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 20:08:01.804456 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2GChSGQYXMPR1EMr5YTy1TMmmoFtZreIjP4pqj8Y4fAN0QeA3Q-dBO7z2urfWOuiCmx6FmfC5t6ze33Xx35JEUfgHM-eCQzcZwZRYh1aHJMaJRhH5lkEuP_tGRSNJMqc3Os4TlceoLcawKRiav_AndZJWNHUApcywMxrg_7tOiWsjAE Jul 20 20:08:01.804456 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 20:08:01.804456 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 20:08:01.804456 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 20:08:01.804456 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 20:08:01.804456 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 20:08:01.804456 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 20:08:01.804456 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: 6e2ed32e0b2745ceb5e6a01bb21b3ac6 Jul 20 20:08:01.804456 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-VolumesNegativeTest-716029449 Jul 20 20:08:01.804456 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 20:08:01.804456 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 20:08:01.806352 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/6e2ed32e0b2745ceb5e6a01bb21b3ac6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/6e2ed32e0b2745ceb5e6a01bb21b3ac6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_6e2ed32e0b2745ceb5e6a01bb21b3ac6", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/6e2ed32e0b2745ceb5e6a01bb21b3ac6"}]}] Jul 20 20:08:01.806352 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-VolumesNegativeTest-716029449 Jul 20 20:08:01.806352 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: 6e2ed32e0b2745ceb5e6a01bb21b3ac6 Jul 20 20:08:01.806352 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-VolumesNegativeTest-716029449 Jul 20 20:08:01.806352 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-VolumesNegativeTest-716029449-project Jul 20 20:08:01.806352 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 20:08:01.806352 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 20:08:01.806352 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: 9cda52391eb44481811d8578ef7b13a8 Jul 20 20:08:01.806352 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-VolumesNegativeTest-716029449-project Jul 20 20:08:01.806352 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: Jul 20 20:08:01.806352 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Volume b254a4bf-a776-4bf4-ba43-2cae28eb25ea could not be found. Jul 20 20:08:01.806352 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'id': 'b254a4bf-a776-4bf4-ba43-2cae28eb25ea'} Jul 20 20:08:01.806352 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 20:08:01.807594 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:08:01.807594 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 20:08:01.807594 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 20:08:01.807594 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 20:08:01.807594 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 20:08:01.807594 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 20:08:01.807594 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 20:08:01.807594 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 20:08:01.807594 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 20:08:01.807594 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 20:08:01.807594 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 20:08:01.807594 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 20:08:01.807594 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 20:08:01.807594 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 20:08:01.807594 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 20:08:01.807594 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b254a4bf-a776-4bf4-ba43-2cae28eb25ea could not be found. (HTTP 404) (Request-ID: req-d83387eb-b0ee-46e4-a91c-3af3f59c8741) Jul 20 20:08:01.807594 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:08:01.807594 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:08:01.807594 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:08:01.809425 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:08:01.809425 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 20 20:08:01.809425 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 20 20:08:01.809425 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 20:08:01.809425 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 20:08:01.809425 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 20:08:01.809425 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 20:08:01.809425 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 20:08:01.809425 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 20:08:01.809425 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 20:08:01.809425 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 20:08:01.809425 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 20:08:01.809425 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 20:08:01.809425 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 20:08:01.809425 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 20:08:01.809425 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 20:08:01.809425 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 20:08:01.809425 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 20:08:01.809425 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 20:08:01.811035 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 20:08:01.811035 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 20:08:01.811035 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 20:08:01.811035 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 20:08:01.811035 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b254a4bf-a776-4bf4-ba43-2cae28eb25ea could not be found. Jul 20 20:08:01.811035 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:08:01.811035 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:08:01.811035 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:08:01.811035 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:08:01.811035 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:08:01.811035 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:08:01.811035 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 20:08:01.811035 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 20:08:01.811035 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 20:08:01.811035 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 20:08:01.811035 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 20:08:01.811035 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 20:08:01.811035 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 20 20:08:01.811035 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 20:08:01.813312 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b254a4bf-a776-4bf4-ba43-2cae28eb25ea could not be found. Jul 20 20:08:01.813312 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:08:01.813312 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:08:01.813312 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:08:01.813312 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:08:01.813312 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:08:01.813312 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:08:01.813312 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 20:08:01.813312 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 20:08:01.813312 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b254a4bf-a776-4bf4-ba43-2cae28eb25ea could not be found. Jul 20 20:08:01.813312 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:08:01.813312 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-b23d6d43-7b3b-4804-95fb-fff132bd331f tempest-VolumesNegativeTest-716029449 tempest-VolumesNegativeTest-716029449-project] Returning 404 to user: Volume b254a4bf-a776-4bf4-ba43-2cae28eb25ea could not be found. {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 20:08:01.813312 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-b23d6d43-7b3b-4804-95fb-fff132bd331f tempest-VolumesNegativeTest-716029449 tempest-VolumesNegativeTest-716029449-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/b254a4bf-a776-4bf4-ba43-2cae28eb25ea" status: 404 len: 109 microversion: 2.1 time: 0.037067 Jul 20 20:08:01.813312 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1886/2517] 10.222.0.69 () {58 vars in 1247 bytes} [Wed Jul 20 20:08:01 2022] DELETE /compute/v2.1/os-volumes/b254a4bf-a776-4bf4-ba43-2cae28eb25ea => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 20:08:01.815642 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-6f5f6bd7-eff2-489a-8a42-e4a086a3f358 tempest-VolumesNegativeTest-716029449 tempest-VolumesNegativeTest-716029449-project] Calling method '.version_select at 0x7ff60e99ba60>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:08:01.845859 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.wsgi [None req-6f5f6bd7-eff2-489a-8a42-e4a086a3f358 tempest-VolumesNegativeTest-716029449 tempest-VolumesNegativeTest-716029449-project] HTTP exception thrown: Volume f0fee36a-26f1-436a-b909-d9909803ea00 could not be found. Jul 20 20:08:01.848402 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-6f5f6bd7-eff2-489a-8a42-e4a086a3f358 tempest-VolumesNegativeTest-716029449 tempest-VolumesNegativeTest-716029449-project] Request method failure captured: Jul 20 20:08:01.848402 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: GET /compute/v2.1/os-volumes/f0fee36a-26f1-436a-b909-d9909803ea00 HTTP/1.1 Jul 20 20:08:01.848402 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 20:08:01.848402 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 20:08:01.848402 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 20:08:01.848402 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 0 Jul 20 20:08:01.848402 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 20:08:01.848402 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 20:08:01.848402 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 20:08:01.848402 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 20:08:01.848402 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2GChSGQYXMPR1EMr5YTy1TMmmoFtZreIjP4pqj8Y4fAN0QeA3Q-dBO7z2urfWOuiCmx6FmfC5t6ze33Xx35JEUfgHM-eCQzcZwZRYh1aHJMaJRhH5lkEuP_tGRSNJMqc3Os4TlceoLcawKRiav_AndZJWNHUApcywMxrg_7tOiWsjAE Jul 20 20:08:01.848402 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 20:08:01.848402 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 20:08:01.848402 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 20:08:01.848402 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 20:08:01.848402 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 20:08:01.848402 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 20:08:01.848402 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: 6e2ed32e0b2745ceb5e6a01bb21b3ac6 Jul 20 20:08:01.848402 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-VolumesNegativeTest-716029449 Jul 20 20:08:01.848402 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 20:08:01.848402 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 20:08:01.850295 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/6e2ed32e0b2745ceb5e6a01bb21b3ac6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/6e2ed32e0b2745ceb5e6a01bb21b3ac6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_6e2ed32e0b2745ceb5e6a01bb21b3ac6", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/6e2ed32e0b2745ceb5e6a01bb21b3ac6"}]}] Jul 20 20:08:01.850295 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-VolumesNegativeTest-716029449 Jul 20 20:08:01.850295 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: 6e2ed32e0b2745ceb5e6a01bb21b3ac6 Jul 20 20:08:01.850295 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-VolumesNegativeTest-716029449 Jul 20 20:08:01.850295 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-VolumesNegativeTest-716029449-project Jul 20 20:08:01.850295 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 20:08:01.850295 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 20:08:01.850295 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: 9cda52391eb44481811d8578ef7b13a8 Jul 20 20:08:01.850295 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-VolumesNegativeTest-716029449-project Jul 20 20:08:01.850295 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: Jul 20 20:08:01.850295 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Volume f0fee36a-26f1-436a-b909-d9909803ea00 could not be found. Jul 20 20:08:01.850295 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'id': 'f0fee36a-26f1-436a-b909-d9909803ea00'} Jul 20 20:08:01.850295 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 20:08:01.852335 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:08:01.852335 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 20:08:01.852335 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 20:08:01.852335 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 20:08:01.852335 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 20:08:01.852335 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 20:08:01.852335 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 20:08:01.852335 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 20:08:01.852335 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 20:08:01.852335 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 20:08:01.852335 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 20:08:01.852335 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 20:08:01.852335 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 20:08:01.852335 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 20:08:01.852335 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 20:08:01.852335 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f0fee36a-26f1-436a-b909-d9909803ea00 could not be found. (HTTP 404) (Request-ID: req-9d1f2418-42d1-4dc6-b73a-e6e01a3de640) Jul 20 20:08:01.852335 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:08:01.852335 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:08:01.852335 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:08:01.853875 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:08:01.853875 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 20 20:08:01.853875 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 20 20:08:01.853875 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 20:08:01.853875 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 20:08:01.853875 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 20:08:01.853875 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 20:08:01.853875 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 20:08:01.853875 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 20:08:01.853875 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 20:08:01.853875 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 20:08:01.853875 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 20:08:01.853875 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 20:08:01.853875 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 20:08:01.853875 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 20:08:01.853875 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 20:08:01.853875 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 20:08:01.853875 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 20:08:01.853875 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 20:08:01.855884 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 20:08:01.855884 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 20:08:01.855884 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 20:08:01.855884 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 20:08:01.855884 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f0fee36a-26f1-436a-b909-d9909803ea00 could not be found. Jul 20 20:08:01.855884 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:08:01.855884 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:08:01.855884 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:08:01.855884 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:08:01.855884 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:08:01.855884 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:08:01.855884 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 20:08:01.855884 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 20:08:01.855884 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 20:08:01.855884 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 20:08:01.855884 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 20:08:01.855884 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 20:08:01.855884 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 20 20:08:01.855884 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 20:08:01.858364 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f0fee36a-26f1-436a-b909-d9909803ea00 could not be found. Jul 20 20:08:01.858364 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:08:01.858364 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:08:01.858364 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:08:01.858364 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:08:01.858364 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:08:01.858364 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:08:01.858364 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 20:08:01.858364 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 20:08:01.858364 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f0fee36a-26f1-436a-b909-d9909803ea00 could not be found. Jul 20 20:08:01.858364 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:08:01.858364 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-6f5f6bd7-eff2-489a-8a42-e4a086a3f358 tempest-VolumesNegativeTest-716029449 tempest-VolumesNegativeTest-716029449-project] Returning 404 to user: Volume f0fee36a-26f1-436a-b909-d9909803ea00 could not be found. {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 20:08:01.858364 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-6f5f6bd7-eff2-489a-8a42-e4a086a3f358 tempest-VolumesNegativeTest-716029449 tempest-VolumesNegativeTest-716029449-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/f0fee36a-26f1-436a-b909-d9909803ea00" status: 404 len: 109 microversion: 2.1 time: 0.038221 Jul 20 20:08:01.858364 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1887/2518] 10.222.0.69 () {58 vars in 1244 bytes} [Wed Jul 20 20:08:01 2022] GET /compute/v2.1/os-volumes/f0fee36a-26f1-436a-b909-d9909803ea00 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 20:08:02.687033 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-00412668-47b3-4ae3-a573-5c307ae9b54a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:08:02.687617 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-00412668-47b3-4ae3-a573-5c307ae9b54a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:08:02.693994 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-00412668-47b3-4ae3-a573-5c307ae9b54a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:02.695189 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-00412668-47b3-4ae3-a573-5c307ae9b54a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:02.695954 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-00412668-47b3-4ae3-a573-5c307ae9b54a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:02.696383 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-00412668-47b3-4ae3-a573-5c307ae9b54a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:02.828531 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-00412668-47b3-4ae3-a573-5c307ae9b54a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:02.836544 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-00412668-47b3-4ae3-a573-5c307ae9b54a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:02.838075 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-00412668-47b3-4ae3-a573-5c307ae9b54a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:02.839231 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-00412668-47b3-4ae3-a573-5c307ae9b54a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1739 microversion: 2.20 time: 0.157388 Jul 20 20:08:02.839784 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1888/2519] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:08:02 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1739 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 20:08:03.857518 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-cec19143-e062-49ed-8909-eed5a5416ff5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:08:03.858179 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-cec19143-e062-49ed-8909-eed5a5416ff5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:08:03.864199 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cec19143-e062-49ed-8909-eed5a5416ff5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:03.864864 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cec19143-e062-49ed-8909-eed5a5416ff5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:03.865648 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cec19143-e062-49ed-8909-eed5a5416ff5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:03.866084 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cec19143-e062-49ed-8909-eed5a5416ff5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:04.001160 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-cec19143-e062-49ed-8909-eed5a5416ff5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:04.009901 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-cec19143-e062-49ed-8909-eed5a5416ff5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:04.011402 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-cec19143-e062-49ed-8909-eed5a5416ff5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:04.012552 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-cec19143-e062-49ed-8909-eed5a5416ff5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1721 microversion: 2.20 time: 0.159032 Jul 20 20:08:04.013106 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1889/2520] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:08:03 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 20:08:05.030919 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-cd85c7da-e03d-4437-a355-94b2cb3fcc11 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:08:05.031638 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-cd85c7da-e03d-4437-a355-94b2cb3fcc11 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:08:05.038012 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cd85c7da-e03d-4437-a355-94b2cb3fcc11 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:05.038465 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cd85c7da-e03d-4437-a355-94b2cb3fcc11 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:05.039321 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cd85c7da-e03d-4437-a355-94b2cb3fcc11 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:05.039753 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cd85c7da-e03d-4437-a355-94b2cb3fcc11 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:05.171097 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-cd85c7da-e03d-4437-a355-94b2cb3fcc11 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:05.179084 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-cd85c7da-e03d-4437-a355-94b2cb3fcc11 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:05.180644 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-cd85c7da-e03d-4437-a355-94b2cb3fcc11 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:05.181811 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-cd85c7da-e03d-4437-a355-94b2cb3fcc11 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1721 microversion: 2.20 time: 0.154759 Jul 20 20:08:05.182363 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1890/2521] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:08:05 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 20:08:05.851876 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [req-d6a5fa3c-946d-4ec3-bb5c-6d9b463fbc63 req-0d881686-2e83-40e3-b2b7-844b3a3bc762 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c5c0c16-97ac-46f6-8a3e-f5440a0d584b", "name": "network-vif-unplugged", "status": "completed", "tag": "4d5fe51d-3208-445f-a00e-81057db89aa5"}]} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 20:08:05.860276 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-d6a5fa3c-946d-4ec3-bb5c-6d9b463fbc63 req-0d881686-2e83-40e3-b2b7-844b3a3bc762 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:05.860720 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-d6a5fa3c-946d-4ec3-bb5c-6d9b463fbc63 req-0d881686-2e83-40e3-b2b7-844b3a3bc762 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:05.872616 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.compute.server_external_events [req-d6a5fa3c-946d-4ec3-bb5c-6d9b463fbc63 req-0d881686-2e83-40e3-b2b7-844b3a3bc762 service nova] Unable to find a host for instance 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b. Dropping event network-vif-unplugged {{(pid=117761) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 20 20:08:05.873483 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [req-d6a5fa3c-946d-4ec3-bb5c-6d9b463fbc63 req-0d881686-2e83-40e3-b2b7-844b3a3bc762 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026989 Jul 20 20:08:05.874088 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1891/2522] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 20:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 20 20:08:06.199850 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-75e384aa-232b-4785-8acf-0b75640d33af tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:08:06.200526 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-75e384aa-232b-4785-8acf-0b75640d33af tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:08:06.207021 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-75e384aa-232b-4785-8acf-0b75640d33af tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:06.207470 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-75e384aa-232b-4785-8acf-0b75640d33af tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:06.208225 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-75e384aa-232b-4785-8acf-0b75640d33af tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:06.208653 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-75e384aa-232b-4785-8acf-0b75640d33af tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:06.342526 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-75e384aa-232b-4785-8acf-0b75640d33af tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:06.351710 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-75e384aa-232b-4785-8acf-0b75640d33af tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:06.353540 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-75e384aa-232b-4785-8acf-0b75640d33af tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:06.354689 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-75e384aa-232b-4785-8acf-0b75640d33af tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1664 microversion: 2.20 time: 0.158757 Jul 20 20:08:06.355241 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1892/2523] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:08:06 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1664 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 20:08:06.371768 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ba47cd10-d3a7-4f29-b7e6-35423dbf17ee tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "69075b81-0551-4649-aded-408b4cbcc357"}} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 20:08:06.372858 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ba47cd10-d3a7-4f29-b7e6-35423dbf17ee tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:08:06.379311 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ba47cd10-d3a7-4f29-b7e6-35423dbf17ee tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:06.379779 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ba47cd10-d3a7-4f29-b7e6-35423dbf17ee tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:06.380537 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ba47cd10-d3a7-4f29-b7e6-35423dbf17ee tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:06.380971 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ba47cd10-d3a7-4f29-b7e6-35423dbf17ee tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:06.686580 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ba47cd10-d3a7-4f29-b7e6-35423dbf17ee tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "POST /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.318549 Jul 20 20:08:06.687186 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1893/2524] 10.222.0.69 () {62 vars in 1363 bytes} [Wed Jul 20 20:08:06 2022] POST /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b/os-volume_attachments => generated 188 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 20:08:06.801046 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-389959d2-0591-4885-ae57-b605736898f3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:08:06.801563 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-389959d2-0591-4885-ae57-b605736898f3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:08:06.809181 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-389959d2-0591-4885-ae57-b605736898f3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:06.809664 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-389959d2-0591-4885-ae57-b605736898f3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:06.810421 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-389959d2-0591-4885-ae57-b605736898f3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:06.810853 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-389959d2-0591-4885-ae57-b605736898f3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:06.905598 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 20:08:07.032016 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-389959d2-0591-4885-ae57-b605736898f3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "DELETE /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b/os-volume_attachments/69075b81-0551-4649-aded-408b4cbcc357" status: 202 len: 0 microversion: 2.20 time: 0.234842 Jul 20 20:08:07.032602 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1894/2525] 10.222.0.69 () {60 vars in 1456 bytes} [Wed Jul 20 20:08:06 2022] DELETE /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b/os-volume_attachments/69075b81-0551-4649-aded-408b4cbcc357 => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 20 20:08:07.087734 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-2234aaa5-cf74-40d5-8f58-f83230104379 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 20:08:07.088295 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-2234aaa5-cf74-40d5-8f58-f83230104379 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:08:07.094218 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2234aaa5-cf74-40d5-8f58-f83230104379 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:07.094663 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2234aaa5-cf74-40d5-8f58-f83230104379 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:07.095676 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2234aaa5-cf74-40d5-8f58-f83230104379 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:07.096104 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2234aaa5-cf74-40d5-8f58-f83230104379 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:07.185080 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-2234aaa5-cf74-40d5-8f58-f83230104379 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "POST /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b/action" status: 202 len: 0 microversion: 2.20 time: 0.101315 Jul 20 20:08:07.185719 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1895/2526] 10.222.0.69 () {62 vars in 1318 bytes} [Wed Jul 20 20:08:07 2022] POST /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 20 20:08:07.193353 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-94c8f216-1bab-4cff-aa74-74bafa4cf7d3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:08:07.193989 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-94c8f216-1bab-4cff-aa74-74bafa4cf7d3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:08:07.200641 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-94c8f216-1bab-4cff-aa74-74bafa4cf7d3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:07.201195 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-94c8f216-1bab-4cff-aa74-74bafa4cf7d3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:07.201871 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-94c8f216-1bab-4cff-aa74-74bafa4cf7d3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:07.202307 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-94c8f216-1bab-4cff-aa74-74bafa4cf7d3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:07.336819 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-94c8f216-1bab-4cff-aa74-74bafa4cf7d3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:07.344960 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-94c8f216-1bab-4cff-aa74-74bafa4cf7d3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:07.347037 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-94c8f216-1bab-4cff-aa74-74bafa4cf7d3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:07.347857 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-94c8f216-1bab-4cff-aa74-74bafa4cf7d3 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1672 microversion: 2.20 time: 0.158187 Jul 20 20:08:07.348407 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1896/2527] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:08:07 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1672 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 20:08:08.365891 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-b98e2511-bfb6-46b0-9773-7918fe520891 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:08:08.366571 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-b98e2511-bfb6-46b0-9773-7918fe520891 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:08:08.373199 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b98e2511-bfb6-46b0-9773-7918fe520891 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:08.373753 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b98e2511-bfb6-46b0-9773-7918fe520891 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:08.374516 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b98e2511-bfb6-46b0-9773-7918fe520891 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:08.374954 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b98e2511-bfb6-46b0-9773-7918fe520891 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:08.511244 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-b98e2511-bfb6-46b0-9773-7918fe520891 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:08.519107 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-b98e2511-bfb6-46b0-9773-7918fe520891 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:08.520615 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-b98e2511-bfb6-46b0-9773-7918fe520891 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:08.521777 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-b98e2511-bfb6-46b0-9773-7918fe520891 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1674 microversion: 2.20 time: 0.160019 Jul 20 20:08:08.522329 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1897/2528] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:08:08 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 20:08:09.543015 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-3e0128ff-1c94-45c2-90b6-b9e7a68a4088 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:08:09.543748 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-3e0128ff-1c94-45c2-90b6-b9e7a68a4088 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:08:09.553233 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3e0128ff-1c94-45c2-90b6-b9e7a68a4088 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:09.553731 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3e0128ff-1c94-45c2-90b6-b9e7a68a4088 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:09.556061 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3e0128ff-1c94-45c2-90b6-b9e7a68a4088 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:09.556536 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3e0128ff-1c94-45c2-90b6-b9e7a68a4088 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:09.802945 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3e0128ff-1c94-45c2-90b6-b9e7a68a4088 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:09.816275 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3e0128ff-1c94-45c2-90b6-b9e7a68a4088 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:09.818695 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3e0128ff-1c94-45c2-90b6-b9e7a68a4088 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:09.821721 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-3e0128ff-1c94-45c2-90b6-b9e7a68a4088 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1730 microversion: 2.20 time: 0.285080 Jul 20 20:08:09.836223 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1898/2529] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:08:09 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1730 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 20:08:10.840098 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ce34cb70-2796-4271-ad6c-92d989bed146 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:08:10.841139 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ce34cb70-2796-4271-ad6c-92d989bed146 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:08:10.847934 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ce34cb70-2796-4271-ad6c-92d989bed146 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:10.848381 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ce34cb70-2796-4271-ad6c-92d989bed146 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:10.849140 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ce34cb70-2796-4271-ad6c-92d989bed146 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:10.849593 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ce34cb70-2796-4271-ad6c-92d989bed146 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:10.988353 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ce34cb70-2796-4271-ad6c-92d989bed146 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:10.996844 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ce34cb70-2796-4271-ad6c-92d989bed146 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:10.998387 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ce34cb70-2796-4271-ad6c-92d989bed146 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:10.999537 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ce34cb70-2796-4271-ad6c-92d989bed146 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1730 microversion: 2.20 time: 0.163713 Jul 20 20:08:11.000097 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1899/2530] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:08:10 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 20:08:12.018188 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-3673104b-24ba-4431-9e38-68f4efae986c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:08:12.018932 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-3673104b-24ba-4431-9e38-68f4efae986c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:08:12.025940 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3673104b-24ba-4431-9e38-68f4efae986c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:12.026770 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3673104b-24ba-4431-9e38-68f4efae986c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:12.027923 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3673104b-24ba-4431-9e38-68f4efae986c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:12.028637 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3673104b-24ba-4431-9e38-68f4efae986c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:12.239406 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3673104b-24ba-4431-9e38-68f4efae986c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:12.248512 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3673104b-24ba-4431-9e38-68f4efae986c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:12.250182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3673104b-24ba-4431-9e38-68f4efae986c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:12.251345 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-3673104b-24ba-4431-9e38-68f4efae986c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1730 microversion: 2.20 time: 0.237642 Jul 20 20:08:12.251893 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1900/2531] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:08:12 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1730 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 20:08:13.270340 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d6c04f07-e407-4800-b34a-06bdfbf64b13 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:08:13.270972 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d6c04f07-e407-4800-b34a-06bdfbf64b13 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:08:13.278895 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d6c04f07-e407-4800-b34a-06bdfbf64b13 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:13.284027 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d6c04f07-e407-4800-b34a-06bdfbf64b13 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:13.289113 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d6c04f07-e407-4800-b34a-06bdfbf64b13 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:13.289601 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d6c04f07-e407-4800-b34a-06bdfbf64b13 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:13.481826 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d6c04f07-e407-4800-b34a-06bdfbf64b13 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:13.488426 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d6c04f07-e407-4800-b34a-06bdfbf64b13 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:13.496003 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d6c04f07-e407-4800-b34a-06bdfbf64b13 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:13.497317 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d6c04f07-e407-4800-b34a-06bdfbf64b13 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1730 microversion: 2.20 time: 0.231009 Jul 20 20:08:13.500069 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1901/2532] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:08:13 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1730 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 20:08:14.518475 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c5afdc96-7cce-48a7-94c1-4684b437e79f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:08:14.519937 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c5afdc96-7cce-48a7-94c1-4684b437e79f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:08:14.527009 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c5afdc96-7cce-48a7-94c1-4684b437e79f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:14.527758 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c5afdc96-7cce-48a7-94c1-4684b437e79f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:14.528736 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c5afdc96-7cce-48a7-94c1-4684b437e79f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:14.529389 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c5afdc96-7cce-48a7-94c1-4684b437e79f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:14.696467 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c5afdc96-7cce-48a7-94c1-4684b437e79f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:14.705176 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c5afdc96-7cce-48a7-94c1-4684b437e79f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:14.706755 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c5afdc96-7cce-48a7-94c1-4684b437e79f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:14.707943 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c5afdc96-7cce-48a7-94c1-4684b437e79f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1730 microversion: 2.20 time: 0.193311 Jul 20 20:08:14.708674 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1902/2533] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:08:14 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1730 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 20:08:15.726094 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-fc5f6fcf-f35a-4872-bc0c-2f68e354db87 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:08:15.726867 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-fc5f6fcf-f35a-4872-bc0c-2f68e354db87 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:08:15.733294 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fc5f6fcf-f35a-4872-bc0c-2f68e354db87 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:15.733906 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fc5f6fcf-f35a-4872-bc0c-2f68e354db87 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:15.735008 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fc5f6fcf-f35a-4872-bc0c-2f68e354db87 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:15.735008 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fc5f6fcf-f35a-4872-bc0c-2f68e354db87 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:15.874194 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-fc5f6fcf-f35a-4872-bc0c-2f68e354db87 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:15.883616 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-fc5f6fcf-f35a-4872-bc0c-2f68e354db87 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:15.885469 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-fc5f6fcf-f35a-4872-bc0c-2f68e354db87 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:15.886669 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-fc5f6fcf-f35a-4872-bc0c-2f68e354db87 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1730 microversion: 2.20 time: 0.164445 Jul 20 20:08:15.887436 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1903/2534] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:08:15 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 20:08:16.905474 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-637e73f2-5776-491c-9839-c89acac22fbc tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:08:16.906957 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-637e73f2-5776-491c-9839-c89acac22fbc tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:08:16.913493 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-637e73f2-5776-491c-9839-c89acac22fbc tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:16.914884 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-637e73f2-5776-491c-9839-c89acac22fbc tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:16.915902 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-637e73f2-5776-491c-9839-c89acac22fbc tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:16.916528 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-637e73f2-5776-491c-9839-c89acac22fbc tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:17.095549 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-637e73f2-5776-491c-9839-c89acac22fbc tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:17.105566 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-637e73f2-5776-491c-9839-c89acac22fbc tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:17.107386 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-637e73f2-5776-491c-9839-c89acac22fbc tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:17.108782 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-637e73f2-5776-491c-9839-c89acac22fbc tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1730 microversion: 2.20 time: 0.207798 Jul 20 20:08:17.109925 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1904/2535] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:08:16 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1730 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 20:08:18.127306 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-dca2e0e8-d0a3-4bee-a6f6-a8d38ab7e936 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:08:18.132129 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-dca2e0e8-d0a3-4bee-a6f6-a8d38ab7e936 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:08:18.137800 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-dca2e0e8-d0a3-4bee-a6f6-a8d38ab7e936 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:18.138718 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-dca2e0e8-d0a3-4bee-a6f6-a8d38ab7e936 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:18.139849 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-dca2e0e8-d0a3-4bee-a6f6-a8d38ab7e936 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:18.140460 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-dca2e0e8-d0a3-4bee-a6f6-a8d38ab7e936 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:18.343194 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-dca2e0e8-d0a3-4bee-a6f6-a8d38ab7e936 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:18.355757 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-dca2e0e8-d0a3-4bee-a6f6-a8d38ab7e936 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:18.358180 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-dca2e0e8-d0a3-4bee-a6f6-a8d38ab7e936 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:18.360151 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-dca2e0e8-d0a3-4bee-a6f6-a8d38ab7e936 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1730 microversion: 2.20 time: 0.237039 Jul 20 20:08:18.361629 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1905/2536] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:08:18 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1730 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 20:08:19.379671 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d413be3a-dc49-42ad-8f93-2e1ceb12a698 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:08:19.380666 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d413be3a-dc49-42ad-8f93-2e1ceb12a698 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:08:19.386724 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d413be3a-dc49-42ad-8f93-2e1ceb12a698 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:19.387168 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d413be3a-dc49-42ad-8f93-2e1ceb12a698 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:19.387927 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d413be3a-dc49-42ad-8f93-2e1ceb12a698 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:19.388357 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d413be3a-dc49-42ad-8f93-2e1ceb12a698 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:19.525922 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d413be3a-dc49-42ad-8f93-2e1ceb12a698 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:19.533935 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d413be3a-dc49-42ad-8f93-2e1ceb12a698 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:19.535362 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d413be3a-dc49-42ad-8f93-2e1ceb12a698 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:19.536513 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d413be3a-dc49-42ad-8f93-2e1ceb12a698 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1730 microversion: 2.20 time: 0.161540 Jul 20 20:08:19.537073 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1906/2537] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:08:19 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 20:08:20.555757 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-36c97cdf-85f7-4f38-91ec-887de110bd29 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:08:20.556471 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-36c97cdf-85f7-4f38-91ec-887de110bd29 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:08:20.558527 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_api:SELECT=72,nova_api:DELETE=1 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 20:08:20.563723 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-36c97cdf-85f7-4f38-91ec-887de110bd29 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:20.564164 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-36c97cdf-85f7-4f38-91ec-887de110bd29 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:20.564915 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-36c97cdf-85f7-4f38-91ec-887de110bd29 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:20.565349 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-36c97cdf-85f7-4f38-91ec-887de110bd29 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:20.703862 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-36c97cdf-85f7-4f38-91ec-887de110bd29 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:20.713265 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-36c97cdf-85f7-4f38-91ec-887de110bd29 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:20.715214 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-36c97cdf-85f7-4f38-91ec-887de110bd29 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:20.716365 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-36c97cdf-85f7-4f38-91ec-887de110bd29 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1730 microversion: 2.20 time: 0.165098 Jul 20 20:08:20.716936 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1907/2538] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:08:20 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 20:08:21.735650 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-454de5a9-990f-4923-b5c4-401d5fc672db tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:08:21.736355 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-454de5a9-990f-4923-b5c4-401d5fc672db tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:08:21.743013 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-454de5a9-990f-4923-b5c4-401d5fc672db tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:21.743468 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-454de5a9-990f-4923-b5c4-401d5fc672db tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:21.744246 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-454de5a9-990f-4923-b5c4-401d5fc672db tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:21.744677 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-454de5a9-990f-4923-b5c4-401d5fc672db tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:21.879460 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-454de5a9-990f-4923-b5c4-401d5fc672db tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:21.887472 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-454de5a9-990f-4923-b5c4-401d5fc672db tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:21.888981 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-454de5a9-990f-4923-b5c4-401d5fc672db tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:21.890165 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-454de5a9-990f-4923-b5c4-401d5fc672db tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1730 microversion: 2.20 time: 0.158435 Jul 20 20:08:21.890734 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1908/2539] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:08:21 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 20:08:22.909415 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-08935164-c61c-4494-8c78-d3625971cda7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:08:22.910416 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-08935164-c61c-4494-8c78-d3625971cda7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:08:22.916737 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-08935164-c61c-4494-8c78-d3625971cda7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:22.917180 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-08935164-c61c-4494-8c78-d3625971cda7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:22.917967 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-08935164-c61c-4494-8c78-d3625971cda7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:22.918395 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-08935164-c61c-4494-8c78-d3625971cda7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:22.922249 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:UPDATE=5,nova_cell1:INSERT=2,nova_cell1:SELECT=93 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 20:08:23.053406 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-08935164-c61c-4494-8c78-d3625971cda7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:23.061969 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-08935164-c61c-4494-8c78-d3625971cda7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:23.063467 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-08935164-c61c-4494-8c78-d3625971cda7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:23.064607 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-08935164-c61c-4494-8c78-d3625971cda7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1730 microversion: 2.20 time: 0.159115 Jul 20 20:08:23.065151 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1909/2540] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:08:22 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 20:08:24.082460 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-3629ac7d-580b-401c-85dc-316392976e16 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:08:24.083129 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-3629ac7d-580b-401c-85dc-316392976e16 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:08:24.090175 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3629ac7d-580b-401c-85dc-316392976e16 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:24.090631 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3629ac7d-580b-401c-85dc-316392976e16 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:24.091390 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3629ac7d-580b-401c-85dc-316392976e16 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:24.091828 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3629ac7d-580b-401c-85dc-316392976e16 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:24.219157 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3629ac7d-580b-401c-85dc-316392976e16 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:24.227279 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3629ac7d-580b-401c-85dc-316392976e16 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:24.228771 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3629ac7d-580b-401c-85dc-316392976e16 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:24.229972 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-3629ac7d-580b-401c-85dc-316392976e16 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1730 microversion: 2.20 time: 0.151360 Jul 20 20:08:24.230528 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1910/2541] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:08:24 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 20:08:25.248412 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-0cc095a5-0cf9-4c3a-8848-325e89d000bd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:08:25.249078 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-0cc095a5-0cf9-4c3a-8848-325e89d000bd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:08:25.255547 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0cc095a5-0cf9-4c3a-8848-325e89d000bd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:25.255998 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0cc095a5-0cf9-4c3a-8848-325e89d000bd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:25.256758 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0cc095a5-0cf9-4c3a-8848-325e89d000bd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:25.257196 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0cc095a5-0cf9-4c3a-8848-325e89d000bd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:25.391298 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0cc095a5-0cf9-4c3a-8848-325e89d000bd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:25.399464 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0cc095a5-0cf9-4c3a-8848-325e89d000bd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:25.400964 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0cc095a5-0cf9-4c3a-8848-325e89d000bd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:25.402142 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-0cc095a5-0cf9-4c3a-8848-325e89d000bd tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1730 microversion: 2.20 time: 0.157631 Jul 20 20:08:25.402695 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1911/2542] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:08:25 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 20:08:26.419741 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4a6e247d-8644-4d37-b0bb-a91a438f6a75 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:08:26.420383 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-4a6e247d-8644-4d37-b0bb-a91a438f6a75 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:08:26.426830 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4a6e247d-8644-4d37-b0bb-a91a438f6a75 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:26.427459 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4a6e247d-8644-4d37-b0bb-a91a438f6a75 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:26.428241 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4a6e247d-8644-4d37-b0bb-a91a438f6a75 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:26.428680 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4a6e247d-8644-4d37-b0bb-a91a438f6a75 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:26.556169 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-4a6e247d-8644-4d37-b0bb-a91a438f6a75 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:26.563973 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-4a6e247d-8644-4d37-b0bb-a91a438f6a75 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:26.565474 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-4a6e247d-8644-4d37-b0bb-a91a438f6a75 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:26.566853 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-4a6e247d-8644-4d37-b0bb-a91a438f6a75 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1730 microversion: 2.20 time: 0.150843 Jul 20 20:08:26.567410 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1912/2543] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:08:26 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 20:08:27.585446 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-9cffeaa2-5e5f-44df-bcf3-0302aef870c6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:08:27.586065 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-9cffeaa2-5e5f-44df-bcf3-0302aef870c6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:08:27.593007 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9cffeaa2-5e5f-44df-bcf3-0302aef870c6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:27.593449 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9cffeaa2-5e5f-44df-bcf3-0302aef870c6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:27.594231 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9cffeaa2-5e5f-44df-bcf3-0302aef870c6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:27.594656 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9cffeaa2-5e5f-44df-bcf3-0302aef870c6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:27.729250 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-9cffeaa2-5e5f-44df-bcf3-0302aef870c6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:27.737328 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-9cffeaa2-5e5f-44df-bcf3-0302aef870c6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:27.738877 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-9cffeaa2-5e5f-44df-bcf3-0302aef870c6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:27.740044 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-9cffeaa2-5e5f-44df-bcf3-0302aef870c6 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1730 microversion: 2.20 time: 0.158637 Jul 20 20:08:27.740602 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1913/2544] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:08:27 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 20:08:28.758070 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-61d4bdf4-976d-44db-8c2e-ac673a6a32f2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:08:28.758674 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-61d4bdf4-976d-44db-8c2e-ac673a6a32f2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:08:28.765487 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-61d4bdf4-976d-44db-8c2e-ac673a6a32f2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:28.765960 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-61d4bdf4-976d-44db-8c2e-ac673a6a32f2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:28.766711 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-61d4bdf4-976d-44db-8c2e-ac673a6a32f2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:28.767168 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-61d4bdf4-976d-44db-8c2e-ac673a6a32f2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:28.904171 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-61d4bdf4-976d-44db-8c2e-ac673a6a32f2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:28.912057 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-61d4bdf4-976d-44db-8c2e-ac673a6a32f2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:28.913596 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-61d4bdf4-976d-44db-8c2e-ac673a6a32f2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:28.915405 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-61d4bdf4-976d-44db-8c2e-ac673a6a32f2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1730 microversion: 2.20 time: 0.160993 Jul 20 20:08:28.915968 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1914/2545] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:08:28 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 20:08:29.934638 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-3ee1031f-c98f-44bd-9a5d-06fbebc0895c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:08:29.935461 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-3ee1031f-c98f-44bd-9a5d-06fbebc0895c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:08:29.941799 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3ee1031f-c98f-44bd-9a5d-06fbebc0895c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:29.942401 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3ee1031f-c98f-44bd-9a5d-06fbebc0895c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:29.943191 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3ee1031f-c98f-44bd-9a5d-06fbebc0895c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:29.943644 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3ee1031f-c98f-44bd-9a5d-06fbebc0895c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:30.072866 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3ee1031f-c98f-44bd-9a5d-06fbebc0895c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:30.080711 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3ee1031f-c98f-44bd-9a5d-06fbebc0895c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:30.082232 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3ee1031f-c98f-44bd-9a5d-06fbebc0895c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:30.083376 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-3ee1031f-c98f-44bd-9a5d-06fbebc0895c tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1730 microversion: 2.20 time: 0.153818 Jul 20 20:08:30.083927 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1915/2546] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:08:29 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 20:08:31.102095 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-bded4abb-0d8f-4a22-8840-8e4032edc5bf tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:08:31.103526 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-bded4abb-0d8f-4a22-8840-8e4032edc5bf tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:08:31.110178 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bded4abb-0d8f-4a22-8840-8e4032edc5bf tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:31.110624 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bded4abb-0d8f-4a22-8840-8e4032edc5bf tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:31.111386 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bded4abb-0d8f-4a22-8840-8e4032edc5bf tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:31.111847 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bded4abb-0d8f-4a22-8840-8e4032edc5bf tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:31.244221 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-bded4abb-0d8f-4a22-8840-8e4032edc5bf tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:31.252095 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-bded4abb-0d8f-4a22-8840-8e4032edc5bf tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:31.253635 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-bded4abb-0d8f-4a22-8840-8e4032edc5bf tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:31.254789 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-bded4abb-0d8f-4a22-8840-8e4032edc5bf tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1730 microversion: 2.20 time: 0.156598 Jul 20 20:08:31.255352 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1916/2547] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:08:31 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 20:08:32.273069 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-cf7be24e-a286-487e-9d04-5901dc2b29c5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:08:32.273759 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-cf7be24e-a286-487e-9d04-5901dc2b29c5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:08:32.280936 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cf7be24e-a286-487e-9d04-5901dc2b29c5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:32.281380 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cf7be24e-a286-487e-9d04-5901dc2b29c5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:32.282163 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cf7be24e-a286-487e-9d04-5901dc2b29c5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:32.282596 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-cf7be24e-a286-487e-9d04-5901dc2b29c5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:32.411903 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-cf7be24e-a286-487e-9d04-5901dc2b29c5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:32.420543 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-cf7be24e-a286-487e-9d04-5901dc2b29c5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:32.422086 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-cf7be24e-a286-487e-9d04-5901dc2b29c5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:32.423244 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-cf7be24e-a286-487e-9d04-5901dc2b29c5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1730 microversion: 2.20 time: 0.154125 Jul 20 20:08:32.423803 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1917/2548] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:08:32 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 20:08:33.441172 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-aff51dd8-0bdd-424d-bb4d-9c150645a268 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:08:33.441856 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-aff51dd8-0bdd-424d-bb4d-9c150645a268 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:08:33.449215 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aff51dd8-0bdd-424d-bb4d-9c150645a268 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:33.449709 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aff51dd8-0bdd-424d-bb4d-9c150645a268 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:33.450473 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aff51dd8-0bdd-424d-bb4d-9c150645a268 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:33.450909 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aff51dd8-0bdd-424d-bb4d-9c150645a268 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:33.584225 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-aff51dd8-0bdd-424d-bb4d-9c150645a268 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:33.593301 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-aff51dd8-0bdd-424d-bb4d-9c150645a268 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:33.594852 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-aff51dd8-0bdd-424d-bb4d-9c150645a268 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:33.596025 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-aff51dd8-0bdd-424d-bb4d-9c150645a268 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1730 microversion: 2.20 time: 0.158835 Jul 20 20:08:33.596583 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1918/2549] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:08:33 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 20:08:34.616970 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-fe19d99d-37df-4040-bc87-a5a721373b9f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:08:34.617837 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-fe19d99d-37df-4040-bc87-a5a721373b9f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:08:34.625673 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fe19d99d-37df-4040-bc87-a5a721373b9f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:34.626116 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fe19d99d-37df-4040-bc87-a5a721373b9f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:34.626868 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fe19d99d-37df-4040-bc87-a5a721373b9f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:34.627295 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-fe19d99d-37df-4040-bc87-a5a721373b9f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:34.760560 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-fe19d99d-37df-4040-bc87-a5a721373b9f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:34.768436 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-fe19d99d-37df-4040-bc87-a5a721373b9f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:34.769946 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-fe19d99d-37df-4040-bc87-a5a721373b9f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:34.771082 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-fe19d99d-37df-4040-bc87-a5a721373b9f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1730 microversion: 2.20 time: 0.159811 Jul 20 20:08:34.771637 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1919/2550] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:08:34 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 20:08:35.789134 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-46c6f6a9-c4b9-4cf9-8a1f-ff0b99e671c7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:08:35.789865 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-46c6f6a9-c4b9-4cf9-8a1f-ff0b99e671c7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:08:35.796429 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-46c6f6a9-c4b9-4cf9-8a1f-ff0b99e671c7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:35.796884 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-46c6f6a9-c4b9-4cf9-8a1f-ff0b99e671c7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:35.797678 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-46c6f6a9-c4b9-4cf9-8a1f-ff0b99e671c7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:35.798114 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-46c6f6a9-c4b9-4cf9-8a1f-ff0b99e671c7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:36.083783 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-46c6f6a9-c4b9-4cf9-8a1f-ff0b99e671c7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:36.092838 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-46c6f6a9-c4b9-4cf9-8a1f-ff0b99e671c7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:36.094392 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-46c6f6a9-c4b9-4cf9-8a1f-ff0b99e671c7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:36.095544 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-46c6f6a9-c4b9-4cf9-8a1f-ff0b99e671c7 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1730 microversion: 2.20 time: 0.310313 Jul 20 20:08:36.096319 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1920/2551] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:08:35 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1730 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 20:08:37.115391 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-1c41a325-3c23-4c66-9a7e-1027fdba695f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:08:37.116051 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-1c41a325-3c23-4c66-9a7e-1027fdba695f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:08:37.122881 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1c41a325-3c23-4c66-9a7e-1027fdba695f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:37.123317 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1c41a325-3c23-4c66-9a7e-1027fdba695f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:37.124073 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1c41a325-3c23-4c66-9a7e-1027fdba695f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:37.124520 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1c41a325-3c23-4c66-9a7e-1027fdba695f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:37.263298 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1c41a325-3c23-4c66-9a7e-1027fdba695f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:37.277338 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1c41a325-3c23-4c66-9a7e-1027fdba695f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:37.278916 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1c41a325-3c23-4c66-9a7e-1027fdba695f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:37.280057 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-1c41a325-3c23-4c66-9a7e-1027fdba695f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1730 microversion: 2.20 time: 0.168770 Jul 20 20:08:37.280592 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1921/2552] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:08:37 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 20:08:38.299655 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-605e0db5-a111-4d1d-ad82-7d3159bfb55d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:08:38.300337 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-605e0db5-a111-4d1d-ad82-7d3159bfb55d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:08:38.307363 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-605e0db5-a111-4d1d-ad82-7d3159bfb55d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:38.307881 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-605e0db5-a111-4d1d-ad82-7d3159bfb55d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:38.309072 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-605e0db5-a111-4d1d-ad82-7d3159bfb55d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:38.309748 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-605e0db5-a111-4d1d-ad82-7d3159bfb55d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:38.442651 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-605e0db5-a111-4d1d-ad82-7d3159bfb55d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:38.450953 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-605e0db5-a111-4d1d-ad82-7d3159bfb55d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:38.452440 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-605e0db5-a111-4d1d-ad82-7d3159bfb55d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:38.453600 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-605e0db5-a111-4d1d-ad82-7d3159bfb55d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1730 microversion: 2.20 time: 0.158472 Jul 20 20:08:38.454149 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1922/2553] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:08:38 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 20:08:39.472134 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-3ff3af1d-6197-4b8c-98fd-beb5d0b6f7cc tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:08:39.473040 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-3ff3af1d-6197-4b8c-98fd-beb5d0b6f7cc tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:08:39.480122 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3ff3af1d-6197-4b8c-98fd-beb5d0b6f7cc tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:39.480568 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3ff3af1d-6197-4b8c-98fd-beb5d0b6f7cc tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:39.481332 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3ff3af1d-6197-4b8c-98fd-beb5d0b6f7cc tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:39.481797 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3ff3af1d-6197-4b8c-98fd-beb5d0b6f7cc tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:39.613895 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3ff3af1d-6197-4b8c-98fd-beb5d0b6f7cc tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:39.622605 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3ff3af1d-6197-4b8c-98fd-beb5d0b6f7cc tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:39.624099 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3ff3af1d-6197-4b8c-98fd-beb5d0b6f7cc tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:39.625357 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-3ff3af1d-6197-4b8c-98fd-beb5d0b6f7cc tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1730 microversion: 2.20 time: 0.156968 Jul 20 20:08:39.625939 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1923/2554] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:08:39 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 20:08:40.643985 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-0b3b478d-79e0-4734-98ce-244d5a1ff8d9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:08:40.644638 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-0b3b478d-79e0-4734-98ce-244d5a1ff8d9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:08:40.651606 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0b3b478d-79e0-4734-98ce-244d5a1ff8d9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:40.652040 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0b3b478d-79e0-4734-98ce-244d5a1ff8d9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:40.652788 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0b3b478d-79e0-4734-98ce-244d5a1ff8d9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:40.653213 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-0b3b478d-79e0-4734-98ce-244d5a1ff8d9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:40.783596 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0b3b478d-79e0-4734-98ce-244d5a1ff8d9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:40.792138 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0b3b478d-79e0-4734-98ce-244d5a1ff8d9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:40.793666 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-0b3b478d-79e0-4734-98ce-244d5a1ff8d9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:40.794876 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-0b3b478d-79e0-4734-98ce-244d5a1ff8d9 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1730 microversion: 2.20 time: 0.154763 Jul 20 20:08:40.795514 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1924/2555] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:08:40 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 20:08:41.812988 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-871fdaf7-206c-4ffd-a73e-cf8b827853c4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:08:41.813925 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-871fdaf7-206c-4ffd-a73e-cf8b827853c4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:08:41.820227 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-871fdaf7-206c-4ffd-a73e-cf8b827853c4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:41.820686 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-871fdaf7-206c-4ffd-a73e-cf8b827853c4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:41.821457 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-871fdaf7-206c-4ffd-a73e-cf8b827853c4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:41.821926 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-871fdaf7-206c-4ffd-a73e-cf8b827853c4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:41.957431 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-871fdaf7-206c-4ffd-a73e-cf8b827853c4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:41.959789 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 20:08:41.967170 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-871fdaf7-206c-4ffd-a73e-cf8b827853c4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:41.968673 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-871fdaf7-206c-4ffd-a73e-cf8b827853c4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:41.969856 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-871fdaf7-206c-4ffd-a73e-cf8b827853c4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1730 microversion: 2.20 time: 0.160756 Jul 20 20:08:41.970405 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1925/2556] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:08:41 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 20:08:42.988301 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-109c00b7-bf57-45ce-8fad-1e7eddfa157a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:08:42.988994 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-109c00b7-bf57-45ce-8fad-1e7eddfa157a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:08:42.996368 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-109c00b7-bf57-45ce-8fad-1e7eddfa157a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:42.996820 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-109c00b7-bf57-45ce-8fad-1e7eddfa157a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:42.997609 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-109c00b7-bf57-45ce-8fad-1e7eddfa157a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:42.998048 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-109c00b7-bf57-45ce-8fad-1e7eddfa157a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:43.137327 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-109c00b7-bf57-45ce-8fad-1e7eddfa157a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:43.145623 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-109c00b7-bf57-45ce-8fad-1e7eddfa157a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:43.147158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-109c00b7-bf57-45ce-8fad-1e7eddfa157a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:43.148306 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-109c00b7-bf57-45ce-8fad-1e7eddfa157a tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1730 microversion: 2.20 time: 0.163992 Jul 20 20:08:43.148860 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1926/2557] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:08:42 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 20:08:43.153473 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [req-79450a84-b678-4c1b-8f50-1edaed71a8c8 req-f150d0ed-528b-4805-9a8b-6fe177702df4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c5c0c16-97ac-46f6-8a3e-f5440a0d584b", "name": "network-vif-plugged", "status": "completed", "tag": "4d5fe51d-3208-445f-a00e-81057db89aa5"}]} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 20:08:43.161570 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-79450a84-b678-4c1b-8f50-1edaed71a8c8 req-f150d0ed-528b-4805-9a8b-6fe177702df4 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:43.162019 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-79450a84-b678-4c1b-8f50-1edaed71a8c8 req-f150d0ed-528b-4805-9a8b-6fe177702df4 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:43.173346 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.compute.server_external_events [req-79450a84-b678-4c1b-8f50-1edaed71a8c8 req-f150d0ed-528b-4805-9a8b-6fe177702df4 service nova] Creating event network-vif-plugged:4d5fe51d-3208-445f-a00e-81057db89aa5 for instance 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b on hv-cinder-83538 Jul 20 20:08:43.178438 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [req-79450a84-b678-4c1b-8f50-1edaed71a8c8 req-f150d0ed-528b-4805-9a8b-6fe177702df4 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028488 Jul 20 20:08:43.179026 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1927/2558] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 20:08:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 20:08:44.167481 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-f70677d7-06e3-4ae3-bd16-49c71dfb251d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:08:44.168174 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-f70677d7-06e3-4ae3-bd16-49c71dfb251d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:08:44.174431 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f70677d7-06e3-4ae3-bd16-49c71dfb251d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:44.174888 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f70677d7-06e3-4ae3-bd16-49c71dfb251d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:44.175840 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f70677d7-06e3-4ae3-bd16-49c71dfb251d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:44.176447 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f70677d7-06e3-4ae3-bd16-49c71dfb251d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:44.319739 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-f70677d7-06e3-4ae3-bd16-49c71dfb251d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:44.328448 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-f70677d7-06e3-4ae3-bd16-49c71dfb251d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:44.329986 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-f70677d7-06e3-4ae3-bd16-49c71dfb251d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:44.331144 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-f70677d7-06e3-4ae3-bd16-49c71dfb251d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1730 microversion: 2.20 time: 0.168504 Jul 20 20:08:44.331708 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1928/2559] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:08:44 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 20:08:45.350858 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-409eed79-b479-4a75-847c-37a030096e17 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:08:45.351643 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-409eed79-b479-4a75-847c-37a030096e17 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:08:45.361449 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-409eed79-b479-4a75-847c-37a030096e17 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:45.361949 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-409eed79-b479-4a75-847c-37a030096e17 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:45.362753 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-409eed79-b479-4a75-847c-37a030096e17 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:45.363290 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-409eed79-b479-4a75-847c-37a030096e17 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:45.538372 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-409eed79-b479-4a75-847c-37a030096e17 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:45.548535 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-409eed79-b479-4a75-847c-37a030096e17 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:45.551032 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-409eed79-b479-4a75-847c-37a030096e17 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:45.552257 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-409eed79-b479-4a75-847c-37a030096e17 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1730 microversion: 2.20 time: 0.205680 Jul 20 20:08:45.552823 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1929/2560] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:08:45 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1730 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 20:08:46.570586 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a490928b-fb5a-49a5-b799-bc760cee6cf2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:08:46.571153 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a490928b-fb5a-49a5-b799-bc760cee6cf2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:08:46.578351 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a490928b-fb5a-49a5-b799-bc760cee6cf2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:46.578533 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a490928b-fb5a-49a5-b799-bc760cee6cf2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:46.579291 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a490928b-fb5a-49a5-b799-bc760cee6cf2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:08:46.579716 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a490928b-fb5a-49a5-b799-bc760cee6cf2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:08:46.716246 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a490928b-fb5a-49a5-b799-bc760cee6cf2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:46.724466 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a490928b-fb5a-49a5-b799-bc760cee6cf2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:46.725998 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a490928b-fb5a-49a5-b799-bc760cee6cf2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:08:46.727136 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a490928b-fb5a-49a5-b799-bc760cee6cf2 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1717 microversion: 2.20 time: 0.160526 Jul 20 20:08:46.727687 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1930/2561] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:08:46 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1717 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 20:09:42.212635 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-18d02cbe-c0c2-4ec7-9219-c9710b84ece6 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:09:42.213321 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-18d02cbe-c0c2-4ec7-9219-c9710b84ece6 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: a3e49f4d-dcea-4c1a-a023-0885718d2e54] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:09:42.215361 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_api:SELECT=47 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 20:09:42.216013 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=27 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 20:09:42.221965 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-18d02cbe-c0c2-4ec7-9219-c9710b84ece6 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:09:42.222414 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-18d02cbe-c0c2-4ec7-9219-c9710b84ece6 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:09:42.223165 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-18d02cbe-c0c2-4ec7-9219-c9710b84ece6 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:09:42.223596 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-18d02cbe-c0c2-4ec7-9219-c9710b84ece6 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:09:42.247211 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-18d02cbe-c0c2-4ec7-9219-c9710b84ece6 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/a3e49f4d-dcea-4c1a-a023-0885718d2e54/ips" status: 200 len: 151 microversion: 2.1 time: 0.038568 Jul 20 20:09:42.247771 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1931/2562] 10.222.0.69 () {58 vars in 1247 bytes} [Wed Jul 20 20:09:42 2022] GET /compute/v2.1/servers/a3e49f4d-dcea-4c1a-a023-0885718d2e54/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 20:09:43.555456 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d14cb7aa-14e3-4fc5-bb9e-2746529c0437 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2a3736f1-eee8-4aac-994d-4cb9e651e428"}} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 20:09:43.556535 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d14cb7aa-14e3-4fc5-bb9e-2746529c0437 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: a3e49f4d-dcea-4c1a-a023-0885718d2e54] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:09:43.563101 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d14cb7aa-14e3-4fc5-bb9e-2746529c0437 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:09:43.563550 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d14cb7aa-14e3-4fc5-bb9e-2746529c0437 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:09:43.564307 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d14cb7aa-14e3-4fc5-bb9e-2746529c0437 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:09:43.564739 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d14cb7aa-14e3-4fc5-bb9e-2746529c0437 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:09:43.804981 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d14cb7aa-14e3-4fc5-bb9e-2746529c0437 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "POST /compute/v2.1/servers/a3e49f4d-dcea-4c1a-a023-0885718d2e54/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253259 Jul 20 20:09:43.805781 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1932/2563] 10.222.0.69 () {60 vars in 1322 bytes} [Wed Jul 20 20:09:43 2022] POST /compute/v2.1/servers/a3e49f4d-dcea-4c1a-a023-0885718d2e54/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 20:09:51.383246 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-3dbe6d98-94fb-4793-985d-f2fce2f21ead tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:09:51.383804 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-3dbe6d98-94fb-4793-985d-f2fce2f21ead tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: a3e49f4d-dcea-4c1a-a023-0885718d2e54] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:09:51.390418 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3dbe6d98-94fb-4793-985d-f2fce2f21ead tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:09:51.390865 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3dbe6d98-94fb-4793-985d-f2fce2f21ead tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:09:51.391620 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3dbe6d98-94fb-4793-985d-f2fce2f21ead tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:09:51.392054 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3dbe6d98-94fb-4793-985d-f2fce2f21ead tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:09:51.471302 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.objects.instance [None req-3dbe6d98-94fb-4793-985d-f2fce2f21ead tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lazy-loading 'services' on Instance uuid a3e49f4d-dcea-4c1a-a023-0885718d2e54 {{(pid=117761) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 20:09:51.545872 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-3dbe6d98-94fb-4793-985d-f2fce2f21ead tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "DELETE /compute/v2.1/servers/a3e49f4d-dcea-4c1a-a023-0885718d2e54/os-volume_attachments/2a3736f1-eee8-4aac-994d-4cb9e651e428" status: 202 len: 0 microversion: 2.1 time: 0.166584 Jul 20 20:09:51.546686 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1933/2564] 10.222.0.69 () {58 vars in 1415 bytes} [Wed Jul 20 20:09:51 2022] DELETE /compute/v2.1/servers/a3e49f4d-dcea-4c1a-a023-0885718d2e54/os-volume_attachments/2a3736f1-eee8-4aac-994d-4cb9e651e428 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 20:09:51.555450 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d170f7d5-ae18-4f2b-99fe-888f4a570f7a tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:09:51.556517 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d170f7d5-ae18-4f2b-99fe-888f4a570f7a tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: a3e49f4d-dcea-4c1a-a023-0885718d2e54] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:09:51.563257 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d170f7d5-ae18-4f2b-99fe-888f4a570f7a tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:09:51.563831 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d170f7d5-ae18-4f2b-99fe-888f4a570f7a tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:09:51.564644 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d170f7d5-ae18-4f2b-99fe-888f4a570f7a tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:09:51.565110 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d170f7d5-ae18-4f2b-99fe-888f4a570f7a tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:09:51.598183 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d170f7d5-ae18-4f2b-99fe-888f4a570f7a tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/a3e49f4d-dcea-4c1a-a023-0885718d2e54/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046700 Jul 20 20:09:51.598737 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1934/2565] 10.222.0.69 () {58 vars in 1301 bytes} [Wed Jul 20 20:09:51 2022] GET /compute/v2.1/servers/a3e49f4d-dcea-4c1a-a023-0885718d2e54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 20:09:52.610710 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-1f033942-50f4-43ef-9081-808562789f7c tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:09:52.611548 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-1f033942-50f4-43ef-9081-808562789f7c tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: a3e49f4d-dcea-4c1a-a023-0885718d2e54] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:09:52.618640 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1f033942-50f4-43ef-9081-808562789f7c tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:09:52.619092 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1f033942-50f4-43ef-9081-808562789f7c tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:09:52.619847 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1f033942-50f4-43ef-9081-808562789f7c tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:09:52.620280 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1f033942-50f4-43ef-9081-808562789f7c tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:09:52.647791 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-1f033942-50f4-43ef-9081-808562789f7c tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/a3e49f4d-dcea-4c1a-a023-0885718d2e54/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041103 Jul 20 20:09:52.648343 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1935/2566] 10.222.0.69 () {58 vars in 1301 bytes} [Wed Jul 20 20:09:52 2022] GET /compute/v2.1/servers/a3e49f4d-dcea-4c1a-a023-0885718d2e54/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 20:09:52.704494 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e6c9257c-4fce-416e-9df2-6cd02f278605 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:09:52.704965 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e6c9257c-4fce-416e-9df2-6cd02f278605 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: a3e49f4d-dcea-4c1a-a023-0885718d2e54] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:09:52.711671 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e6c9257c-4fce-416e-9df2-6cd02f278605 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:09:52.712125 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e6c9257c-4fce-416e-9df2-6cd02f278605 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:09:52.712890 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e6c9257c-4fce-416e-9df2-6cd02f278605 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:09:52.713326 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e6c9257c-4fce-416e-9df2-6cd02f278605 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:09:52.738677 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e6c9257c-4fce-416e-9df2-6cd02f278605 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: a3e49f4d-dcea-4c1a-a023-0885718d2e54] Going to try to terminate instance {{(pid=117761) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 20:09:52.814485 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e6c9257c-4fce-416e-9df2-6cd02f278605 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "DELETE /compute/v2.1/servers/a3e49f4d-dcea-4c1a-a023-0885718d2e54" status: 204 len: 0 microversion: 2.1 time: 0.113444 Jul 20 20:09:52.815115 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1936/2567] 10.222.0.69 () {58 vars in 1238 bytes} [Wed Jul 20 20:09:52 2022] DELETE /compute/v2.1/servers/a3e49f4d-dcea-4c1a-a023-0885718d2e54 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 20:09:52.823307 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-2e012dcc-59db-4bf7-97ee-3a8facc29316 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:09:52.823992 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-2e012dcc-59db-4bf7-97ee-3a8facc29316 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: a3e49f4d-dcea-4c1a-a023-0885718d2e54] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:09:52.829653 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2e012dcc-59db-4bf7-97ee-3a8facc29316 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:09:52.830096 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2e012dcc-59db-4bf7-97ee-3a8facc29316 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:09:52.830835 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2e012dcc-59db-4bf7-97ee-3a8facc29316 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:09:52.831260 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-2e012dcc-59db-4bf7-97ee-3a8facc29316 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:09:52.959992 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-2e012dcc-59db-4bf7-97ee-3a8facc29316 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1cf9b55ce04cf997bf23ad73222814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b576df300148ad8d8d7dd3f8335f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:09:52.967434 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-2e012dcc-59db-4bf7-97ee-3a8facc29316 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/a3e49f4d-dcea-4c1a-a023-0885718d2e54" status: 200 len: 1683 microversion: 2.1 time: 0.148015 Jul 20 20:09:52.967992 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1937/2568] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:09:52 2022] GET /compute/v2.1/servers/a3e49f4d-dcea-4c1a-a023-0885718d2e54 => generated 1683 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:09:53.985273 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-10859f4f-2b60-4901-82b6-0e7d05ded777 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:09:53.985924 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-10859f4f-2b60-4901-82b6-0e7d05ded777 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: a3e49f4d-dcea-4c1a-a023-0885718d2e54] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:09:53.993682 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-10859f4f-2b60-4901-82b6-0e7d05ded777 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:09:53.994136 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-10859f4f-2b60-4901-82b6-0e7d05ded777 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:09:53.994898 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-10859f4f-2b60-4901-82b6-0e7d05ded777 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:09:53.995364 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-10859f4f-2b60-4901-82b6-0e7d05ded777 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:09:54.125323 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-10859f4f-2b60-4901-82b6-0e7d05ded777 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1cf9b55ce04cf997bf23ad73222814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b576df300148ad8d8d7dd3f8335f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:09:54.132834 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-10859f4f-2b60-4901-82b6-0e7d05ded777 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/a3e49f4d-dcea-4c1a-a023-0885718d2e54" status: 200 len: 1683 microversion: 2.1 time: 0.151412 Jul 20 20:09:54.133394 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1938/2569] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:09:53 2022] GET /compute/v2.1/servers/a3e49f4d-dcea-4c1a-a023-0885718d2e54 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:09:55.150194 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-77f86098-e794-4d24-98b3-ae50b7df1a51 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:09:55.150805 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-77f86098-e794-4d24-98b3-ae50b7df1a51 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: a3e49f4d-dcea-4c1a-a023-0885718d2e54] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:09:55.157182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-77f86098-e794-4d24-98b3-ae50b7df1a51 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:09:55.157682 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-77f86098-e794-4d24-98b3-ae50b7df1a51 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:09:55.158442 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-77f86098-e794-4d24-98b3-ae50b7df1a51 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:09:55.158870 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-77f86098-e794-4d24-98b3-ae50b7df1a51 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:09:55.381157 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-77f86098-e794-4d24-98b3-ae50b7df1a51 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1cf9b55ce04cf997bf23ad73222814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b576df300148ad8d8d7dd3f8335f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:09:55.388700 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-77f86098-e794-4d24-98b3-ae50b7df1a51 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/a3e49f4d-dcea-4c1a-a023-0885718d2e54" status: 200 len: 1683 microversion: 2.1 time: 0.242982 Jul 20 20:09:55.389278 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1939/2570] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:09:55 2022] GET /compute/v2.1/servers/a3e49f4d-dcea-4c1a-a023-0885718d2e54 => generated 1683 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:09:56.030843 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [req-7993f42b-31b5-4881-8292-8adb06d6827b req-d2c38df7-f8a4-4681-b9ef-e83cbe1e30e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3e49f4d-dcea-4c1a-a023-0885718d2e54", "name": "network-vif-deleted", "tag": "43e2539a-bd3e-42cc-9cd3-24dd413449cf"}]} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 20:09:56.039982 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-7993f42b-31b5-4881-8292-8adb06d6827b req-d2c38df7-f8a4-4681-b9ef-e83cbe1e30e4 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:09:56.040418 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-7993f42b-31b5-4881-8292-8adb06d6827b req-d2c38df7-f8a4-4681-b9ef-e83cbe1e30e4 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:09:56.053434 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.compute.server_external_events [req-7993f42b-31b5-4881-8292-8adb06d6827b req-d2c38df7-f8a4-4681-b9ef-e83cbe1e30e4 service nova] Creating event network-vif-deleted:43e2539a-bd3e-42cc-9cd3-24dd413449cf for instance a3e49f4d-dcea-4c1a-a023-0885718d2e54 on hv-cinder-83538 Jul 20 20:09:56.058674 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [req-7993f42b-31b5-4881-8292-8adb06d6827b req-d2c38df7-f8a4-4681-b9ef-e83cbe1e30e4 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.244559 Jul 20 20:09:56.059274 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1940/2571] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 20:09:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 20:09:56.406633 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-5cdbdd52-7e43-4cf3-8ee0-76f78d9b168c tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:09:56.407334 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-5cdbdd52-7e43-4cf3-8ee0-76f78d9b168c tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: a3e49f4d-dcea-4c1a-a023-0885718d2e54] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:09:56.413690 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5cdbdd52-7e43-4cf3-8ee0-76f78d9b168c tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:09:56.414144 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5cdbdd52-7e43-4cf3-8ee0-76f78d9b168c tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:09:56.414938 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5cdbdd52-7e43-4cf3-8ee0-76f78d9b168c tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:09:56.415371 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5cdbdd52-7e43-4cf3-8ee0-76f78d9b168c tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:09:56.428633 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.wsgi [None req-5cdbdd52-7e43-4cf3-8ee0-76f78d9b168c tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] HTTP exception thrown: Instance a3e49f4d-dcea-4c1a-a023-0885718d2e54 could not be found. Jul 20 20:09:56.430293 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-5cdbdd52-7e43-4cf3-8ee0-76f78d9b168c tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Request method failure captured: Jul 20 20:09:56.430293 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: GET /compute/v2.1/servers/a3e49f4d-dcea-4c1a-a023-0885718d2e54 HTTP/1.1 Jul 20 20:09:56.430293 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 20:09:56.430293 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 20:09:56.430293 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 20:09:56.430293 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 0 Jul 20 20:09:56.430293 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 20:09:56.430293 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 20:09:56.430293 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 20:09:56.430293 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 20:09:56.430293 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2F8F6Ge10hBXuhDa0NLuoIQGKdCbH_-0Qytzgx2TiuDpG5vxQ-IW-4WPHWLIEm2lkY4j4eRPFcsjkcnP9w_FRJ3X-P89qM9tliQWnJkm78fASQt3Z_jz-B1-QjBfFR7l1gMla2jtR2bkXlUlscrWVmnS7NtJkSS_8OjKqGZtvWPk5Iw Jul 20 20:09:56.430293 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 20:09:56.430293 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 20:09:56.430293 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 20:09:56.430293 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 20:09:56.430293 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 20:09:56.430293 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 20:09:56.430293 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: b2b576df300148ad8d8d7dd3f8335f8e Jul 20 20:09:56.430293 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-AttachVolumeNegativeTest-1904845904 Jul 20 20:09:56.430293 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 20:09:56.430293 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 20:09:56.431403 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b2b576df300148ad8d8d7dd3f8335f8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b2b576df300148ad8d8d7dd3f8335f8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_b2b576df300148ad8d8d7dd3f8335f8e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/b2b576df300148ad8d8d7dd3f8335f8e"}]}] Jul 20 20:09:56.431403 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-AttachVolumeNegativeTest-1904845904 Jul 20 20:09:56.431403 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: b2b576df300148ad8d8d7dd3f8335f8e Jul 20 20:09:56.431403 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1904845904 Jul 20 20:09:56.431403 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-AttachVolumeNegativeTest-1904845904-project Jul 20 20:09:56.431403 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 20:09:56.431403 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 20:09:56.431403 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: 0d1cf9b55ce04cf997bf23ad73222814 Jul 20 20:09:56.431403 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-AttachVolumeNegativeTest-1904845904-project Jul 20 20:09:56.431403 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: > Jul 20 20:09:56.431403 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Instance a3e49f4d-dcea-4c1a-a023-0885718d2e54 could not be found. Jul 20 20:09:56.431403 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'id': 'a3e49f4d-dcea-4c1a-a023-0885718d2e54'} Jul 20 20:09:56.432127 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 20:09:56.432127 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:09:56.432127 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 20:09:56.432127 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 20:09:56.432127 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 20:09:56.432127 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 20:09:56.432127 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 20:09:56.432127 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 20:09:56.432127 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 20:09:56.432127 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 20:09:56.432127 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3e49f4d-dcea-4c1a-a023-0885718d2e54 could not be found. Jul 20 20:09:56.432127 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:09:56.432127 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:09:56.432127 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:09:56.432127 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:09:56.432127 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:09:56.432127 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:09:56.432127 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 20:09:56.432127 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 20:09:56.432127 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 20:09:56.433158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 20:09:56.433158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 20:09:56.433158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 20:09:56.433158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 20:09:56.433158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 20:09:56.433158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 20:09:56.433158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 20:09:56.433158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3e49f4d-dcea-4c1a-a023-0885718d2e54 could not be found. Jul 20 20:09:56.433158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:09:56.433158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:09:56.433158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:09:56.433158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:09:56.433158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:09:56.433158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:09:56.433158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 20:09:56.433158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 20:09:56.433158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3e49f4d-dcea-4c1a-a023-0885718d2e54 could not be found. Jul 20 20:09:56.433158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:09:56.434112 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-5cdbdd52-7e43-4cf3-8ee0-76f78d9b168c tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Returning 404 to user: Instance a3e49f4d-dcea-4c1a-a023-0885718d2e54 could not be found. {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 20:09:56.434112 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-5cdbdd52-7e43-4cf3-8ee0-76f78d9b168c tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/a3e49f4d-dcea-4c1a-a023-0885718d2e54" status: 404 len: 111 microversion: 2.1 time: 0.029887 Jul 20 20:09:56.434112 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1941/2572] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:09:56 2022] GET /compute/v2.1/servers/a3e49f4d-dcea-4c1a-a023-0885718d2e54 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 20:09:56.440139 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4bd1881f-5867-4ccf-ac64-580f62efa3db tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '.version_select at 0x7ff60e8beee0>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:09:56.458538 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-4bd1881f-5867-4ccf-ac64-580f62efa3db tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1121810295" status: 202 len: 0 microversion: 2.1 time: 0.021876 Jul 20 20:09:56.459777 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1942/2573] 10.222.0.69 () {58 vars in 1220 bytes} [Wed Jul 20 20:09:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1121810295 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 20:09:58.226783 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-1c803c14-6fd4-491f-83e2-bc979593bc6b tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:09:58.227337 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-1c803c14-6fd4-491f-83e2-bc979593bc6b tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: a3e49f4d-dcea-4c1a-a023-0885718d2e54] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:09:58.234714 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1c803c14-6fd4-491f-83e2-bc979593bc6b tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:09:58.235166 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1c803c14-6fd4-491f-83e2-bc979593bc6b tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:09:58.235921 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1c803c14-6fd4-491f-83e2-bc979593bc6b tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:09:58.236363 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1c803c14-6fd4-491f-83e2-bc979593bc6b tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:09:58.250075 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.wsgi [None req-1c803c14-6fd4-491f-83e2-bc979593bc6b tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] HTTP exception thrown: Instance a3e49f4d-dcea-4c1a-a023-0885718d2e54 could not be found. Jul 20 20:09:58.251631 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-1c803c14-6fd4-491f-83e2-bc979593bc6b tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Request method failure captured: Jul 20 20:09:58.251631 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: DELETE /compute/v2.1/servers/a3e49f4d-dcea-4c1a-a023-0885718d2e54 HTTP/1.1 Jul 20 20:09:58.251631 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 20:09:58.251631 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 20:09:58.251631 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 20:09:58.251631 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 0 Jul 20 20:09:58.251631 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 20:09:58.251631 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 20:09:58.251631 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 20:09:58.251631 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 20:09:58.251631 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2F8F6Ge10hBXuhDa0NLuoIQGKdCbH_-0Qytzgx2TiuDpG5vxQ-IW-4WPHWLIEm2lkY4j4eRPFcsjkcnP9w_FRJ3X-P89qM9tliQWnJkm78fASQt3Z_jz-B1-QjBfFR7l1gMla2jtR2bkXlUlscrWVmnS7NtJkSS_8OjKqGZtvWPk5Iw Jul 20 20:09:58.251631 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 20:09:58.251631 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 20:09:58.251631 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 20:09:58.251631 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 20:09:58.251631 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 20:09:58.251631 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 20:09:58.251631 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: b2b576df300148ad8d8d7dd3f8335f8e Jul 20 20:09:58.251631 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-AttachVolumeNegativeTest-1904845904 Jul 20 20:09:58.251631 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 20:09:58.251631 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 20:09:58.252693 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b2b576df300148ad8d8d7dd3f8335f8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b2b576df300148ad8d8d7dd3f8335f8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_b2b576df300148ad8d8d7dd3f8335f8e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/b2b576df300148ad8d8d7dd3f8335f8e"}]}] Jul 20 20:09:58.252693 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-AttachVolumeNegativeTest-1904845904 Jul 20 20:09:58.252693 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: b2b576df300148ad8d8d7dd3f8335f8e Jul 20 20:09:58.252693 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1904845904 Jul 20 20:09:58.252693 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-AttachVolumeNegativeTest-1904845904-project Jul 20 20:09:58.252693 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 20:09:58.252693 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 20:09:58.252693 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: 0d1cf9b55ce04cf997bf23ad73222814 Jul 20 20:09:58.252693 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-AttachVolumeNegativeTest-1904845904-project Jul 20 20:09:58.252693 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: > Jul 20 20:09:58.252693 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Instance a3e49f4d-dcea-4c1a-a023-0885718d2e54 could not be found. Jul 20 20:09:58.252693 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'id': 'a3e49f4d-dcea-4c1a-a023-0885718d2e54'} Jul 20 20:09:58.253256 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 20:09:58.253256 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:09:58.253256 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 20:09:58.253256 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 20:09:58.253256 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 20:09:58.253256 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 20:09:58.253256 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 20:09:58.253256 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 20:09:58.253256 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 20:09:58.253256 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 20:09:58.253256 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3e49f4d-dcea-4c1a-a023-0885718d2e54 could not be found. Jul 20 20:09:58.253256 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:09:58.253256 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:09:58.253256 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:09:58.253256 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:09:58.253256 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:09:58.253256 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:09:58.253256 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 20:09:58.253256 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 20:09:58.253256 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 20:09:58.254227 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 20:09:58.254227 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 20:09:58.254227 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 20:09:58.254227 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 20:09:58.254227 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 20:09:58.254227 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 20:09:58.254227 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 20:09:58.254227 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 20:09:58.254227 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 20:09:58.254227 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3e49f4d-dcea-4c1a-a023-0885718d2e54 could not be found. Jul 20 20:09:58.254227 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:09:58.254227 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:09:58.254227 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:09:58.254227 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:09:58.254227 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:09:58.254227 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:09:58.254227 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 20:09:58.254227 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 20:09:58.254227 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3e49f4d-dcea-4c1a-a023-0885718d2e54 could not be found. Jul 20 20:09:58.254227 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:09:58.255393 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-1c803c14-6fd4-491f-83e2-bc979593bc6b tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Returning 404 to user: Instance a3e49f4d-dcea-4c1a-a023-0885718d2e54 could not be found. {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 20:09:58.255393 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-1c803c14-6fd4-491f-83e2-bc979593bc6b tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "DELETE /compute/v2.1/servers/a3e49f4d-dcea-4c1a-a023-0885718d2e54" status: 404 len: 111 microversion: 2.1 time: 0.030206 Jul 20 20:09:58.255393 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1943/2574] 10.222.0.69 () {58 vars in 1238 bytes} [Wed Jul 20 20:09:58 2022] DELETE /compute/v2.1/servers/a3e49f4d-dcea-4c1a-a023-0885718d2e54 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 20:09:58.261427 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-f865b970-7b2a-4954-b6f5-550b1294689c tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:09:58.262119 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-f865b970-7b2a-4954-b6f5-550b1294689c tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: a3e49f4d-dcea-4c1a-a023-0885718d2e54] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:09:58.267719 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f865b970-7b2a-4954-b6f5-550b1294689c tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:09:58.268164 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f865b970-7b2a-4954-b6f5-550b1294689c tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:09:58.268907 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f865b970-7b2a-4954-b6f5-550b1294689c tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:09:58.269339 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f865b970-7b2a-4954-b6f5-550b1294689c tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:09:58.282160 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.wsgi [None req-f865b970-7b2a-4954-b6f5-550b1294689c tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] HTTP exception thrown: Instance a3e49f4d-dcea-4c1a-a023-0885718d2e54 could not be found. Jul 20 20:09:58.283618 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-f865b970-7b2a-4954-b6f5-550b1294689c tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Request method failure captured: Jul 20 20:09:58.283618 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: GET /compute/v2.1/servers/a3e49f4d-dcea-4c1a-a023-0885718d2e54 HTTP/1.1 Jul 20 20:09:58.283618 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 20:09:58.283618 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 20:09:58.283618 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 20:09:58.283618 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 0 Jul 20 20:09:58.283618 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 20:09:58.283618 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 20:09:58.283618 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 20:09:58.283618 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 20:09:58.283618 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2F8F6Ge10hBXuhDa0NLuoIQGKdCbH_-0Qytzgx2TiuDpG5vxQ-IW-4WPHWLIEm2lkY4j4eRPFcsjkcnP9w_FRJ3X-P89qM9tliQWnJkm78fASQt3Z_jz-B1-QjBfFR7l1gMla2jtR2bkXlUlscrWVmnS7NtJkSS_8OjKqGZtvWPk5Iw Jul 20 20:09:58.283618 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 20:09:58.283618 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 20:09:58.283618 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 20:09:58.283618 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 20:09:58.283618 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 20:09:58.283618 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 20:09:58.283618 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: b2b576df300148ad8d8d7dd3f8335f8e Jul 20 20:09:58.283618 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-AttachVolumeNegativeTest-1904845904 Jul 20 20:09:58.283618 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 20:09:58.283618 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 20:09:58.284821 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b2b576df300148ad8d8d7dd3f8335f8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b2b576df300148ad8d8d7dd3f8335f8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_b2b576df300148ad8d8d7dd3f8335f8e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/b2b576df300148ad8d8d7dd3f8335f8e"}]}] Jul 20 20:09:58.284821 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-AttachVolumeNegativeTest-1904845904 Jul 20 20:09:58.284821 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: b2b576df300148ad8d8d7dd3f8335f8e Jul 20 20:09:58.284821 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1904845904 Jul 20 20:09:58.284821 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-AttachVolumeNegativeTest-1904845904-project Jul 20 20:09:58.284821 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 20:09:58.284821 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 20:09:58.284821 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: 0d1cf9b55ce04cf997bf23ad73222814 Jul 20 20:09:58.284821 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-AttachVolumeNegativeTest-1904845904-project Jul 20 20:09:58.284821 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: > Jul 20 20:09:58.284821 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Instance a3e49f4d-dcea-4c1a-a023-0885718d2e54 could not be found. Jul 20 20:09:58.284821 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'id': 'a3e49f4d-dcea-4c1a-a023-0885718d2e54'} Jul 20 20:09:58.285557 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 20:09:58.285557 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:09:58.285557 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 20:09:58.285557 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 20:09:58.285557 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 20:09:58.285557 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 20:09:58.285557 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 20:09:58.285557 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 20:09:58.285557 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 20:09:58.285557 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 20:09:58.285557 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3e49f4d-dcea-4c1a-a023-0885718d2e54 could not be found. Jul 20 20:09:58.285557 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:09:58.285557 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:09:58.285557 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:09:58.285557 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:09:58.285557 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:09:58.285557 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:09:58.285557 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 20:09:58.285557 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 20:09:58.285557 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 20:09:58.286708 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 20:09:58.286708 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 20:09:58.286708 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 20:09:58.286708 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 20:09:58.286708 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 20:09:58.286708 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 20:09:58.286708 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 20:09:58.286708 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3e49f4d-dcea-4c1a-a023-0885718d2e54 could not be found. Jul 20 20:09:58.286708 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:09:58.286708 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:09:58.286708 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:09:58.286708 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:09:58.286708 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:09:58.286708 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:09:58.286708 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 20:09:58.286708 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 20:09:58.286708 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3e49f4d-dcea-4c1a-a023-0885718d2e54 could not be found. Jul 20 20:09:58.286708 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:09:58.287729 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-f865b970-7b2a-4954-b6f5-550b1294689c tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Returning 404 to user: Instance a3e49f4d-dcea-4c1a-a023-0885718d2e54 could not be found. {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 20:09:58.287729 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-f865b970-7b2a-4954-b6f5-550b1294689c tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/a3e49f4d-dcea-4c1a-a023-0885718d2e54" status: 404 len: 111 microversion: 2.1 time: 0.026932 Jul 20 20:09:58.287729 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1944/2575] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:09:58 2022] GET /compute/v2.1/servers/a3e49f4d-dcea-4c1a-a023-0885718d2e54 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 20:09:59.420465 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-39e51e76-f3c2-4c6f-bf73-13370ffad541 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:09:59.421106 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-39e51e76-f3c2-4c6f-bf73-13370ffad541 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: dce310ab-07be-49b9-a207-5d3f22f7b679] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:09:59.427438 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-39e51e76-f3c2-4c6f-bf73-13370ffad541 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:09:59.427970 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-39e51e76-f3c2-4c6f-bf73-13370ffad541 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:09:59.428770 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-39e51e76-f3c2-4c6f-bf73-13370ffad541 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:09:59.429211 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-39e51e76-f3c2-4c6f-bf73-13370ffad541 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:09:59.442346 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.wsgi [None req-39e51e76-f3c2-4c6f-bf73-13370ffad541 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] HTTP exception thrown: Instance dce310ab-07be-49b9-a207-5d3f22f7b679 could not be found. Jul 20 20:09:59.444477 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-39e51e76-f3c2-4c6f-bf73-13370ffad541 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Request method failure captured: Jul 20 20:09:59.444477 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: DELETE /compute/v2.1/servers/dce310ab-07be-49b9-a207-5d3f22f7b679 HTTP/1.1 Jul 20 20:09:59.444477 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 20:09:59.444477 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 20:09:59.444477 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 20:09:59.444477 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 0 Jul 20 20:09:59.444477 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 20:09:59.444477 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 20:09:59.444477 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 20:09:59.444477 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 20:09:59.444477 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2F8F6Ge10hBXuhDa0NLuoIQGKdCbH_-0Qytzgx2TiuDpG5vxQ-IW-4WPHWLIEm2lkY4j4eRPFcsjkcnP9w_FRJ3X-P89qM9tliQWnJkm78fASQt3Z_jz-B1-QjBfFR7l1gMla2jtR2bkXlUlscrWVmnS7NtJkSS_8OjKqGZtvWPk5Iw Jul 20 20:09:59.444477 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 20:09:59.444477 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 20:09:59.444477 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 20:09:59.444477 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 20:09:59.444477 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 20:09:59.444477 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 20:09:59.444477 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: b2b576df300148ad8d8d7dd3f8335f8e Jul 20 20:09:59.444477 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-AttachVolumeNegativeTest-1904845904 Jul 20 20:09:59.444477 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 20:09:59.444477 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 20:09:59.445852 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b2b576df300148ad8d8d7dd3f8335f8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b2b576df300148ad8d8d7dd3f8335f8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_b2b576df300148ad8d8d7dd3f8335f8e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/b2b576df300148ad8d8d7dd3f8335f8e"}]}] Jul 20 20:09:59.445852 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-AttachVolumeNegativeTest-1904845904 Jul 20 20:09:59.445852 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: b2b576df300148ad8d8d7dd3f8335f8e Jul 20 20:09:59.445852 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1904845904 Jul 20 20:09:59.445852 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-AttachVolumeNegativeTest-1904845904-project Jul 20 20:09:59.445852 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 20:09:59.445852 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 20:09:59.445852 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: 0d1cf9b55ce04cf997bf23ad73222814 Jul 20 20:09:59.445852 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-AttachVolumeNegativeTest-1904845904-project Jul 20 20:09:59.445852 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: > Jul 20 20:09:59.445852 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Instance dce310ab-07be-49b9-a207-5d3f22f7b679 could not be found. Jul 20 20:09:59.445852 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'id': 'dce310ab-07be-49b9-a207-5d3f22f7b679'} Jul 20 20:09:59.446637 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 20:09:59.446637 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:09:59.446637 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 20:09:59.446637 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 20:09:59.446637 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 20:09:59.446637 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 20:09:59.446637 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 20:09:59.446637 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 20:09:59.446637 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 20:09:59.446637 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 20:09:59.446637 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dce310ab-07be-49b9-a207-5d3f22f7b679 could not be found. Jul 20 20:09:59.446637 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:09:59.446637 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:09:59.446637 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:09:59.446637 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:09:59.446637 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:09:59.446637 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:09:59.446637 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 20:09:59.446637 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 20:09:59.446637 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 20:09:59.447661 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 20:09:59.447661 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 20:09:59.447661 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 20:09:59.447661 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 20:09:59.447661 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 20:09:59.447661 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 20:09:59.447661 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 20:09:59.447661 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 20:09:59.447661 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 20:09:59.447661 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dce310ab-07be-49b9-a207-5d3f22f7b679 could not be found. Jul 20 20:09:59.447661 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:09:59.447661 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:09:59.447661 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:09:59.447661 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:09:59.447661 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:09:59.447661 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:09:59.447661 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 20:09:59.447661 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 20:09:59.447661 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dce310ab-07be-49b9-a207-5d3f22f7b679 could not be found. Jul 20 20:09:59.447661 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:09:59.448620 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-39e51e76-f3c2-4c6f-bf73-13370ffad541 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Returning 404 to user: Instance dce310ab-07be-49b9-a207-5d3f22f7b679 could not be found. {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 20:09:59.448620 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-39e51e76-f3c2-4c6f-bf73-13370ffad541 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "DELETE /compute/v2.1/servers/dce310ab-07be-49b9-a207-5d3f22f7b679" status: 404 len: 111 microversion: 2.1 time: 0.029239 Jul 20 20:09:59.448620 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1945/2576] 10.222.0.69 () {58 vars in 1238 bytes} [Wed Jul 20 20:09:59 2022] DELETE /compute/v2.1/servers/dce310ab-07be-49b9-a207-5d3f22f7b679 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 20:09:59.453626 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4e12907c-e4ff-4b8d-aff8-26d2b0c29f98 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:09:59.454224 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-4e12907c-e4ff-4b8d-aff8-26d2b0c29f98 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: dce310ab-07be-49b9-a207-5d3f22f7b679] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:09:59.460527 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4e12907c-e4ff-4b8d-aff8-26d2b0c29f98 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:09:59.460976 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4e12907c-e4ff-4b8d-aff8-26d2b0c29f98 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:09:59.461751 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4e12907c-e4ff-4b8d-aff8-26d2b0c29f98 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:09:59.462193 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4e12907c-e4ff-4b8d-aff8-26d2b0c29f98 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:09:59.474988 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.wsgi [None req-4e12907c-e4ff-4b8d-aff8-26d2b0c29f98 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] HTTP exception thrown: Instance dce310ab-07be-49b9-a207-5d3f22f7b679 could not be found. Jul 20 20:09:59.476401 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4e12907c-e4ff-4b8d-aff8-26d2b0c29f98 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Request method failure captured: Jul 20 20:09:59.476401 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: GET /compute/v2.1/servers/dce310ab-07be-49b9-a207-5d3f22f7b679 HTTP/1.1 Jul 20 20:09:59.476401 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 20:09:59.476401 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 20:09:59.476401 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 20:09:59.476401 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 0 Jul 20 20:09:59.476401 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 20:09:59.476401 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 20:09:59.476401 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 20:09:59.476401 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 20:09:59.476401 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2F8F6Ge10hBXuhDa0NLuoIQGKdCbH_-0Qytzgx2TiuDpG5vxQ-IW-4WPHWLIEm2lkY4j4eRPFcsjkcnP9w_FRJ3X-P89qM9tliQWnJkm78fASQt3Z_jz-B1-QjBfFR7l1gMla2jtR2bkXlUlscrWVmnS7NtJkSS_8OjKqGZtvWPk5Iw Jul 20 20:09:59.476401 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 20:09:59.476401 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 20:09:59.476401 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 20:09:59.476401 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 20:09:59.476401 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 20:09:59.476401 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 20:09:59.476401 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: b2b576df300148ad8d8d7dd3f8335f8e Jul 20 20:09:59.476401 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-AttachVolumeNegativeTest-1904845904 Jul 20 20:09:59.476401 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 20:09:59.476401 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 20:09:59.477738 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b2b576df300148ad8d8d7dd3f8335f8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b2b576df300148ad8d8d7dd3f8335f8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_b2b576df300148ad8d8d7dd3f8335f8e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/b2b576df300148ad8d8d7dd3f8335f8e"}]}] Jul 20 20:09:59.477738 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-AttachVolumeNegativeTest-1904845904 Jul 20 20:09:59.477738 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: b2b576df300148ad8d8d7dd3f8335f8e Jul 20 20:09:59.477738 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1904845904 Jul 20 20:09:59.477738 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-AttachVolumeNegativeTest-1904845904-project Jul 20 20:09:59.477738 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 20:09:59.477738 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 20:09:59.477738 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: 0d1cf9b55ce04cf997bf23ad73222814 Jul 20 20:09:59.477738 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-AttachVolumeNegativeTest-1904845904-project Jul 20 20:09:59.477738 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: > Jul 20 20:09:59.477738 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Instance dce310ab-07be-49b9-a207-5d3f22f7b679 could not be found. Jul 20 20:09:59.477738 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'id': 'dce310ab-07be-49b9-a207-5d3f22f7b679'} Jul 20 20:09:59.478555 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 20:09:59.478555 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:09:59.478555 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 20:09:59.478555 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 20:09:59.478555 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 20:09:59.478555 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 20:09:59.478555 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 20:09:59.478555 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 20:09:59.478555 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 20:09:59.478555 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 20:09:59.478555 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dce310ab-07be-49b9-a207-5d3f22f7b679 could not be found. Jul 20 20:09:59.478555 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:09:59.478555 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:09:59.478555 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:09:59.478555 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:09:59.478555 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:09:59.478555 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:09:59.478555 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 20:09:59.478555 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 20:09:59.478555 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 20:09:59.480051 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 20:09:59.480051 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 20:09:59.480051 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 20:09:59.480051 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 20:09:59.480051 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 20:09:59.480051 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 20:09:59.480051 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 20:09:59.480051 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dce310ab-07be-49b9-a207-5d3f22f7b679 could not be found. Jul 20 20:09:59.480051 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:09:59.480051 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:09:59.480051 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:09:59.480051 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:09:59.480051 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:09:59.480051 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:09:59.480051 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 20:09:59.480051 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 20:09:59.480051 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dce310ab-07be-49b9-a207-5d3f22f7b679 could not be found. Jul 20 20:09:59.480051 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:09:59.481204 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4e12907c-e4ff-4b8d-aff8-26d2b0c29f98 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Returning 404 to user: Instance dce310ab-07be-49b9-a207-5d3f22f7b679 could not be found. {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 20:09:59.481204 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-4e12907c-e4ff-4b8d-aff8-26d2b0c29f98 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/dce310ab-07be-49b9-a207-5d3f22f7b679" status: 404 len: 111 microversion: 2.1 time: 0.027556 Jul 20 20:09:59.481204 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1946/2577] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:09:59 2022] GET /compute/v2.1/servers/dce310ab-07be-49b9-a207-5d3f22f7b679 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 20:09:59.485494 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a17a8b1c-1800-4356-9da3-a6832e0a4fbf tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:09:59.485996 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a17a8b1c-1800-4356-9da3-a6832e0a4fbf tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: 21f47247-6afa-4d0b-a3aa-3d9e87d114c2] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:09:59.492117 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a17a8b1c-1800-4356-9da3-a6832e0a4fbf tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:09:59.492558 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a17a8b1c-1800-4356-9da3-a6832e0a4fbf tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:09:59.493305 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a17a8b1c-1800-4356-9da3-a6832e0a4fbf tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:09:59.493779 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a17a8b1c-1800-4356-9da3-a6832e0a4fbf tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:09:59.507055 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.wsgi [None req-a17a8b1c-1800-4356-9da3-a6832e0a4fbf tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] HTTP exception thrown: Instance 21f47247-6afa-4d0b-a3aa-3d9e87d114c2 could not be found. Jul 20 20:09:59.508572 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a17a8b1c-1800-4356-9da3-a6832e0a4fbf tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Request method failure captured: Jul 20 20:09:59.508572 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: DELETE /compute/v2.1/servers/21f47247-6afa-4d0b-a3aa-3d9e87d114c2 HTTP/1.1 Jul 20 20:09:59.508572 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 20:09:59.508572 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 20:09:59.508572 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 20:09:59.508572 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 0 Jul 20 20:09:59.508572 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 20:09:59.508572 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 20:09:59.508572 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 20:09:59.508572 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 20:09:59.508572 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2F8F6Ge10hBXuhDa0NLuoIQGKdCbH_-0Qytzgx2TiuDpG5vxQ-IW-4WPHWLIEm2lkY4j4eRPFcsjkcnP9w_FRJ3X-P89qM9tliQWnJkm78fASQt3Z_jz-B1-QjBfFR7l1gMla2jtR2bkXlUlscrWVmnS7NtJkSS_8OjKqGZtvWPk5Iw Jul 20 20:09:59.508572 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 20:09:59.508572 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 20:09:59.508572 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 20:09:59.508572 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 20:09:59.508572 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 20:09:59.508572 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 20:09:59.508572 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: b2b576df300148ad8d8d7dd3f8335f8e Jul 20 20:09:59.508572 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-AttachVolumeNegativeTest-1904845904 Jul 20 20:09:59.508572 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 20:09:59.508572 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 20:09:59.510140 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b2b576df300148ad8d8d7dd3f8335f8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b2b576df300148ad8d8d7dd3f8335f8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_b2b576df300148ad8d8d7dd3f8335f8e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/b2b576df300148ad8d8d7dd3f8335f8e"}]}] Jul 20 20:09:59.510140 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-AttachVolumeNegativeTest-1904845904 Jul 20 20:09:59.510140 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: b2b576df300148ad8d8d7dd3f8335f8e Jul 20 20:09:59.510140 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1904845904 Jul 20 20:09:59.510140 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-AttachVolumeNegativeTest-1904845904-project Jul 20 20:09:59.510140 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 20:09:59.510140 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 20:09:59.510140 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: 0d1cf9b55ce04cf997bf23ad73222814 Jul 20 20:09:59.510140 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-AttachVolumeNegativeTest-1904845904-project Jul 20 20:09:59.510140 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: > Jul 20 20:09:59.510140 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Instance 21f47247-6afa-4d0b-a3aa-3d9e87d114c2 could not be found. Jul 20 20:09:59.510140 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'id': '21f47247-6afa-4d0b-a3aa-3d9e87d114c2'} Jul 20 20:09:59.510919 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 20:09:59.510919 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:09:59.510919 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 20:09:59.510919 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 20:09:59.510919 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 20:09:59.510919 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 20:09:59.510919 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 20:09:59.510919 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 20:09:59.510919 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 20:09:59.510919 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 20:09:59.510919 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21f47247-6afa-4d0b-a3aa-3d9e87d114c2 could not be found. Jul 20 20:09:59.510919 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:09:59.510919 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:09:59.510919 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:09:59.510919 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:09:59.510919 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:09:59.510919 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:09:59.510919 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 20:09:59.510919 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 20:09:59.510919 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 20:09:59.512153 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 20:09:59.512153 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 20:09:59.512153 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 20:09:59.512153 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 20:09:59.512153 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 20:09:59.512153 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 20:09:59.512153 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 20:09:59.512153 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 20:09:59.512153 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 20:09:59.512153 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21f47247-6afa-4d0b-a3aa-3d9e87d114c2 could not be found. Jul 20 20:09:59.512153 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:09:59.512153 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:09:59.512153 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:09:59.512153 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:09:59.512153 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:09:59.512153 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:09:59.512153 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 20:09:59.512153 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 20:09:59.512153 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21f47247-6afa-4d0b-a3aa-3d9e87d114c2 could not be found. Jul 20 20:09:59.512153 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:09:59.513380 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a17a8b1c-1800-4356-9da3-a6832e0a4fbf tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Returning 404 to user: Instance 21f47247-6afa-4d0b-a3aa-3d9e87d114c2 could not be found. {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 20:09:59.513380 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a17a8b1c-1800-4356-9da3-a6832e0a4fbf tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "DELETE /compute/v2.1/servers/21f47247-6afa-4d0b-a3aa-3d9e87d114c2" status: 404 len: 111 microversion: 2.1 time: 0.027748 Jul 20 20:09:59.513380 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1947/2578] 10.222.0.69 () {58 vars in 1238 bytes} [Wed Jul 20 20:09:59 2022] DELETE /compute/v2.1/servers/21f47247-6afa-4d0b-a3aa-3d9e87d114c2 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 20:09:59.517682 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a6981d9c-da45-4599-9da5-8a3a6abc27a8 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:09:59.518280 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a6981d9c-da45-4599-9da5-8a3a6abc27a8 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: 21f47247-6afa-4d0b-a3aa-3d9e87d114c2] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:09:59.524273 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a6981d9c-da45-4599-9da5-8a3a6abc27a8 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:09:59.524724 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a6981d9c-da45-4599-9da5-8a3a6abc27a8 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:09:59.525480 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a6981d9c-da45-4599-9da5-8a3a6abc27a8 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:09:59.525948 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a6981d9c-da45-4599-9da5-8a3a6abc27a8 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:09:59.538780 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.wsgi [None req-a6981d9c-da45-4599-9da5-8a3a6abc27a8 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] HTTP exception thrown: Instance 21f47247-6afa-4d0b-a3aa-3d9e87d114c2 could not be found. Jul 20 20:09:59.540258 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a6981d9c-da45-4599-9da5-8a3a6abc27a8 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Request method failure captured: Jul 20 20:09:59.540258 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: GET /compute/v2.1/servers/21f47247-6afa-4d0b-a3aa-3d9e87d114c2 HTTP/1.1 Jul 20 20:09:59.540258 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 20:09:59.540258 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 20:09:59.540258 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 20:09:59.540258 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 0 Jul 20 20:09:59.540258 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 20:09:59.540258 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 20:09:59.540258 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 20:09:59.540258 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 20:09:59.540258 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2F8F6Ge10hBXuhDa0NLuoIQGKdCbH_-0Qytzgx2TiuDpG5vxQ-IW-4WPHWLIEm2lkY4j4eRPFcsjkcnP9w_FRJ3X-P89qM9tliQWnJkm78fASQt3Z_jz-B1-QjBfFR7l1gMla2jtR2bkXlUlscrWVmnS7NtJkSS_8OjKqGZtvWPk5Iw Jul 20 20:09:59.540258 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 20:09:59.540258 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 20:09:59.540258 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 20:09:59.540258 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 20:09:59.540258 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 20:09:59.540258 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 20:09:59.540258 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: b2b576df300148ad8d8d7dd3f8335f8e Jul 20 20:09:59.540258 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-AttachVolumeNegativeTest-1904845904 Jul 20 20:09:59.540258 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 20:09:59.540258 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 20:09:59.541617 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b2b576df300148ad8d8d7dd3f8335f8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b2b576df300148ad8d8d7dd3f8335f8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_b2b576df300148ad8d8d7dd3f8335f8e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/b2b576df300148ad8d8d7dd3f8335f8e"}]}] Jul 20 20:09:59.541617 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-AttachVolumeNegativeTest-1904845904 Jul 20 20:09:59.541617 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: b2b576df300148ad8d8d7dd3f8335f8e Jul 20 20:09:59.541617 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1904845904 Jul 20 20:09:59.541617 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-AttachVolumeNegativeTest-1904845904-project Jul 20 20:09:59.541617 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 20:09:59.541617 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 20:09:59.541617 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: 0d1cf9b55ce04cf997bf23ad73222814 Jul 20 20:09:59.541617 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-AttachVolumeNegativeTest-1904845904-project Jul 20 20:09:59.541617 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: > Jul 20 20:09:59.541617 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Instance 21f47247-6afa-4d0b-a3aa-3d9e87d114c2 could not be found. Jul 20 20:09:59.541617 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'id': '21f47247-6afa-4d0b-a3aa-3d9e87d114c2'} Jul 20 20:09:59.542310 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 20:09:59.542310 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:09:59.542310 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 20:09:59.542310 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 20:09:59.542310 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 20:09:59.542310 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 20:09:59.542310 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 20:09:59.542310 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 20:09:59.542310 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 20:09:59.542310 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 20:09:59.542310 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21f47247-6afa-4d0b-a3aa-3d9e87d114c2 could not be found. Jul 20 20:09:59.542310 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:09:59.542310 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:09:59.542310 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:09:59.542310 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:09:59.542310 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:09:59.542310 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:09:59.542310 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 20:09:59.542310 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 20:09:59.542310 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 20:09:59.543223 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 20:09:59.543223 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 20:09:59.543223 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 20:09:59.543223 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 20:09:59.543223 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 20:09:59.543223 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 20:09:59.543223 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 20:09:59.543223 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21f47247-6afa-4d0b-a3aa-3d9e87d114c2 could not be found. Jul 20 20:09:59.543223 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:09:59.543223 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:09:59.543223 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:09:59.543223 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:09:59.543223 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:09:59.543223 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:09:59.543223 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 20:09:59.543223 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 20:09:59.543223 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21f47247-6afa-4d0b-a3aa-3d9e87d114c2 could not be found. Jul 20 20:09:59.543223 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:09:59.544045 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a6981d9c-da45-4599-9da5-8a3a6abc27a8 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Returning 404 to user: Instance 21f47247-6afa-4d0b-a3aa-3d9e87d114c2 could not be found. {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 20:09:59.544045 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a6981d9c-da45-4599-9da5-8a3a6abc27a8 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/21f47247-6afa-4d0b-a3aa-3d9e87d114c2" status: 404 len: 111 microversion: 2.1 time: 0.027267 Jul 20 20:09:59.544045 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1948/2579] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:09:59 2022] GET /compute/v2.1/servers/21f47247-6afa-4d0b-a3aa-3d9e87d114c2 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 20:10:00.674850 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-190087a6-0f04-452d-88d3-158b9660daf2 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:10:00.675403 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-190087a6-0f04-452d-88d3-158b9660daf2 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: b3442f69-2ce9-4c5c-b137-e09fa9317e17] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:10:00.682390 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-190087a6-0f04-452d-88d3-158b9660daf2 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:10:00.682833 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-190087a6-0f04-452d-88d3-158b9660daf2 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:10:00.683584 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-190087a6-0f04-452d-88d3-158b9660daf2 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:10:00.684014 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-190087a6-0f04-452d-88d3-158b9660daf2 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:10:00.697333 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.wsgi [None req-190087a6-0f04-452d-88d3-158b9660daf2 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] HTTP exception thrown: Instance b3442f69-2ce9-4c5c-b137-e09fa9317e17 could not be found. Jul 20 20:10:00.698867 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-190087a6-0f04-452d-88d3-158b9660daf2 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Request method failure captured: Jul 20 20:10:00.698867 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: DELETE /compute/v2.1/servers/b3442f69-2ce9-4c5c-b137-e09fa9317e17 HTTP/1.1 Jul 20 20:10:00.698867 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 20:10:00.698867 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 20:10:00.698867 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 20:10:00.698867 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 0 Jul 20 20:10:00.698867 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 20:10:00.698867 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 20:10:00.698867 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 20:10:00.698867 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 20:10:00.698867 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2F8F6Ge10hBXuhDa0NLuoIQGKdCbH_-0Qytzgx2TiuDpG5vxQ-IW-4WPHWLIEm2lkY4j4eRPFcsjkcnP9w_FRJ3X-P89qM9tliQWnJkm78fASQt3Z_jz-B1-QjBfFR7l1gMla2jtR2bkXlUlscrWVmnS7NtJkSS_8OjKqGZtvWPk5Iw Jul 20 20:10:00.698867 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 20:10:00.698867 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 20:10:00.698867 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 20:10:00.698867 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 20:10:00.698867 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 20:10:00.698867 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 20:10:00.698867 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: b2b576df300148ad8d8d7dd3f8335f8e Jul 20 20:10:00.698867 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-AttachVolumeNegativeTest-1904845904 Jul 20 20:10:00.698867 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 20:10:00.698867 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 20:10:00.700202 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b2b576df300148ad8d8d7dd3f8335f8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b2b576df300148ad8d8d7dd3f8335f8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_b2b576df300148ad8d8d7dd3f8335f8e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/b2b576df300148ad8d8d7dd3f8335f8e"}]}] Jul 20 20:10:00.700202 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-AttachVolumeNegativeTest-1904845904 Jul 20 20:10:00.700202 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: b2b576df300148ad8d8d7dd3f8335f8e Jul 20 20:10:00.700202 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1904845904 Jul 20 20:10:00.700202 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-AttachVolumeNegativeTest-1904845904-project Jul 20 20:10:00.700202 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 20:10:00.700202 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 20:10:00.700202 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: 0d1cf9b55ce04cf997bf23ad73222814 Jul 20 20:10:00.700202 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-AttachVolumeNegativeTest-1904845904-project Jul 20 20:10:00.700202 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: > Jul 20 20:10:00.700202 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Instance b3442f69-2ce9-4c5c-b137-e09fa9317e17 could not be found. Jul 20 20:10:00.700202 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'id': 'b3442f69-2ce9-4c5c-b137-e09fa9317e17'} Jul 20 20:10:00.700965 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 20:10:00.700965 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:10:00.700965 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 20:10:00.700965 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 20:10:00.700965 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 20:10:00.700965 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 20:10:00.700965 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 20:10:00.700965 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 20:10:00.700965 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 20:10:00.700965 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 20:10:00.700965 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3442f69-2ce9-4c5c-b137-e09fa9317e17 could not be found. Jul 20 20:10:00.700965 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:10:00.700965 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:10:00.700965 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:10:00.700965 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:10:00.700965 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:10:00.700965 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:10:00.700965 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 20:10:00.700965 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 20:10:00.700965 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 20:10:00.702182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 20:10:00.702182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 20:10:00.702182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 20:10:00.702182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 20:10:00.702182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 20:10:00.702182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 20:10:00.702182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 20:10:00.702182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 20:10:00.702182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 20:10:00.702182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3442f69-2ce9-4c5c-b137-e09fa9317e17 could not be found. Jul 20 20:10:00.702182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:10:00.702182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:10:00.702182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:10:00.702182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:10:00.702182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:10:00.702182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:10:00.702182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 20:10:00.702182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 20:10:00.702182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3442f69-2ce9-4c5c-b137-e09fa9317e17 could not be found. Jul 20 20:10:00.702182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:10:00.703360 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-190087a6-0f04-452d-88d3-158b9660daf2 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Returning 404 to user: Instance b3442f69-2ce9-4c5c-b137-e09fa9317e17 could not be found. {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 20:10:00.703360 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-190087a6-0f04-452d-88d3-158b9660daf2 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "DELETE /compute/v2.1/servers/b3442f69-2ce9-4c5c-b137-e09fa9317e17" status: 404 len: 111 microversion: 2.1 time: 0.029206 Jul 20 20:10:00.703360 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1949/2580] 10.222.0.69 () {58 vars in 1238 bytes} [Wed Jul 20 20:10:00 2022] DELETE /compute/v2.1/servers/b3442f69-2ce9-4c5c-b137-e09fa9317e17 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 20:10:00.708030 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-86824086-5251-4cc5-9112-db3d147bacd0 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:10:00.708621 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-86824086-5251-4cc5-9112-db3d147bacd0 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] [instance: b3442f69-2ce9-4c5c-b137-e09fa9317e17] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:10:00.714331 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-86824086-5251-4cc5-9112-db3d147bacd0 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:10:00.714776 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-86824086-5251-4cc5-9112-db3d147bacd0 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:10:00.715521 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-86824086-5251-4cc5-9112-db3d147bacd0 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:10:00.715951 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-86824086-5251-4cc5-9112-db3d147bacd0 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:10:00.729940 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.wsgi [None req-86824086-5251-4cc5-9112-db3d147bacd0 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] HTTP exception thrown: Instance b3442f69-2ce9-4c5c-b137-e09fa9317e17 could not be found. Jul 20 20:10:00.731498 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-86824086-5251-4cc5-9112-db3d147bacd0 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Request method failure captured: Jul 20 20:10:00.731498 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: GET /compute/v2.1/servers/b3442f69-2ce9-4c5c-b137-e09fa9317e17 HTTP/1.1 Jul 20 20:10:00.731498 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 20:10:00.731498 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 20:10:00.731498 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 20:10:00.731498 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 0 Jul 20 20:10:00.731498 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 20:10:00.731498 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 20:10:00.731498 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 20:10:00.731498 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 20:10:00.731498 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2F8F6Ge10hBXuhDa0NLuoIQGKdCbH_-0Qytzgx2TiuDpG5vxQ-IW-4WPHWLIEm2lkY4j4eRPFcsjkcnP9w_FRJ3X-P89qM9tliQWnJkm78fASQt3Z_jz-B1-QjBfFR7l1gMla2jtR2bkXlUlscrWVmnS7NtJkSS_8OjKqGZtvWPk5Iw Jul 20 20:10:00.731498 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 20:10:00.731498 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 20:10:00.731498 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 20:10:00.731498 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 20:10:00.731498 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 20:10:00.731498 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 20:10:00.731498 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: b2b576df300148ad8d8d7dd3f8335f8e Jul 20 20:10:00.731498 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-AttachVolumeNegativeTest-1904845904 Jul 20 20:10:00.731498 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 20:10:00.731498 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 20:10:00.732788 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b2b576df300148ad8d8d7dd3f8335f8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b2b576df300148ad8d8d7dd3f8335f8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_b2b576df300148ad8d8d7dd3f8335f8e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/b2b576df300148ad8d8d7dd3f8335f8e"}]}] Jul 20 20:10:00.732788 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-AttachVolumeNegativeTest-1904845904 Jul 20 20:10:00.732788 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: b2b576df300148ad8d8d7dd3f8335f8e Jul 20 20:10:00.732788 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1904845904 Jul 20 20:10:00.732788 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-AttachVolumeNegativeTest-1904845904-project Jul 20 20:10:00.732788 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 20:10:00.732788 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 20:10:00.732788 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: 0d1cf9b55ce04cf997bf23ad73222814 Jul 20 20:10:00.732788 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-AttachVolumeNegativeTest-1904845904-project Jul 20 20:10:00.732788 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: > Jul 20 20:10:00.732788 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Instance b3442f69-2ce9-4c5c-b137-e09fa9317e17 could not be found. Jul 20 20:10:00.732788 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'id': 'b3442f69-2ce9-4c5c-b137-e09fa9317e17'} Jul 20 20:10:00.733500 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 20:10:00.733500 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:10:00.733500 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 20:10:00.733500 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 20:10:00.733500 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 20:10:00.733500 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 20:10:00.733500 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 20:10:00.733500 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 20:10:00.733500 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 20:10:00.733500 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 20:10:00.733500 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3442f69-2ce9-4c5c-b137-e09fa9317e17 could not be found. Jul 20 20:10:00.733500 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:10:00.733500 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:10:00.733500 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:10:00.733500 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:10:00.733500 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:10:00.733500 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:10:00.733500 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 20:10:00.733500 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 20:10:00.733500 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 20:10:00.734707 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 20:10:00.734707 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 20:10:00.734707 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 20:10:00.734707 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 20:10:00.734707 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 20:10:00.734707 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 20:10:00.734707 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 20:10:00.734707 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3442f69-2ce9-4c5c-b137-e09fa9317e17 could not be found. Jul 20 20:10:00.734707 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:10:00.734707 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:10:00.734707 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:10:00.734707 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:10:00.734707 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:10:00.734707 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:10:00.734707 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 20:10:00.734707 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 20:10:00.734707 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3442f69-2ce9-4c5c-b137-e09fa9317e17 could not be found. Jul 20 20:10:00.734707 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:10:00.735760 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-86824086-5251-4cc5-9112-db3d147bacd0 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] Returning 404 to user: Instance b3442f69-2ce9-4c5c-b137-e09fa9317e17 could not be found. {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 20:10:00.735760 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-86824086-5251-4cc5-9112-db3d147bacd0 tempest-AttachVolumeNegativeTest-1904845904 tempest-AttachVolumeNegativeTest-1904845904-project] 10.222.0.69 "GET /compute/v2.1/servers/b3442f69-2ce9-4c5c-b137-e09fa9317e17" status: 404 len: 111 microversion: 2.1 time: 0.028299 Jul 20 20:10:00.735760 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1950/2581] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:10:00 2022] GET /compute/v2.1/servers/b3442f69-2ce9-4c5c-b137-e09fa9317e17 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 20:10:17.044740 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-6063bd4f-6747-4e19-a51c-2bf82018da25 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:10:17.045684 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-6063bd4f-6747-4e19-a51c-2bf82018da25 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:10:17.048360 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 20:10:17.049008 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 20:10:17.055412 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6063bd4f-6747-4e19-a51c-2bf82018da25 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:10:17.055922 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6063bd4f-6747-4e19-a51c-2bf82018da25 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:10:17.056689 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6063bd4f-6747-4e19-a51c-2bf82018da25 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:10:17.057168 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-6063bd4f-6747-4e19-a51c-2bf82018da25 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:10:17.089748 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-6063bd4f-6747-4e19-a51c-2bf82018da25 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048812 Jul 20 20:10:17.090294 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1951/2582] 10.222.0.69 () {60 vars in 1342 bytes} [Wed Jul 20 20:10:17 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:10:17.146956 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-bb4317af-dc52-4f34-a776-5c573332353f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:10:17.147453 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-bb4317af-dc52-4f34-a776-5c573332353f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:10:17.154045 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bb4317af-dc52-4f34-a776-5c573332353f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:10:17.154485 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bb4317af-dc52-4f34-a776-5c573332353f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:10:17.155233 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bb4317af-dc52-4f34-a776-5c573332353f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:10:17.155660 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bb4317af-dc52-4f34-a776-5c573332353f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:10:17.179104 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-bb4317af-dc52-4f34-a776-5c573332353f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Going to try to terminate instance {{(pid=117761) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 20:10:17.251584 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-bb4317af-dc52-4f34-a776-5c573332353f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "DELETE /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 204 len: 0 microversion: 2.20 time: 0.108055 Jul 20 20:10:17.252084 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1952/2583] 10.222.0.69 () {60 vars in 1279 bytes} [Wed Jul 20 20:10:17 2022] DELETE /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 20 20:10:17.263146 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-02fdc7bd-30d4-4961-9dd9-45fe47e9c1bb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:10:17.263871 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-02fdc7bd-30d4-4961-9dd9-45fe47e9c1bb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:10:17.270053 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-02fdc7bd-30d4-4961-9dd9-45fe47e9c1bb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:10:17.270502 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-02fdc7bd-30d4-4961-9dd9-45fe47e9c1bb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:10:17.271255 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-02fdc7bd-30d4-4961-9dd9-45fe47e9c1bb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:10:17.271685 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-02fdc7bd-30d4-4961-9dd9-45fe47e9c1bb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:10:17.401689 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-02fdc7bd-30d4-4961-9dd9-45fe47e9c1bb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:10:17.409812 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-02fdc7bd-30d4-4961-9dd9-45fe47e9c1bb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:10:17.411314 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-02fdc7bd-30d4-4961-9dd9-45fe47e9c1bb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:10:17.412461 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-02fdc7bd-30d4-4961-9dd9-45fe47e9c1bb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1723 microversion: 2.20 time: 0.155708 Jul 20 20:10:17.413000 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1953/2584] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:10:17 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 20:10:18.431267 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d007338d-4295-4138-88e9-cea44ea5ad42 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:10:18.431878 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d007338d-4295-4138-88e9-cea44ea5ad42 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:10:18.438384 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d007338d-4295-4138-88e9-cea44ea5ad42 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:10:18.438833 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d007338d-4295-4138-88e9-cea44ea5ad42 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:10:18.439591 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d007338d-4295-4138-88e9-cea44ea5ad42 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:10:18.440027 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d007338d-4295-4138-88e9-cea44ea5ad42 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:10:18.566207 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d007338d-4295-4138-88e9-cea44ea5ad42 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:10:18.574767 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d007338d-4295-4138-88e9-cea44ea5ad42 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:10:18.576203 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d007338d-4295-4138-88e9-cea44ea5ad42 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:10:18.577349 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d007338d-4295-4138-88e9-cea44ea5ad42 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1723 microversion: 2.20 time: 0.150373 Jul 20 20:10:18.577967 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1954/2585] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:10:18 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 20:10:19.596869 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-65414d5d-bda9-4ed8-8a99-ffd73e6262eb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:10:19.597476 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-65414d5d-bda9-4ed8-8a99-ffd73e6262eb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:10:19.603809 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-65414d5d-bda9-4ed8-8a99-ffd73e6262eb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:10:19.604250 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-65414d5d-bda9-4ed8-8a99-ffd73e6262eb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:10:19.605010 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-65414d5d-bda9-4ed8-8a99-ffd73e6262eb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:10:19.605759 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-65414d5d-bda9-4ed8-8a99-ffd73e6262eb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:10:19.826353 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-65414d5d-bda9-4ed8-8a99-ffd73e6262eb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:10:19.834438 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-65414d5d-bda9-4ed8-8a99-ffd73e6262eb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:10:19.836461 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-65414d5d-bda9-4ed8-8a99-ffd73e6262eb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343e480dd5ee4389ba430129cd7daaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0bccb45a24af3918f7db2c60de33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:10:19.837656 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-65414d5d-bda9-4ed8-8a99-ffd73e6262eb tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 200 len: 1723 microversion: 2.20 time: 0.245104 Jul 20 20:10:19.838217 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1955/2586] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:10:19 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 1723 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 20:10:20.266247 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [req-966b3e80-2793-4caf-90a9-81e792a6521c req-4934a059-46a3-46bf-8638-ad8b1777f0fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c5c0c16-97ac-46f6-8a3e-f5440a0d584b", "name": "network-vif-deleted", "tag": "4d5fe51d-3208-445f-a00e-81057db89aa5"}]} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 20:10:20.277322 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-966b3e80-2793-4caf-90a9-81e792a6521c req-4934a059-46a3-46bf-8638-ad8b1777f0fe service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:10:20.279580 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-966b3e80-2793-4caf-90a9-81e792a6521c req-4934a059-46a3-46bf-8638-ad8b1777f0fe service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:10:20.292210 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.compute.server_external_events [req-966b3e80-2793-4caf-90a9-81e792a6521c req-4934a059-46a3-46bf-8638-ad8b1777f0fe service nova] Creating event network-vif-deleted:4d5fe51d-3208-445f-a00e-81057db89aa5 for instance 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b on hv-cinder-83538 Jul 20 20:10:20.297345 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [req-966b3e80-2793-4caf-90a9-81e792a6521c req-4934a059-46a3-46bf-8638-ad8b1777f0fe service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035014 Jul 20 20:10:20.297984 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1956/2587] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 20:10:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 20:10:20.858452 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-aba5913a-0c77-4f6a-b131-977eef0cef7d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:10:20.859192 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-aba5913a-0c77-4f6a-b131-977eef0cef7d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:10:20.865920 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aba5913a-0c77-4f6a-b131-977eef0cef7d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:10:20.866635 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aba5913a-0c77-4f6a-b131-977eef0cef7d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:10:20.868330 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aba5913a-0c77-4f6a-b131-977eef0cef7d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:10:20.868926 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aba5913a-0c77-4f6a-b131-977eef0cef7d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:10:20.882484 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.wsgi [None req-aba5913a-0c77-4f6a-b131-977eef0cef7d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] HTTP exception thrown: Instance 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b could not be found. Jul 20 20:10:20.884182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-aba5913a-0c77-4f6a-b131-977eef0cef7d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Request method failure captured: Jul 20 20:10:20.884182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b HTTP/1.1 Jul 20 20:10:20.884182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 20:10:20.884182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 20:10:20.884182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 20:10:20.884182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 0 Jul 20 20:10:20.884182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 20:10:20.884182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 20:10:20.884182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 20:10:20.884182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 20:10:20.884182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2FZC6TLk9RyUoa-CnTzn6cQxntNIPmSHf4VFFjH4WEFcoeAmBV9hwPBPtC5Rl2l-XF4LktNbG9iGige5chaqXsYkrW0lRRuajMs1WJGqI2iOeUuFsH3YqbZ4MaB0FsoB66owZGpWtFZWEg7-b4uFtfLjY2JdEYIydzfjK6rmwA9rAok Jul 20 20:10:20.884182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 20:10:20.884182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 20:10:20.884182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 20:10:20.884182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 20:10:20.884182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 20:10:20.884182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 20:10:20.884182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 20:10:20.884182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: e6e0bccb45a24af3918f7db2c60de33d Jul 20 20:10:20.884182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1947755824 Jul 20 20:10:20.884182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 20:10:20.884182 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 20:10:20.885583 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e6e0bccb45a24af3918f7db2c60de33d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e6e0bccb45a24af3918f7db2c60de33d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_e6e0bccb45a24af3918f7db2c60de33d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/e6e0bccb45a24af3918f7db2c60de33d"}]}] Jul 20 20:10:20.885583 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1947755824 Jul 20 20:10:20.885583 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: e6e0bccb45a24af3918f7db2c60de33d Jul 20 20:10:20.885583 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1947755824 Jul 20 20:10:20.885583 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-AttachVolumeShelveTestJSON-1947755824-project Jul 20 20:10:20.885583 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 20:10:20.885583 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 20:10:20.885583 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: 343e480dd5ee4389ba430129cd7daaa4 Jul 20 20:10:20.885583 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1947755824-project Jul 20 20:10:20.885583 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: > Jul 20 20:10:20.885583 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Instance 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b could not be found. Jul 20 20:10:20.885583 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'id': '2c5c0c16-97ac-46f6-8a3e-f5440a0d584b'} Jul 20 20:10:20.886432 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 20:10:20.886432 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:10:20.886432 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 20:10:20.886432 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 20:10:20.886432 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 20:10:20.886432 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 20:10:20.886432 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 20:10:20.886432 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 20:10:20.886432 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 20:10:20.886432 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 20:10:20.886432 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b could not be found. Jul 20 20:10:20.886432 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:10:20.886432 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:10:20.886432 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:10:20.886432 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:10:20.886432 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:10:20.886432 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:10:20.886432 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 20:10:20.886432 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 20:10:20.886432 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 20:10:20.887655 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 20:10:20.887655 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 20:10:20.887655 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 20:10:20.887655 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 20:10:20.887655 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 20:10:20.887655 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 20:10:20.887655 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 20:10:20.887655 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b could not be found. Jul 20 20:10:20.887655 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:10:20.887655 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:10:20.887655 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:10:20.887655 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:10:20.887655 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:10:20.887655 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:10:20.887655 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 20:10:20.887655 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 20:10:20.887655 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b could not be found. Jul 20 20:10:20.887655 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:10:20.888762 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-aba5913a-0c77-4f6a-b131-977eef0cef7d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Returning 404 to user: Instance 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b could not be found. {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 20:10:20.888762 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-aba5913a-0c77-4f6a-b131-977eef0cef7d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 404 len: 111 microversion: 2.20 time: 0.032776 Jul 20 20:10:20.888762 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1957/2588] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:10:20 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 20:10:20.894175 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e4d5a8ba-2ee4-462f-b705-e8eaea4699b8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '.version_select at 0x7ff60e8eaaf0>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:10:20.911512 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e4d5a8ba-2ee4-462f-b705-e8eaea4699b8 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1987905101" status: 204 len: 0 microversion: 2.20 time: 0.020808 Jul 20 20:10:20.912094 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1958/2589] 10.222.0.69 () {60 vars in 1261 bytes} [Wed Jul 20 20:10:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1987905101 => generated 0 bytes in 22 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 20 20:10:22.722720 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d26bb713-769e-4619-b460-820b710f2ab4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:10:22.723361 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d26bb713-769e-4619-b460-820b710f2ab4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:10:22.730910 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d26bb713-769e-4619-b460-820b710f2ab4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:10:22.731363 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d26bb713-769e-4619-b460-820b710f2ab4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:10:22.732115 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d26bb713-769e-4619-b460-820b710f2ab4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:10:22.732552 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d26bb713-769e-4619-b460-820b710f2ab4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:10:22.747472 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.wsgi [None req-d26bb713-769e-4619-b460-820b710f2ab4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] HTTP exception thrown: Instance 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b could not be found. Jul 20 20:10:22.749027 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d26bb713-769e-4619-b460-820b710f2ab4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Request method failure captured: Jul 20 20:10:22.749027 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: DELETE /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b HTTP/1.1 Jul 20 20:10:22.749027 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 20:10:22.749027 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 20:10:22.749027 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 20:10:22.749027 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 0 Jul 20 20:10:22.749027 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 20:10:22.749027 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 20:10:22.749027 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 20:10:22.749027 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 20:10:22.749027 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2FZC6TLk9RyUoa-CnTzn6cQxntNIPmSHf4VFFjH4WEFcoeAmBV9hwPBPtC5Rl2l-XF4LktNbG9iGige5chaqXsYkrW0lRRuajMs1WJGqI2iOeUuFsH3YqbZ4MaB0FsoB66owZGpWtFZWEg7-b4uFtfLjY2JdEYIydzfjK6rmwA9rAok Jul 20 20:10:22.749027 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 20:10:22.749027 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 20:10:22.749027 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 20:10:22.749027 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 20:10:22.749027 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 20:10:22.749027 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 20:10:22.749027 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 20:10:22.749027 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: e6e0bccb45a24af3918f7db2c60de33d Jul 20 20:10:22.749027 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1947755824 Jul 20 20:10:22.749027 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 20:10:22.749027 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 20:10:22.750302 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e6e0bccb45a24af3918f7db2c60de33d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e6e0bccb45a24af3918f7db2c60de33d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_e6e0bccb45a24af3918f7db2c60de33d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/e6e0bccb45a24af3918f7db2c60de33d"}]}] Jul 20 20:10:22.750302 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1947755824 Jul 20 20:10:22.750302 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: e6e0bccb45a24af3918f7db2c60de33d Jul 20 20:10:22.750302 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1947755824 Jul 20 20:10:22.750302 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-AttachVolumeShelveTestJSON-1947755824-project Jul 20 20:10:22.750302 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 20:10:22.750302 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 20:10:22.750302 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: 343e480dd5ee4389ba430129cd7daaa4 Jul 20 20:10:22.750302 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1947755824-project Jul 20 20:10:22.750302 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: > Jul 20 20:10:22.750302 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Instance 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b could not be found. Jul 20 20:10:22.750302 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'id': '2c5c0c16-97ac-46f6-8a3e-f5440a0d584b'} Jul 20 20:10:22.750960 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 20:10:22.750960 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:10:22.750960 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 20:10:22.750960 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 20:10:22.750960 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 20:10:22.750960 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 20:10:22.750960 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 20:10:22.750960 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 20:10:22.750960 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 20:10:22.750960 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 20:10:22.750960 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b could not be found. Jul 20 20:10:22.750960 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:10:22.750960 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:10:22.750960 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:10:22.750960 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:10:22.750960 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:10:22.750960 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:10:22.750960 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 20:10:22.750960 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 20:10:22.750960 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 20:10:22.751972 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 20:10:22.751972 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 20:10:22.751972 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 20:10:22.751972 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 20:10:22.751972 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 20:10:22.751972 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 20:10:22.751972 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 20:10:22.751972 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 20:10:22.751972 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 20:10:22.751972 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b could not be found. Jul 20 20:10:22.751972 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:10:22.751972 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:10:22.751972 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:10:22.751972 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:10:22.751972 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:10:22.751972 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:10:22.751972 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 20:10:22.751972 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 20:10:22.751972 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b could not be found. Jul 20 20:10:22.751972 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:10:22.753388 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d26bb713-769e-4619-b460-820b710f2ab4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Returning 404 to user: Instance 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b could not be found. {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 20:10:22.753388 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d26bb713-769e-4619-b460-820b710f2ab4 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "DELETE /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 404 len: 111 microversion: 2.20 time: 0.032093 Jul 20 20:10:22.753388 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1959/2590] 10.222.0.69 () {60 vars in 1279 bytes} [Wed Jul 20 20:10:22 2022] DELETE /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 20 20:10:22.758671 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a60a5196-5e29-4681-8a6c-9a69900a164f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:10:22.759271 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a60a5196-5e29-4681-8a6c-9a69900a164f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:10:22.764931 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a60a5196-5e29-4681-8a6c-9a69900a164f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:10:22.765382 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a60a5196-5e29-4681-8a6c-9a69900a164f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:10:22.766167 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a60a5196-5e29-4681-8a6c-9a69900a164f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:10:22.766599 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a60a5196-5e29-4681-8a6c-9a69900a164f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:10:22.780204 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.wsgi [None req-a60a5196-5e29-4681-8a6c-9a69900a164f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] HTTP exception thrown: Instance 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b could not be found. Jul 20 20:10:22.781743 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a60a5196-5e29-4681-8a6c-9a69900a164f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Request method failure captured: Jul 20 20:10:22.781743 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b HTTP/1.1 Jul 20 20:10:22.781743 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 20:10:22.781743 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 20:10:22.781743 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 20:10:22.781743 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 0 Jul 20 20:10:22.781743 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 20:10:22.781743 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 20:10:22.781743 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 20:10:22.781743 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 20:10:22.781743 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2FZC6TLk9RyUoa-CnTzn6cQxntNIPmSHf4VFFjH4WEFcoeAmBV9hwPBPtC5Rl2l-XF4LktNbG9iGige5chaqXsYkrW0lRRuajMs1WJGqI2iOeUuFsH3YqbZ4MaB0FsoB66owZGpWtFZWEg7-b4uFtfLjY2JdEYIydzfjK6rmwA9rAok Jul 20 20:10:22.781743 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 20:10:22.781743 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 20:10:22.781743 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 20:10:22.781743 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 20:10:22.781743 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 20:10:22.781743 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 20:10:22.781743 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 20:10:22.781743 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: e6e0bccb45a24af3918f7db2c60de33d Jul 20 20:10:22.781743 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1947755824 Jul 20 20:10:22.781743 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 20:10:22.781743 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 20:10:22.783263 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e6e0bccb45a24af3918f7db2c60de33d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e6e0bccb45a24af3918f7db2c60de33d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_e6e0bccb45a24af3918f7db2c60de33d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/e6e0bccb45a24af3918f7db2c60de33d"}]}] Jul 20 20:10:22.783263 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1947755824 Jul 20 20:10:22.783263 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: e6e0bccb45a24af3918f7db2c60de33d Jul 20 20:10:22.783263 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1947755824 Jul 20 20:10:22.783263 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-AttachVolumeShelveTestJSON-1947755824-project Jul 20 20:10:22.783263 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 20:10:22.783263 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 20:10:22.783263 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: 343e480dd5ee4389ba430129cd7daaa4 Jul 20 20:10:22.783263 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1947755824-project Jul 20 20:10:22.783263 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: > Jul 20 20:10:22.783263 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Instance 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b could not be found. Jul 20 20:10:22.783263 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'id': '2c5c0c16-97ac-46f6-8a3e-f5440a0d584b'} Jul 20 20:10:22.783864 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 20:10:22.783864 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:10:22.783864 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 20:10:22.783864 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 20:10:22.783864 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 20:10:22.783864 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 20:10:22.783864 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 20:10:22.783864 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 20:10:22.783864 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 20:10:22.783864 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 20:10:22.783864 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b could not be found. Jul 20 20:10:22.783864 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:10:22.783864 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:10:22.783864 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:10:22.783864 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:10:22.783864 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:10:22.783864 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:10:22.783864 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 20:10:22.783864 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 20:10:22.783864 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 20:10:22.784845 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 20:10:22.784845 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 20:10:22.784845 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 20:10:22.784845 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 20:10:22.784845 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 20:10:22.784845 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 20:10:22.784845 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 20:10:22.784845 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b could not be found. Jul 20 20:10:22.784845 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:10:22.784845 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:10:22.784845 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:10:22.784845 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:10:22.784845 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:10:22.784845 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:10:22.784845 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 20:10:22.784845 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 20:10:22.784845 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b could not be found. Jul 20 20:10:22.784845 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:10:22.785757 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a60a5196-5e29-4681-8a6c-9a69900a164f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Returning 404 to user: Instance 2c5c0c16-97ac-46f6-8a3e-f5440a0d584b could not be found. {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 20:10:22.785757 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a60a5196-5e29-4681-8a6c-9a69900a164f tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b" status: 404 len: 111 microversion: 2.20 time: 0.028051 Jul 20 20:10:22.785757 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1960/2591] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:10:22 2022] GET /compute/v2.1/servers/2c5c0c16-97ac-46f6-8a3e-f5440a0d584b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 20 20:10:23.915907 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c915d7f1-3734-4cb6-89c8-d1c450c372d5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:10:23.916470 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c915d7f1-3734-4cb6-89c8-d1c450c372d5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:10:23.922762 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c915d7f1-3734-4cb6-89c8-d1c450c372d5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:10:23.923207 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c915d7f1-3734-4cb6-89c8-d1c450c372d5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:10:23.923959 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c915d7f1-3734-4cb6-89c8-d1c450c372d5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:10:23.924420 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c915d7f1-3734-4cb6-89c8-d1c450c372d5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:10:23.937414 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.wsgi [None req-c915d7f1-3734-4cb6-89c8-d1c450c372d5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] HTTP exception thrown: Instance 3b2abd53-4758-462c-b36a-0d1bf0b66a55 could not be found. Jul 20 20:10:23.938966 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c915d7f1-3734-4cb6-89c8-d1c450c372d5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Request method failure captured: Jul 20 20:10:23.938966 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: DELETE /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 HTTP/1.1 Jul 20 20:10:23.938966 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 20:10:23.938966 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 20:10:23.938966 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 20:10:23.938966 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 0 Jul 20 20:10:23.938966 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 20:10:23.938966 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 20:10:23.938966 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 20:10:23.938966 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 20:10:23.938966 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2FZC6TLk9RyUoa-CnTzn6cQxntNIPmSHf4VFFjH4WEFcoeAmBV9hwPBPtC5Rl2l-XF4LktNbG9iGige5chaqXsYkrW0lRRuajMs1WJGqI2iOeUuFsH3YqbZ4MaB0FsoB66owZGpWtFZWEg7-b4uFtfLjY2JdEYIydzfjK6rmwA9rAok Jul 20 20:10:23.938966 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 20:10:23.938966 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 20:10:23.938966 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 20:10:23.938966 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 20:10:23.938966 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 20:10:23.938966 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 20:10:23.938966 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 20:10:23.938966 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: e6e0bccb45a24af3918f7db2c60de33d Jul 20 20:10:23.938966 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1947755824 Jul 20 20:10:23.938966 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 20:10:23.938966 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 20:10:23.940355 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e6e0bccb45a24af3918f7db2c60de33d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e6e0bccb45a24af3918f7db2c60de33d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_e6e0bccb45a24af3918f7db2c60de33d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/e6e0bccb45a24af3918f7db2c60de33d"}]}] Jul 20 20:10:23.940355 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1947755824 Jul 20 20:10:23.940355 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: e6e0bccb45a24af3918f7db2c60de33d Jul 20 20:10:23.940355 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1947755824 Jul 20 20:10:23.940355 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-AttachVolumeShelveTestJSON-1947755824-project Jul 20 20:10:23.940355 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 20:10:23.940355 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 20:10:23.940355 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: 343e480dd5ee4389ba430129cd7daaa4 Jul 20 20:10:23.940355 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1947755824-project Jul 20 20:10:23.940355 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: > Jul 20 20:10:23.940355 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Instance 3b2abd53-4758-462c-b36a-0d1bf0b66a55 could not be found. Jul 20 20:10:23.940355 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'id': '3b2abd53-4758-462c-b36a-0d1bf0b66a55'} Jul 20 20:10:23.940994 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 20:10:23.940994 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:10:23.940994 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 20:10:23.940994 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 20:10:23.940994 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 20:10:23.940994 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 20:10:23.940994 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 20:10:23.940994 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 20:10:23.940994 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 20:10:23.940994 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 20:10:23.940994 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b2abd53-4758-462c-b36a-0d1bf0b66a55 could not be found. Jul 20 20:10:23.940994 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:10:23.940994 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:10:23.940994 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:10:23.940994 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:10:23.940994 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:10:23.940994 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:10:23.940994 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 20:10:23.940994 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 20:10:23.940994 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 20:10:23.942022 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 20:10:23.942022 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 20:10:23.942022 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 20:10:23.942022 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 20:10:23.942022 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 20:10:23.942022 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 20:10:23.942022 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 20:10:23.942022 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 20:10:23.942022 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 20:10:23.942022 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b2abd53-4758-462c-b36a-0d1bf0b66a55 could not be found. Jul 20 20:10:23.942022 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:10:23.942022 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:10:23.942022 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:10:23.942022 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:10:23.942022 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:10:23.942022 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:10:23.942022 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 20:10:23.942022 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 20:10:23.942022 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b2abd53-4758-462c-b36a-0d1bf0b66a55 could not be found. Jul 20 20:10:23.942022 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:10:23.943024 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c915d7f1-3734-4cb6-89c8-d1c450c372d5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Returning 404 to user: Instance 3b2abd53-4758-462c-b36a-0d1bf0b66a55 could not be found. {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 20:10:23.943024 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c915d7f1-3734-4cb6-89c8-d1c450c372d5 tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "DELETE /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 404 len: 111 microversion: 2.20 time: 0.028353 Jul 20 20:10:23.943024 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1961/2592] 10.222.0.69 () {60 vars in 1279 bytes} [Wed Jul 20 20:10:23 2022] DELETE /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 20 20:10:23.948657 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a406601b-2fc7-4939-bc33-4d10a808234d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:10:23.949248 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a406601b-2fc7-4939-bc33-4d10a808234d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] [instance: 3b2abd53-4758-462c-b36a-0d1bf0b66a55] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:10:23.955089 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a406601b-2fc7-4939-bc33-4d10a808234d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:10:23.955533 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a406601b-2fc7-4939-bc33-4d10a808234d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:10:23.956285 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a406601b-2fc7-4939-bc33-4d10a808234d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:10:23.956717 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a406601b-2fc7-4939-bc33-4d10a808234d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:10:23.970416 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.wsgi [None req-a406601b-2fc7-4939-bc33-4d10a808234d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] HTTP exception thrown: Instance 3b2abd53-4758-462c-b36a-0d1bf0b66a55 could not be found. Jul 20 20:10:23.971914 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a406601b-2fc7-4939-bc33-4d10a808234d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Request method failure captured: Jul 20 20:10:23.971914 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 HTTP/1.1 Jul 20 20:10:23.971914 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 20:10:23.971914 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 20:10:23.971914 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 20:10:23.971914 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 0 Jul 20 20:10:23.971914 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 20:10:23.971914 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 20:10:23.971914 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 20:10:23.971914 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 20:10:23.971914 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2FZC6TLk9RyUoa-CnTzn6cQxntNIPmSHf4VFFjH4WEFcoeAmBV9hwPBPtC5Rl2l-XF4LktNbG9iGige5chaqXsYkrW0lRRuajMs1WJGqI2iOeUuFsH3YqbZ4MaB0FsoB66owZGpWtFZWEg7-b4uFtfLjY2JdEYIydzfjK6rmwA9rAok Jul 20 20:10:23.971914 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 20:10:23.971914 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 20:10:23.971914 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 20:10:23.971914 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 20:10:23.971914 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 20:10:23.971914 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 20:10:23.971914 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 20:10:23.971914 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: e6e0bccb45a24af3918f7db2c60de33d Jul 20 20:10:23.971914 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1947755824 Jul 20 20:10:23.971914 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 20:10:23.971914 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 20:10:23.973268 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e6e0bccb45a24af3918f7db2c60de33d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e6e0bccb45a24af3918f7db2c60de33d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_e6e0bccb45a24af3918f7db2c60de33d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/e6e0bccb45a24af3918f7db2c60de33d"}]}] Jul 20 20:10:23.973268 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1947755824 Jul 20 20:10:23.973268 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: e6e0bccb45a24af3918f7db2c60de33d Jul 20 20:10:23.973268 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1947755824 Jul 20 20:10:23.973268 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-AttachVolumeShelveTestJSON-1947755824-project Jul 20 20:10:23.973268 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 20:10:23.973268 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 20:10:23.973268 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: 343e480dd5ee4389ba430129cd7daaa4 Jul 20 20:10:23.973268 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1947755824-project Jul 20 20:10:23.973268 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: > Jul 20 20:10:23.973268 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Instance 3b2abd53-4758-462c-b36a-0d1bf0b66a55 could not be found. Jul 20 20:10:23.973268 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'id': '3b2abd53-4758-462c-b36a-0d1bf0b66a55'} Jul 20 20:10:23.974012 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 20:10:23.974012 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:10:23.974012 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 20:10:23.974012 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 20:10:23.974012 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 20:10:23.974012 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 20:10:23.974012 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 20:10:23.974012 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 20:10:23.974012 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 20:10:23.974012 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 20:10:23.974012 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b2abd53-4758-462c-b36a-0d1bf0b66a55 could not be found. Jul 20 20:10:23.974012 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:10:23.974012 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:10:23.974012 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:10:23.974012 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:10:23.974012 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:10:23.974012 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:10:23.974012 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 20:10:23.974012 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 20:10:23.974012 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 20:10:23.975236 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 20:10:23.975236 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 20:10:23.975236 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 20:10:23.975236 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 20:10:23.975236 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 20:10:23.975236 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 20:10:23.975236 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 20:10:23.975236 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b2abd53-4758-462c-b36a-0d1bf0b66a55 could not be found. Jul 20 20:10:23.975236 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:10:23.975236 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:10:23.975236 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:10:23.975236 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:10:23.975236 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:10:23.975236 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:10:23.975236 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 20:10:23.975236 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 20:10:23.975236 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b2abd53-4758-462c-b36a-0d1bf0b66a55 could not be found. Jul 20 20:10:23.975236 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:10:23.976314 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a406601b-2fc7-4939-bc33-4d10a808234d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] Returning 404 to user: Instance 3b2abd53-4758-462c-b36a-0d1bf0b66a55 could not be found. {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 20:10:23.976314 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a406601b-2fc7-4939-bc33-4d10a808234d tempest-AttachVolumeShelveTestJSON-1947755824 tempest-AttachVolumeShelveTestJSON-1947755824-project] 10.222.0.69 "GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55" status: 404 len: 111 microversion: 2.20 time: 0.028608 Jul 20 20:10:23.976314 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1962/2593] 10.222.0.69 () {60 vars in 1276 bytes} [Wed Jul 20 20:10:23 2022] GET /compute/v2.1/servers/3b2abd53-4758-462c-b36a-0d1bf0b66a55 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 20:11:55.564124 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 20:11:55.564949 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 20:11:55.569021 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e4727e29-4812-4d80-bdfa-eae3d52d954b tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Action: 'create', calling method: .version_select at 0x7ff60a39b8b0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-466886681", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG2I295bDO0bFCg3VLvtqRWAPQcNgTq3rkFmyninGWA4A/brQwxjxhV2evC3MSgqSe0aGb8mECyEGD+x9hptcQ24eXjQxZ7YsmbyGHvDDtCwI4N0oUf2tq4nuviR+Ov2tg=="}} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 20:11:55.587170 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.quota [None req-e4727e29-4812-4d80-bdfa-eae3d52d954b tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Getting quotas for project cc8b7ce45a7d420c8e80648aef1eb14f. Resources: {'key_pairs'} {{(pid=117761) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 20:11:55.590757 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.quota [None req-e4727e29-4812-4d80-bdfa-eae3d52d954b tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Getting quotas for user e08007dee07e4884b37e4beb78956be5 and project cc8b7ce45a7d420c8e80648aef1eb14f. Resources: {'key_pairs'} {{(pid=117761) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 20:11:55.612683 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e4727e29-4812-4d80-bdfa-eae3d52d954b tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.050437 Jul 20 20:11:55.613430 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1963/2594] 10.222.0.69 () {60 vars in 1158 bytes} [Wed Jul 20 20:11:55 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 20:11:55.712863 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-43533ca2-3722-4f3e-b3a9-56498928a96f tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-364254843", "imageRef": "81f025cc-25fb-483b-81b6-e5126f38f842", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-466886681", "networks": [{"uuid": "fc1f0b20-59eb-4273-acb6-287f41980591"}]}} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 20:11:55.763039 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.network.neutron [None req-43533ca2-3722-4f3e-b3a9-56498928a96f tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] validate_networks() for [('fc1f0b20-59eb-4273-acb6-287f41980591', None, None, None, None, None)] {{(pid=117761) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 20:11:56.144187 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.virt.hardware [None req-43533ca2-3722-4f3e-b3a9-56498928a96f tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Flavor limits 0:0:0 {{(pid=117761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 20:11:56.144604 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.virt.hardware [None req-43533ca2-3722-4f3e-b3a9-56498928a96f tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Image limits 0:0:0 {{(pid=117761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 20:11:56.145061 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.virt.hardware [None req-43533ca2-3722-4f3e-b3a9-56498928a96f tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Flavor pref 0:0:0 {{(pid=117761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 20:11:56.145454 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.virt.hardware [None req-43533ca2-3722-4f3e-b3a9-56498928a96f tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Image pref 0:0:0 {{(pid=117761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 20:11:56.145886 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.virt.hardware [None req-43533ca2-3722-4f3e-b3a9-56498928a96f tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117761) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 20:11:56.155027 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-43533ca2-3722-4f3e-b3a9-56498928a96f tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:11:56.155466 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-43533ca2-3722-4f3e-b3a9-56498928a96f tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:11:56.156241 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-43533ca2-3722-4f3e-b3a9-56498928a96f tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:11:56.156661 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-43533ca2-3722-4f3e-b3a9-56498928a96f tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:11:56.172466 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.quota [None req-43533ca2-3722-4f3e-b3a9-56498928a96f tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Getting quotas for project cc8b7ce45a7d420c8e80648aef1eb14f. Resources: {'cores', 'ram', 'instances'} {{(pid=117761) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 20:11:56.176329 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.quota [None req-43533ca2-3722-4f3e-b3a9-56498928a96f tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Getting quotas for user e08007dee07e4884b37e4beb78956be5 and project cc8b7ce45a7d420c8e80648aef1eb14f. Resources: {'cores', 'ram', 'instances'} {{(pid=117761) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 20:11:56.186914 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-43533ca2-3722-4f3e-b3a9-56498928a96f tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Going to run 1 instances... {{(pid=117761) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 20:11:56.189016 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-43533ca2-3722-4f3e-b3a9-56498928a96f tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] [instance: ebe9faba-2b02-4ab6-be69-e7830be3ddf3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81f025cc-25fb-483b-81b6-e5126f38f842',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117761) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 20:11:56.237934 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-43533ca2-3722-4f3e-b3a9-56498928a96f tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.529035 Jul 20 20:11:56.238742 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1964/2595] 10.222.0.69 () {60 vars in 1146 bytes} [Wed Jul 20 20:11:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 530 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 20:11:56.247895 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-6740fa5d-1fed-4a33-a998-328bdfd473e7 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:11:56.248493 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-6740fa5d-1fed-4a33-a998-328bdfd473e7 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] [instance: ebe9faba-2b02-4ab6-be69-e7830be3ddf3] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:11:56.302781 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-6740fa5d-1fed-4a33-a998-328bdfd473e7 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08007dee07e4884b37e4beb78956be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8b7ce45a7d420c8e80648aef1eb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:11:56.311016 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-6740fa5d-1fed-4a33-a998-328bdfd473e7 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] 10.222.0.69 "GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3" status: 200 len: 1257 microversion: 2.1 time: 0.066692 Jul 20 20:11:56.320355 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1965/2596] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:11:56 2022] GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3 => generated 1257 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:11:57.329974 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-280a79e8-8d71-4581-8518-54ddab45e0e4 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:11:57.330617 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-280a79e8-8d71-4581-8518-54ddab45e0e4 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] [instance: ebe9faba-2b02-4ab6-be69-e7830be3ddf3] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:11:57.337079 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-280a79e8-8d71-4581-8518-54ddab45e0e4 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:11:57.337539 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-280a79e8-8d71-4581-8518-54ddab45e0e4 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:11:57.338320 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-280a79e8-8d71-4581-8518-54ddab45e0e4 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:11:57.338748 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-280a79e8-8d71-4581-8518-54ddab45e0e4 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:11:57.408081 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-280a79e8-8d71-4581-8518-54ddab45e0e4 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08007dee07e4884b37e4beb78956be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8b7ce45a7d420c8e80648aef1eb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:11:57.417334 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-280a79e8-8d71-4581-8518-54ddab45e0e4 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] 10.222.0.69 "GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3" status: 200 len: 1315 microversion: 2.1 time: 0.092432 Jul 20 20:11:57.418012 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1966/2597] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:11:57 2022] GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3 => generated 1315 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 20:11:58.434979 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-1f395402-4cc3-4740-a396-cbce7957d4a6 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:11:58.437220 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-1f395402-4cc3-4740-a396-cbce7957d4a6 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] [instance: ebe9faba-2b02-4ab6-be69-e7830be3ddf3] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:11:58.447523 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1f395402-4cc3-4740-a396-cbce7957d4a6 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:11:58.448700 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1f395402-4cc3-4740-a396-cbce7957d4a6 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:11:58.450005 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1f395402-4cc3-4740-a396-cbce7957d4a6 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:11:58.450739 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1f395402-4cc3-4740-a396-cbce7957d4a6 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:11:58.595518 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1f395402-4cc3-4740-a396-cbce7957d4a6 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08007dee07e4884b37e4beb78956be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8b7ce45a7d420c8e80648aef1eb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:11:58.606629 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-1f395402-4cc3-4740-a396-cbce7957d4a6 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] 10.222.0.69 "GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3" status: 200 len: 1357 microversion: 2.1 time: 0.175451 Jul 20 20:11:58.608010 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1967/2598] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:11:58 2022] GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3 => generated 1357 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:11:59.624930 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-36d580e1-152d-46bf-84d0-54472b67cd88 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:11:59.625571 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-36d580e1-152d-46bf-84d0-54472b67cd88 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] [instance: ebe9faba-2b02-4ab6-be69-e7830be3ddf3] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:11:59.632086 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-36d580e1-152d-46bf-84d0-54472b67cd88 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:11:59.632535 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-36d580e1-152d-46bf-84d0-54472b67cd88 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:11:59.633303 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-36d580e1-152d-46bf-84d0-54472b67cd88 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:11:59.633765 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-36d580e1-152d-46bf-84d0-54472b67cd88 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:11:59.772179 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-36d580e1-152d-46bf-84d0-54472b67cd88 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08007dee07e4884b37e4beb78956be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8b7ce45a7d420c8e80648aef1eb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:11:59.780551 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-36d580e1-152d-46bf-84d0-54472b67cd88 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] 10.222.0.69 "GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3" status: 200 len: 1357 microversion: 2.1 time: 0.160167 Jul 20 20:11:59.781425 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1968/2599] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:11:59 2022] GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3 => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:12:00.802772 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-005592d5-9410-415f-95d1-1dd952299fb9 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:12:00.803821 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-005592d5-9410-415f-95d1-1dd952299fb9 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] [instance: ebe9faba-2b02-4ab6-be69-e7830be3ddf3] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:12:00.814408 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-005592d5-9410-415f-95d1-1dd952299fb9 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:12:00.815176 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-005592d5-9410-415f-95d1-1dd952299fb9 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:12:00.816489 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-005592d5-9410-415f-95d1-1dd952299fb9 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:12:00.817227 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-005592d5-9410-415f-95d1-1dd952299fb9 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:12:01.157484 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-005592d5-9410-415f-95d1-1dd952299fb9 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08007dee07e4884b37e4beb78956be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8b7ce45a7d420c8e80648aef1eb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:12:01.165454 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-005592d5-9410-415f-95d1-1dd952299fb9 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] 10.222.0.69 "GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3" status: 200 len: 1357 microversion: 2.1 time: 0.369156 Jul 20 20:12:01.166056 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1969/2600] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:12:00 2022] GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3 => generated 1357 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 20:12:02.182775 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-f0a1aafe-1614-4a94-928f-2d03a7bb832b tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:12:02.183473 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-f0a1aafe-1614-4a94-928f-2d03a7bb832b tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] [instance: ebe9faba-2b02-4ab6-be69-e7830be3ddf3] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:12:02.190530 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f0a1aafe-1614-4a94-928f-2d03a7bb832b tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:12:02.191068 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f0a1aafe-1614-4a94-928f-2d03a7bb832b tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:12:02.191913 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f0a1aafe-1614-4a94-928f-2d03a7bb832b tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:12:02.192439 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-f0a1aafe-1614-4a94-928f-2d03a7bb832b tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:12:02.336326 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-f0a1aafe-1614-4a94-928f-2d03a7bb832b tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08007dee07e4884b37e4beb78956be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8b7ce45a7d420c8e80648aef1eb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:12:02.345065 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-f0a1aafe-1614-4a94-928f-2d03a7bb832b tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] 10.222.0.69 "GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3" status: 200 len: 1357 microversion: 2.1 time: 0.165982 Jul 20 20:12:02.345919 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1970/2601] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:12:02 2022] GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3 => generated 1357 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:12:03.362396 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-dc190147-e197-483c-9ee6-4f066fe9cf56 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:12:03.363032 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-dc190147-e197-483c-9ee6-4f066fe9cf56 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] [instance: ebe9faba-2b02-4ab6-be69-e7830be3ddf3] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:12:03.370021 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-dc190147-e197-483c-9ee6-4f066fe9cf56 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:12:03.370578 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-dc190147-e197-483c-9ee6-4f066fe9cf56 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:12:03.371556 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-dc190147-e197-483c-9ee6-4f066fe9cf56 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:12:03.371948 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-dc190147-e197-483c-9ee6-4f066fe9cf56 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:12:03.512369 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-dc190147-e197-483c-9ee6-4f066fe9cf56 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08007dee07e4884b37e4beb78956be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8b7ce45a7d420c8e80648aef1eb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:12:03.520779 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-dc190147-e197-483c-9ee6-4f066fe9cf56 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] 10.222.0.69 "GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3" status: 200 len: 1357 microversion: 2.1 time: 0.162722 Jul 20 20:12:03.521496 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1971/2602] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:12:03 2022] GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3 => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:12:04.538718 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-95b76d1d-b030-4547-a0a2-e9b99a791859 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:12:04.539422 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-95b76d1d-b030-4547-a0a2-e9b99a791859 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] [instance: ebe9faba-2b02-4ab6-be69-e7830be3ddf3] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:12:04.546979 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-95b76d1d-b030-4547-a0a2-e9b99a791859 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:12:04.547594 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-95b76d1d-b030-4547-a0a2-e9b99a791859 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:12:04.548491 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-95b76d1d-b030-4547-a0a2-e9b99a791859 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:12:04.549049 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-95b76d1d-b030-4547-a0a2-e9b99a791859 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:12:04.696353 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-95b76d1d-b030-4547-a0a2-e9b99a791859 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08007dee07e4884b37e4beb78956be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8b7ce45a7d420c8e80648aef1eb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:12:04.706045 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-95b76d1d-b030-4547-a0a2-e9b99a791859 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] 10.222.0.69 "GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3" status: 200 len: 1357 microversion: 2.1 time: 0.170902 Jul 20 20:12:04.706708 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1972/2603] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:12:04 2022] GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3 => generated 1357 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:12:05.722993 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-1a34c879-0d2f-41d0-968b-7dd83ccffa3f tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:12:05.723641 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-1a34c879-0d2f-41d0-968b-7dd83ccffa3f tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] [instance: ebe9faba-2b02-4ab6-be69-e7830be3ddf3] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:12:05.730048 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1a34c879-0d2f-41d0-968b-7dd83ccffa3f tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:12:05.730493 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1a34c879-0d2f-41d0-968b-7dd83ccffa3f tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:12:05.731243 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1a34c879-0d2f-41d0-968b-7dd83ccffa3f tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:12:05.731673 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1a34c879-0d2f-41d0-968b-7dd83ccffa3f tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:12:05.858580 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1a34c879-0d2f-41d0-968b-7dd83ccffa3f tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08007dee07e4884b37e4beb78956be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8b7ce45a7d420c8e80648aef1eb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:12:05.866492 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-1a34c879-0d2f-41d0-968b-7dd83ccffa3f tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] 10.222.0.69 "GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3" status: 200 len: 1357 microversion: 2.1 time: 0.147296 Jul 20 20:12:05.867054 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1973/2604] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:12:05 2022] GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3 => generated 1357 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:12:06.883057 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-1c18d22d-86c3-4001-aaff-48538357a7a2 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:12:06.883627 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-1c18d22d-86c3-4001-aaff-48538357a7a2 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] [instance: ebe9faba-2b02-4ab6-be69-e7830be3ddf3] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:12:06.885757 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell0:SELECT=2 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 20:12:06.886443 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell0:SELECT=12 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 20:12:06.894268 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1c18d22d-86c3-4001-aaff-48538357a7a2 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:12:06.894715 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1c18d22d-86c3-4001-aaff-48538357a7a2 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:12:06.895470 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1c18d22d-86c3-4001-aaff-48538357a7a2 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:12:06.895903 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-1c18d22d-86c3-4001-aaff-48538357a7a2 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:12:07.022911 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-1c18d22d-86c3-4001-aaff-48538357a7a2 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08007dee07e4884b37e4beb78956be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8b7ce45a7d420c8e80648aef1eb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:12:07.030342 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-1c18d22d-86c3-4001-aaff-48538357a7a2 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] 10.222.0.69 "GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3" status: 200 len: 1357 microversion: 2.1 time: 0.151206 Jul 20 20:12:07.030901 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1974/2605] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:12:06 2022] GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:12:08.047745 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-71d41d38-1d8e-49ce-bf63-21504d405655 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:12:08.048365 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-71d41d38-1d8e-49ce-bf63-21504d405655 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] [instance: ebe9faba-2b02-4ab6-be69-e7830be3ddf3] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:12:08.054601 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-71d41d38-1d8e-49ce-bf63-21504d405655 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:12:08.055053 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-71d41d38-1d8e-49ce-bf63-21504d405655 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:12:08.055818 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-71d41d38-1d8e-49ce-bf63-21504d405655 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:12:08.056251 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-71d41d38-1d8e-49ce-bf63-21504d405655 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:12:08.186202 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-71d41d38-1d8e-49ce-bf63-21504d405655 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08007dee07e4884b37e4beb78956be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8b7ce45a7d420c8e80648aef1eb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:12:08.194262 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-71d41d38-1d8e-49ce-bf63-21504d405655 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] 10.222.0.69 "GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3" status: 200 len: 1357 microversion: 2.1 time: 0.151180 Jul 20 20:12:08.194822 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1975/2606] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:12:08 2022] GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 20:12:08.936142 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [req-99f7b1d3-aa7d-40c0-8a0b-7739b8ac4e5f req-ef984236-44ed-427d-9e44-2ee961425597 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebe9faba-2b02-4ab6-be69-e7830be3ddf3", "tag": "f0e96a9c-0442-4c4b-834f-e403d781fcea"}]} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 20:12:08.945148 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-99f7b1d3-aa7d-40c0-8a0b-7739b8ac4e5f req-ef984236-44ed-427d-9e44-2ee961425597 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:12:08.945861 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-99f7b1d3-aa7d-40c0-8a0b-7739b8ac4e5f req-ef984236-44ed-427d-9e44-2ee961425597 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:12:08.958095 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.compute.server_external_events [req-99f7b1d3-aa7d-40c0-8a0b-7739b8ac4e5f req-ef984236-44ed-427d-9e44-2ee961425597 service nova] Creating event network-changed:f0e96a9c-0442-4c4b-834f-e403d781fcea for instance ebe9faba-2b02-4ab6-be69-e7830be3ddf3 on hv-cinder-83538 Jul 20 20:12:08.963351 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [req-99f7b1d3-aa7d-40c0-8a0b-7739b8ac4e5f req-ef984236-44ed-427d-9e44-2ee961425597 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031270 Jul 20 20:12:08.963966 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1976/2607] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 20:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 20:12:09.212001 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-5e1bff3a-7fa7-443f-a027-aca3fface091 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:12:09.213376 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-5e1bff3a-7fa7-443f-a027-aca3fface091 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] [instance: ebe9faba-2b02-4ab6-be69-e7830be3ddf3] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:12:09.220457 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5e1bff3a-7fa7-443f-a027-aca3fface091 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:12:09.220913 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5e1bff3a-7fa7-443f-a027-aca3fface091 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:12:09.221738 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5e1bff3a-7fa7-443f-a027-aca3fface091 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:12:09.222213 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-5e1bff3a-7fa7-443f-a027-aca3fface091 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:12:09.463135 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-5e1bff3a-7fa7-443f-a027-aca3fface091 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08007dee07e4884b37e4beb78956be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8b7ce45a7d420c8e80648aef1eb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:12:09.472309 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-5e1bff3a-7fa7-443f-a027-aca3fface091 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] 10.222.0.69 "GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3" status: 200 len: 1357 microversion: 2.1 time: 0.264877 Jul 20 20:12:09.473583 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1977/2608] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:12:09 2022] GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3 => generated 1357 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:12:10.528692 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-795e1f26-5758-4a26-b5f2-7917c0001265 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:12:10.529301 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-795e1f26-5758-4a26-b5f2-7917c0001265 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] [instance: ebe9faba-2b02-4ab6-be69-e7830be3ddf3] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:12:10.535834 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-795e1f26-5758-4a26-b5f2-7917c0001265 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:12:10.536284 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-795e1f26-5758-4a26-b5f2-7917c0001265 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:12:10.537038 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-795e1f26-5758-4a26-b5f2-7917c0001265 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:12:10.537478 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-795e1f26-5758-4a26-b5f2-7917c0001265 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:12:10.668732 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-795e1f26-5758-4a26-b5f2-7917c0001265 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08007dee07e4884b37e4beb78956be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8b7ce45a7d420c8e80648aef1eb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:12:10.676845 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-795e1f26-5758-4a26-b5f2-7917c0001265 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] 10.222.0.69 "GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3" status: 200 len: 1357 microversion: 2.1 time: 0.151992 Jul 20 20:12:10.677413 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1978/2609] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:12:10 2022] GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3 => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:12:11.693561 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-30f7b4bc-7e22-4aee-b430-d8233c3ba9e9 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:12:11.694168 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-30f7b4bc-7e22-4aee-b430-d8233c3ba9e9 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] [instance: ebe9faba-2b02-4ab6-be69-e7830be3ddf3] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:12:11.700534 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-30f7b4bc-7e22-4aee-b430-d8233c3ba9e9 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:12:11.700976 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-30f7b4bc-7e22-4aee-b430-d8233c3ba9e9 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:12:11.701753 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-30f7b4bc-7e22-4aee-b430-d8233c3ba9e9 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:12:11.702982 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-30f7b4bc-7e22-4aee-b430-d8233c3ba9e9 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:12:11.829337 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-30f7b4bc-7e22-4aee-b430-d8233c3ba9e9 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08007dee07e4884b37e4beb78956be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8b7ce45a7d420c8e80648aef1eb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:12:11.836678 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-30f7b4bc-7e22-4aee-b430-d8233c3ba9e9 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] 10.222.0.69 "GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3" status: 200 len: 1357 microversion: 2.1 time: 0.147025 Jul 20 20:12:11.837231 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1979/2610] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:12:11 2022] GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3 => generated 1357 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:12:12.853200 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-9498be85-3483-4e5f-b556-711e136f9699 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:12:12.853906 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-9498be85-3483-4e5f-b556-711e136f9699 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] [instance: ebe9faba-2b02-4ab6-be69-e7830be3ddf3] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:12:12.860483 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9498be85-3483-4e5f-b556-711e136f9699 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:12:12.860923 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9498be85-3483-4e5f-b556-711e136f9699 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:12:12.861713 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9498be85-3483-4e5f-b556-711e136f9699 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:12:12.862410 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9498be85-3483-4e5f-b556-711e136f9699 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:12:12.988383 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-9498be85-3483-4e5f-b556-711e136f9699 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08007dee07e4884b37e4beb78956be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8b7ce45a7d420c8e80648aef1eb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:12:12.995754 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-9498be85-3483-4e5f-b556-711e136f9699 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] 10.222.0.69 "GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3" status: 200 len: 1357 microversion: 2.1 time: 0.146428 Jul 20 20:12:12.996315 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1980/2611] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:12:12 2022] GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3 => generated 1357 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:12:14.012225 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4f505d9e-1686-4c65-9092-44fec1ff9470 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:12:14.012844 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-4f505d9e-1686-4c65-9092-44fec1ff9470 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] [instance: ebe9faba-2b02-4ab6-be69-e7830be3ddf3] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:12:14.020212 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4f505d9e-1686-4c65-9092-44fec1ff9470 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:12:14.020652 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4f505d9e-1686-4c65-9092-44fec1ff9470 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:12:14.021398 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4f505d9e-1686-4c65-9092-44fec1ff9470 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:12:14.021850 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4f505d9e-1686-4c65-9092-44fec1ff9470 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:12:14.149280 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-4f505d9e-1686-4c65-9092-44fec1ff9470 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08007dee07e4884b37e4beb78956be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8b7ce45a7d420c8e80648aef1eb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:12:14.157791 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-4f505d9e-1686-4c65-9092-44fec1ff9470 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] 10.222.0.69 "GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3" status: 200 len: 1357 microversion: 2.1 time: 0.149347 Jul 20 20:12:14.158355 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1981/2612] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:12:14 2022] GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3 => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:12:15.174608 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ba975840-adb9-4ce7-9100-2102b2ce2f0e tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:12:15.175296 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ba975840-adb9-4ce7-9100-2102b2ce2f0e tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] [instance: ebe9faba-2b02-4ab6-be69-e7830be3ddf3] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:12:15.181736 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ba975840-adb9-4ce7-9100-2102b2ce2f0e tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:12:15.182188 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ba975840-adb9-4ce7-9100-2102b2ce2f0e tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:12:15.182958 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ba975840-adb9-4ce7-9100-2102b2ce2f0e tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:12:15.183393 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ba975840-adb9-4ce7-9100-2102b2ce2f0e tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:12:15.313774 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ba975840-adb9-4ce7-9100-2102b2ce2f0e tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08007dee07e4884b37e4beb78956be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8b7ce45a7d420c8e80648aef1eb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:12:15.317315 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=100 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 20:12:15.322721 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ba975840-adb9-4ce7-9100-2102b2ce2f0e tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] 10.222.0.69 "GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3" status: 200 len: 1357 microversion: 2.1 time: 0.152258 Jul 20 20:12:15.323291 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1982/2613] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:12:15 2022] GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:12:16.338968 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-45dbfa53-2bad-40f8-a425-7b1f41a96b7e tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:12:16.339577 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-45dbfa53-2bad-40f8-a425-7b1f41a96b7e tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] [instance: ebe9faba-2b02-4ab6-be69-e7830be3ddf3] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:12:16.346818 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-45dbfa53-2bad-40f8-a425-7b1f41a96b7e tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:12:16.347263 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-45dbfa53-2bad-40f8-a425-7b1f41a96b7e tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:12:16.348011 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-45dbfa53-2bad-40f8-a425-7b1f41a96b7e tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:12:16.348439 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-45dbfa53-2bad-40f8-a425-7b1f41a96b7e tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:12:16.740935 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-45dbfa53-2bad-40f8-a425-7b1f41a96b7e tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08007dee07e4884b37e4beb78956be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8b7ce45a7d420c8e80648aef1eb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:12:16.748337 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-45dbfa53-2bad-40f8-a425-7b1f41a96b7e tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] 10.222.0.69 "GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3" status: 200 len: 1357 microversion: 2.1 time: 0.413202 Jul 20 20:12:16.748908 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1983/2614] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:12:16 2022] GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3 => generated 1357 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:12:17.161648 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [req-32c8c940-163e-4eea-8b20-f393dec1ce29 req-19a36da6-4eb8-4ea6-af8d-10168d36df95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebe9faba-2b02-4ab6-be69-e7830be3ddf3", "name": "network-vif-plugged", "status": "completed", "tag": "f0e96a9c-0442-4c4b-834f-e403d781fcea"}]} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 20:12:17.170091 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-32c8c940-163e-4eea-8b20-f393dec1ce29 req-19a36da6-4eb8-4ea6-af8d-10168d36df95 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:12:17.170536 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-32c8c940-163e-4eea-8b20-f393dec1ce29 req-19a36da6-4eb8-4ea6-af8d-10168d36df95 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:12:17.182400 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.compute.server_external_events [req-32c8c940-163e-4eea-8b20-f393dec1ce29 req-19a36da6-4eb8-4ea6-af8d-10168d36df95 service nova] Creating event network-vif-plugged:f0e96a9c-0442-4c4b-834f-e403d781fcea for instance ebe9faba-2b02-4ab6-be69-e7830be3ddf3 on hv-cinder-83538 Jul 20 20:12:17.188452 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [req-32c8c940-163e-4eea-8b20-f393dec1ce29 req-19a36da6-4eb8-4ea6-af8d-10168d36df95 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030273 Jul 20 20:12:17.189041 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1984/2615] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 20:12:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 20:12:17.767368 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-faeee2e7-11a3-4cf4-a5cf-84d59d0880c5 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:12:17.768053 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-faeee2e7-11a3-4cf4-a5cf-84d59d0880c5 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] [instance: ebe9faba-2b02-4ab6-be69-e7830be3ddf3] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:12:17.774272 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-faeee2e7-11a3-4cf4-a5cf-84d59d0880c5 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:12:17.774719 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-faeee2e7-11a3-4cf4-a5cf-84d59d0880c5 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:12:17.775470 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-faeee2e7-11a3-4cf4-a5cf-84d59d0880c5 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:12:17.775898 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-faeee2e7-11a3-4cf4-a5cf-84d59d0880c5 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:12:17.906968 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-faeee2e7-11a3-4cf4-a5cf-84d59d0880c5 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08007dee07e4884b37e4beb78956be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8b7ce45a7d420c8e80648aef1eb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:12:17.914341 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-faeee2e7-11a3-4cf4-a5cf-84d59d0880c5 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] 10.222.0.69 "GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3" status: 200 len: 1357 microversion: 2.1 time: 0.152158 Jul 20 20:12:17.914901 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1985/2616] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:12:17 2022] GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:12:18.932812 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-92d25364-555d-4eb6-81f4-16a820ce90df tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:12:18.933569 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-92d25364-555d-4eb6-81f4-16a820ce90df tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] [instance: ebe9faba-2b02-4ab6-be69-e7830be3ddf3] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:12:18.940863 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-92d25364-555d-4eb6-81f4-16a820ce90df tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:12:18.941314 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-92d25364-555d-4eb6-81f4-16a820ce90df tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:12:18.942131 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-92d25364-555d-4eb6-81f4-16a820ce90df tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:12:18.942569 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-92d25364-555d-4eb6-81f4-16a820ce90df tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:12:19.078842 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-92d25364-555d-4eb6-81f4-16a820ce90df tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08007dee07e4884b37e4beb78956be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8b7ce45a7d420c8e80648aef1eb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:12:19.086254 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-92d25364-555d-4eb6-81f4-16a820ce90df tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] 10.222.0.69 "GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3" status: 200 len: 1357 microversion: 2.1 time: 0.158364 Jul 20 20:12:19.086808 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1986/2617] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:12:18 2022] GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3 => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 20:12:20.103106 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-7bf1288e-2d9c-4978-8c52-7b63882ecc3c tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:12:20.103719 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-7bf1288e-2d9c-4978-8c52-7b63882ecc3c tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] [instance: ebe9faba-2b02-4ab6-be69-e7830be3ddf3] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:12:20.110365 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7bf1288e-2d9c-4978-8c52-7b63882ecc3c tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:12:20.110818 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7bf1288e-2d9c-4978-8c52-7b63882ecc3c tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:12:20.111592 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7bf1288e-2d9c-4978-8c52-7b63882ecc3c tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:12:20.112024 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-7bf1288e-2d9c-4978-8c52-7b63882ecc3c tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:12:20.244631 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-7bf1288e-2d9c-4978-8c52-7b63882ecc3c tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08007dee07e4884b37e4beb78956be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8b7ce45a7d420c8e80648aef1eb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:12:20.252110 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-7bf1288e-2d9c-4978-8c52-7b63882ecc3c tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] 10.222.0.69 "GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3" status: 200 len: 1547 microversion: 2.1 time: 0.153068 Jul 20 20:12:20.252690 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1987/2618] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:12:20 2022] GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3 => generated 1547 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:12:20.268081 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-4711eec6-c71b-452e-b54b-1f398f30dada tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:12:20.268679 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-4711eec6-c71b-452e-b54b-1f398f30dada tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] [instance: ebe9faba-2b02-4ab6-be69-e7830be3ddf3] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:12:20.274428 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4711eec6-c71b-452e-b54b-1f398f30dada tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:12:20.274875 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4711eec6-c71b-452e-b54b-1f398f30dada tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:12:20.275622 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4711eec6-c71b-452e-b54b-1f398f30dada tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:12:20.276051 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-4711eec6-c71b-452e-b54b-1f398f30dada tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:12:20.406131 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-4711eec6-c71b-452e-b54b-1f398f30dada tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08007dee07e4884b37e4beb78956be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8b7ce45a7d420c8e80648aef1eb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:12:20.413694 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-4711eec6-c71b-452e-b54b-1f398f30dada tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] 10.222.0.69 "GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3" status: 200 len: 1547 microversion: 2.1 time: 0.149586 Jul 20 20:12:20.414261 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1988/2619] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:12:20 2022] GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3 => generated 1547 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:12:20.428460 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c1e46f3d-efe0-4d08-9d26-266f8aaf5ad0 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:12:20.431788 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c1e46f3d-efe0-4d08-9d26-266f8aaf5ad0 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e08007dee07e4884b37e4beb78956be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8b7ce45a7d420c8e80648aef1eb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:12:20.432541 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c1e46f3d-efe0-4d08-9d26-266f8aaf5ad0 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Searching by: {'deleted': False, 'project_id': 'cc8b7ce45a7d420c8e80648aef1eb14f'} {{(pid=117761) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 20:12:20.439354 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c1e46f3d-efe0-4d08-9d26-266f8aaf5ad0 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:12:20.439792 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c1e46f3d-efe0-4d08-9d26-266f8aaf5ad0 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:12:20.440570 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c1e46f3d-efe0-4d08-9d26-266f8aaf5ad0 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:12:20.440994 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c1e46f3d-efe0-4d08-9d26-266f8aaf5ad0 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:12:20.528533 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.multi_cell_list [None req-c1e46f3d-efe0-4d08-9d26-266f8aaf5ad0 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117761) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 20:12:20.621799 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c1e46f3d-efe0-4d08-9d26-266f8aaf5ad0 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] 10.222.0.69 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.196554 Jul 20 20:12:20.622477 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1989/2620] 10.222.0.69 () {58 vars in 1124 bytes} [Wed Jul 20 20:12:20 2022] GET /compute/v2.1/servers => generated 342 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 20:12:20.632532 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-603631a8-1b35-429e-9a8d-9386afeecca1 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:12:20.633127 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-603631a8-1b35-429e-9a8d-9386afeecca1 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] [instance: ebe9faba-2b02-4ab6-be69-e7830be3ddf3] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:12:20.638999 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-603631a8-1b35-429e-9a8d-9386afeecca1 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:12:20.639439 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-603631a8-1b35-429e-9a8d-9386afeecca1 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:12:20.640803 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-603631a8-1b35-429e-9a8d-9386afeecca1 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:12:20.641228 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-603631a8-1b35-429e-9a8d-9386afeecca1 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:12:20.766599 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-603631a8-1b35-429e-9a8d-9386afeecca1 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08007dee07e4884b37e4beb78956be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8b7ce45a7d420c8e80648aef1eb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:12:20.774088 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-603631a8-1b35-429e-9a8d-9386afeecca1 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] 10.222.0.69 "GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3" status: 200 len: 1547 microversion: 2.1 time: 0.145173 Jul 20 20:12:20.774656 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1990/2621] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:12:20 2022] GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3 => generated 1547 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:12:22.285487 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-b5e53c22-ad79-47db-837f-4cb501c4d074 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b264bb01-4f37-4367-aaaf-ce02a3c5d274"}} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 20:12:22.286682 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-b5e53c22-ad79-47db-837f-4cb501c4d074 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] [instance: ebe9faba-2b02-4ab6-be69-e7830be3ddf3] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:12:22.293222 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b5e53c22-ad79-47db-837f-4cb501c4d074 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:12:22.293703 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b5e53c22-ad79-47db-837f-4cb501c4d074 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:12:22.294458 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b5e53c22-ad79-47db-837f-4cb501c4d074 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:12:22.294883 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b5e53c22-ad79-47db-837f-4cb501c4d074 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:12:22.534909 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-b5e53c22-ad79-47db-837f-4cb501c4d074 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] 10.222.0.69 "POST /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253367 Jul 20 20:12:22.535702 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1991/2622] 10.222.0.69 () {60 vars in 1322 bytes} [Wed Jul 20 20:12:22 2022] POST /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 20:12:30.065054 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-38f3c3d3-48ac-4a76-bd38-a10a4bcd93b5 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:12:30.065796 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-38f3c3d3-48ac-4a76-bd38-a10a4bcd93b5 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] [instance: ebe9faba-2b02-4ab6-be69-e7830be3ddf3] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:12:30.068319 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=4 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 20:12:30.074061 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-38f3c3d3-48ac-4a76-bd38-a10a4bcd93b5 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:12:30.074514 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-38f3c3d3-48ac-4a76-bd38-a10a4bcd93b5 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:12:30.075275 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-38f3c3d3-48ac-4a76-bd38-a10a4bcd93b5 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:12:30.075713 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-38f3c3d3-48ac-4a76-bd38-a10a4bcd93b5 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:12:30.208507 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-38f3c3d3-48ac-4a76-bd38-a10a4bcd93b5 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08007dee07e4884b37e4beb78956be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8b7ce45a7d420c8e80648aef1eb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:12:30.216272 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-38f3c3d3-48ac-4a76-bd38-a10a4bcd93b5 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] 10.222.0.69 "GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3" status: 200 len: 1593 microversion: 2.1 time: 0.156084 Jul 20 20:12:30.216840 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1992/2623] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:12:30 2022] GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3 => generated 1593 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:12:31.881609 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [req-30e64098-670c-44f1-9a65-705169b4228b req-a0c16df7-d965-4e01-b14b-af53fc31633f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebe9faba-2b02-4ab6-be69-e7830be3ddf3", "tag": "f0e96a9c-0442-4c4b-834f-e403d781fcea"}]} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 20:12:31.886554 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell0:SELECT=2 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 20:12:31.891908 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-30e64098-670c-44f1-9a65-705169b4228b req-a0c16df7-d965-4e01-b14b-af53fc31633f service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:12:31.892353 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-30e64098-670c-44f1-9a65-705169b4228b req-a0c16df7-d965-4e01-b14b-af53fc31633f service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:12:31.904546 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.compute.server_external_events [req-30e64098-670c-44f1-9a65-705169b4228b req-a0c16df7-d965-4e01-b14b-af53fc31633f service nova] Creating event network-changed:f0e96a9c-0442-4c4b-834f-e403d781fcea for instance ebe9faba-2b02-4ab6-be69-e7830be3ddf3 on hv-cinder-83538 Jul 20 20:12:31.909799 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [req-30e64098-670c-44f1-9a65-705169b4228b req-a0c16df7-d965-4e01-b14b-af53fc31633f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031740 Jul 20 20:12:31.910517 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1993/2624] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 20:12:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 20:12:32.893166 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-03205342-440c-44fd-a797-175b7dd0292c tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-838507375"}} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 20:12:32.893833 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-03205342-440c-44fd-a797-175b7dd0292c tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] [instance: ebe9faba-2b02-4ab6-be69-e7830be3ddf3] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:12:32.899982 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-03205342-440c-44fd-a797-175b7dd0292c tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:12:32.900438 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-03205342-440c-44fd-a797-175b7dd0292c tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:12:32.901203 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-03205342-440c-44fd-a797-175b7dd0292c tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:12:32.901675 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-03205342-440c-44fd-a797-175b7dd0292c tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:12:33.033699 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.network.security_group_api [None req-03205342-440c-44fd-a797-175b7dd0292c tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Adding security group 0d5be65d-9c61-4da5-a360-418133ee063c to port f0e96a9c-0442-4c4b-834f-e403d781fcea Jul 20 20:12:33.375725 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-03205342-440c-44fd-a797-175b7dd0292c tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] 10.222.0.69 "POST /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3/action" status: 202 len: 0 microversion: 2.1 time: 0.487508 Jul 20 20:12:33.378505 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1994/2625] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Jul 20 20:12:32 2022] POST /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3/action => generated 0 bytes in 490 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 20:12:33.386833 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ace87ce7-dc7e-4d29-9098-8ae5cb32e790 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:12:33.387541 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ace87ce7-dc7e-4d29-9098-8ae5cb32e790 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] [instance: ebe9faba-2b02-4ab6-be69-e7830be3ddf3] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:12:33.396617 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ace87ce7-dc7e-4d29-9098-8ae5cb32e790 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:12:33.397141 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ace87ce7-dc7e-4d29-9098-8ae5cb32e790 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:12:33.398753 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ace87ce7-dc7e-4d29-9098-8ae5cb32e790 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:12:33.399298 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ace87ce7-dc7e-4d29-9098-8ae5cb32e790 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:12:33.559236 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-ace87ce7-dc7e-4d29-9098-8ae5cb32e790 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08007dee07e4884b37e4beb78956be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8b7ce45a7d420c8e80648aef1eb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:12:33.568258 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ace87ce7-dc7e-4d29-9098-8ae5cb32e790 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] 10.222.0.69 "GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3" status: 200 len: 1758 microversion: 2.1 time: 0.186517 Jul 20 20:12:33.568843 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1995/2626] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:12:33 2022] GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3 => generated 1758 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:12:33.924178 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [req-05f4fd77-39f1-472e-ad84-b0022bbe9877 req-922994f8-573f-4f82-8376-21830c29ada4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebe9faba-2b02-4ab6-be69-e7830be3ddf3", "tag": "f0e96a9c-0442-4c4b-834f-e403d781fcea"}]} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 20:12:33.932606 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-05f4fd77-39f1-472e-ad84-b0022bbe9877 req-922994f8-573f-4f82-8376-21830c29ada4 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:12:33.933040 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-05f4fd77-39f1-472e-ad84-b0022bbe9877 req-922994f8-573f-4f82-8376-21830c29ada4 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:12:33.944226 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.compute.server_external_events [req-05f4fd77-39f1-472e-ad84-b0022bbe9877 req-922994f8-573f-4f82-8376-21830c29ada4 service nova] Creating event network-changed:f0e96a9c-0442-4c4b-834f-e403d781fcea for instance ebe9faba-2b02-4ab6-be69-e7830be3ddf3 on hv-cinder-83538 Jul 20 20:12:33.949073 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [req-05f4fd77-39f1-472e-ad84-b0022bbe9877 req-922994f8-573f-4f82-8376-21830c29ada4 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029183 Jul 20 20:12:33.949848 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1996/2627] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 20:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 20:13:44.567249 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_api:SELECT=9 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 20:13:44.567980 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 20:13:44.572602 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-bfead05c-d171-41c1-8277-d370235a8d8f tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 20:13:44.573683 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-bfead05c-d171-41c1-8277-d370235a8d8f tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] [instance: ebe9faba-2b02-4ab6-be69-e7830be3ddf3] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:13:44.581239 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bfead05c-d171-41c1-8277-d370235a8d8f tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:13:44.581710 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bfead05c-d171-41c1-8277-d370235a8d8f tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:13:44.582460 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bfead05c-d171-41c1-8277-d370235a8d8f tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:13:44.582889 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-bfead05c-d171-41c1-8277-d370235a8d8f tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:13:44.658080 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-bfead05c-d171-41c1-8277-d370235a8d8f tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] 10.222.0.69 "POST /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3/action" status: 202 len: 0 microversion: 2.1 time: 0.092700 Jul 20 20:13:44.658727 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1997/2628] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Jul 20 20:13:44 2022] POST /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 20:13:44.667877 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-d2c2c289-09d9-481c-a8e5-1202824047ba tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:13:44.668576 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-d2c2c289-09d9-481c-a8e5-1202824047ba tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] [instance: ebe9faba-2b02-4ab6-be69-e7830be3ddf3] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:13:44.674875 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d2c2c289-09d9-481c-a8e5-1202824047ba tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:13:44.675450 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d2c2c289-09d9-481c-a8e5-1202824047ba tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:13:44.676225 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d2c2c289-09d9-481c-a8e5-1202824047ba tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:13:44.676659 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-d2c2c289-09d9-481c-a8e5-1202824047ba tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:13:44.909064 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-d2c2c289-09d9-481c-a8e5-1202824047ba tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08007dee07e4884b37e4beb78956be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8b7ce45a7d420c8e80648aef1eb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:13:44.917721 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-d2c2c289-09d9-481c-a8e5-1202824047ba tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] 10.222.0.69 "GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3" status: 200 len: 1750 microversion: 2.1 time: 0.253822 Jul 20 20:13:44.918293 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1998/2629] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:13:44 2022] GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3 => generated 1750 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:13:45.935365 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c0141892-e0f9-4f8d-a971-76f27be5fd1c tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:13:45.935972 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c0141892-e0f9-4f8d-a971-76f27be5fd1c tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] [instance: ebe9faba-2b02-4ab6-be69-e7830be3ddf3] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:13:45.942347 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c0141892-e0f9-4f8d-a971-76f27be5fd1c tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:13:45.942817 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c0141892-e0f9-4f8d-a971-76f27be5fd1c tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:13:45.943562 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c0141892-e0f9-4f8d-a971-76f27be5fd1c tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:13:45.944007 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c0141892-e0f9-4f8d-a971-76f27be5fd1c tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:13:46.083219 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c0141892-e0f9-4f8d-a971-76f27be5fd1c tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08007dee07e4884b37e4beb78956be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8b7ce45a7d420c8e80648aef1eb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:13:46.091564 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c0141892-e0f9-4f8d-a971-76f27be5fd1c tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] 10.222.0.69 "GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3" status: 200 len: 1755 microversion: 2.1 time: 0.160036 Jul 20 20:13:46.092061 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 1999/2630] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:13:45 2022] GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3 => generated 1755 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:13:47.109429 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-b27a1f2d-403a-4c1f-990c-800069172ec5 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:13:47.110097 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-b27a1f2d-403a-4c1f-990c-800069172ec5 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] [instance: ebe9faba-2b02-4ab6-be69-e7830be3ddf3] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:13:47.117414 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b27a1f2d-403a-4c1f-990c-800069172ec5 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:13:47.117901 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b27a1f2d-403a-4c1f-990c-800069172ec5 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:13:47.118723 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b27a1f2d-403a-4c1f-990c-800069172ec5 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:13:47.119157 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-b27a1f2d-403a-4c1f-990c-800069172ec5 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:13:47.262693 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-b27a1f2d-403a-4c1f-990c-800069172ec5 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08007dee07e4884b37e4beb78956be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8b7ce45a7d420c8e80648aef1eb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:13:47.270460 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-b27a1f2d-403a-4c1f-990c-800069172ec5 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] 10.222.0.69 "GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3" status: 200 len: 1755 microversion: 2.1 time: 0.165123 Jul 20 20:13:47.271019 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 2000/2631] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:13:47 2022] GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:13:48.287355 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-63c118bf-af65-42e9-a198-e5563b02aab8 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:13:48.288068 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-63c118bf-af65-42e9-a198-e5563b02aab8 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] [instance: ebe9faba-2b02-4ab6-be69-e7830be3ddf3] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:13:48.294488 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-63c118bf-af65-42e9-a198-e5563b02aab8 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:13:48.294940 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-63c118bf-af65-42e9-a198-e5563b02aab8 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:13:48.295694 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-63c118bf-af65-42e9-a198-e5563b02aab8 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:13:48.296127 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-63c118bf-af65-42e9-a198-e5563b02aab8 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:13:48.436547 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-63c118bf-af65-42e9-a198-e5563b02aab8 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08007dee07e4884b37e4beb78956be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8b7ce45a7d420c8e80648aef1eb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:13:48.444968 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-63c118bf-af65-42e9-a198-e5563b02aab8 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] 10.222.0.69 "GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3" status: 200 len: 1755 microversion: 2.1 time: 0.160893 Jul 20 20:13:48.445554 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 2001/2632] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:13:48 2022] GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:13:49.462493 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e9844578-f4b4-419a-ac74-136bee6d4242 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:13:49.463097 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e9844578-f4b4-419a-ac74-136bee6d4242 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] [instance: ebe9faba-2b02-4ab6-be69-e7830be3ddf3] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:13:49.469464 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e9844578-f4b4-419a-ac74-136bee6d4242 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:13:49.469934 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e9844578-f4b4-419a-ac74-136bee6d4242 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:13:49.470690 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e9844578-f4b4-419a-ac74-136bee6d4242 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:13:49.471119 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e9844578-f4b4-419a-ac74-136bee6d4242 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:13:49.612897 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-e9844578-f4b4-419a-ac74-136bee6d4242 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08007dee07e4884b37e4beb78956be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8b7ce45a7d420c8e80648aef1eb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:13:49.621329 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e9844578-f4b4-419a-ac74-136bee6d4242 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] 10.222.0.69 "GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3" status: 200 len: 1755 microversion: 2.1 time: 0.163174 Jul 20 20:13:49.621941 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 2002/2633] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:13:49 2022] GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:13:50.639703 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-8719e360-5b1f-4c1b-83ee-63d27b6caec8 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:13:50.640321 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-8719e360-5b1f-4c1b-83ee-63d27b6caec8 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] [instance: ebe9faba-2b02-4ab6-be69-e7830be3ddf3] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:13:50.646544 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8719e360-5b1f-4c1b-83ee-63d27b6caec8 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:13:50.646985 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8719e360-5b1f-4c1b-83ee-63d27b6caec8 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:13:50.648375 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8719e360-5b1f-4c1b-83ee-63d27b6caec8 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:13:50.648795 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-8719e360-5b1f-4c1b-83ee-63d27b6caec8 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:13:50.791469 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-8719e360-5b1f-4c1b-83ee-63d27b6caec8 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08007dee07e4884b37e4beb78956be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8b7ce45a7d420c8e80648aef1eb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:13:50.799304 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-8719e360-5b1f-4c1b-83ee-63d27b6caec8 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] 10.222.0.69 "GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3" status: 200 len: 1755 microversion: 2.1 time: 0.163486 Jul 20 20:13:50.799867 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 2003/2634] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:13:50 2022] GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:13:51.816149 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-a8b8170c-75e9-4476-a82a-6323254b3d59 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:13:51.816798 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-a8b8170c-75e9-4476-a82a-6323254b3d59 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] [instance: ebe9faba-2b02-4ab6-be69-e7830be3ddf3] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:13:51.823460 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a8b8170c-75e9-4476-a82a-6323254b3d59 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:13:51.823904 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a8b8170c-75e9-4476-a82a-6323254b3d59 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:13:51.824653 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a8b8170c-75e9-4476-a82a-6323254b3d59 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:13:51.825080 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-a8b8170c-75e9-4476-a82a-6323254b3d59 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:13:51.967049 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-a8b8170c-75e9-4476-a82a-6323254b3d59 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08007dee07e4884b37e4beb78956be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8b7ce45a7d420c8e80648aef1eb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:13:51.974927 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-a8b8170c-75e9-4476-a82a-6323254b3d59 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] 10.222.0.69 "GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3" status: 200 len: 1755 microversion: 2.1 time: 0.162637 Jul 20 20:13:51.976013 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 2004/2635] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:13:51 2022] GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:13:52.993282 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c8f34bea-49be-4d31-a091-e4ea869f8a2a tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:13:52.994096 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c8f34bea-49be-4d31-a091-e4ea869f8a2a tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] [instance: ebe9faba-2b02-4ab6-be69-e7830be3ddf3] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:13:53.000771 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c8f34bea-49be-4d31-a091-e4ea869f8a2a tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:13:53.001251 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c8f34bea-49be-4d31-a091-e4ea869f8a2a tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:13:53.002044 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c8f34bea-49be-4d31-a091-e4ea869f8a2a tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:13:53.002507 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c8f34bea-49be-4d31-a091-e4ea869f8a2a tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:13:53.147737 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c8f34bea-49be-4d31-a091-e4ea869f8a2a tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08007dee07e4884b37e4beb78956be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8b7ce45a7d420c8e80648aef1eb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:13:53.155902 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c8f34bea-49be-4d31-a091-e4ea869f8a2a tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] 10.222.0.69 "GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3" status: 200 len: 1755 microversion: 2.1 time: 0.167474 Jul 20 20:13:53.156476 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 2005/2636] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:13:52 2022] GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:13:54.173731 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-91907093-c6a1-4d76-99d7-827889432abe tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:13:54.174374 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-91907093-c6a1-4d76-99d7-827889432abe tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] [instance: ebe9faba-2b02-4ab6-be69-e7830be3ddf3] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:13:54.181134 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-91907093-c6a1-4d76-99d7-827889432abe tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:13:54.181627 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-91907093-c6a1-4d76-99d7-827889432abe tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:13:54.182397 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-91907093-c6a1-4d76-99d7-827889432abe tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:13:54.182836 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-91907093-c6a1-4d76-99d7-827889432abe tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:13:54.323027 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-91907093-c6a1-4d76-99d7-827889432abe tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08007dee07e4884b37e4beb78956be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8b7ce45a7d420c8e80648aef1eb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:13:54.331122 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-91907093-c6a1-4d76-99d7-827889432abe tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] 10.222.0.69 "GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3" status: 200 len: 1755 microversion: 2.1 time: 0.161565 Jul 20 20:13:54.331686 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 2006/2637] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:13:54 2022] GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:13:55.348158 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-46f38138-1ec3-4fbb-a819-6a73f6365ef2 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:13:55.348770 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-46f38138-1ec3-4fbb-a819-6a73f6365ef2 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] [instance: ebe9faba-2b02-4ab6-be69-e7830be3ddf3] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:13:55.356296 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-46f38138-1ec3-4fbb-a819-6a73f6365ef2 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:13:55.356747 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-46f38138-1ec3-4fbb-a819-6a73f6365ef2 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:13:55.357526 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-46f38138-1ec3-4fbb-a819-6a73f6365ef2 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:13:55.357960 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-46f38138-1ec3-4fbb-a819-6a73f6365ef2 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:13:55.500881 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-46f38138-1ec3-4fbb-a819-6a73f6365ef2 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08007dee07e4884b37e4beb78956be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8b7ce45a7d420c8e80648aef1eb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:13:55.509364 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-46f38138-1ec3-4fbb-a819-6a73f6365ef2 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] 10.222.0.69 "GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3" status: 200 len: 1755 microversion: 2.1 time: 0.165020 Jul 20 20:13:55.509892 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 2007/2638] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:13:55 2022] GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:13:56.526275 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-c0200455-b5e9-4adf-9a31-191f589d0e1d tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:13:56.526917 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-c0200455-b5e9-4adf-9a31-191f589d0e1d tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] [instance: ebe9faba-2b02-4ab6-be69-e7830be3ddf3] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:13:56.533272 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c0200455-b5e9-4adf-9a31-191f589d0e1d tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:13:56.533758 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c0200455-b5e9-4adf-9a31-191f589d0e1d tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:13:56.534528 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c0200455-b5e9-4adf-9a31-191f589d0e1d tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:13:56.534940 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-c0200455-b5e9-4adf-9a31-191f589d0e1d tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:13:56.677416 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-c0200455-b5e9-4adf-9a31-191f589d0e1d tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08007dee07e4884b37e4beb78956be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8b7ce45a7d420c8e80648aef1eb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:13:56.685384 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-c0200455-b5e9-4adf-9a31-191f589d0e1d tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] 10.222.0.69 "GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3" status: 200 len: 1758 microversion: 2.1 time: 0.163043 Jul 20 20:13:56.685973 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 2008/2639] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:13:56 2022] GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3 => generated 1758 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:15:02.190526 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_api:SELECT=24 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 20:15:02.191282 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG dbcounter [-] [117761] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 20:15:02.195709 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ccd5405e-cb1b-4d25-aced-94c7c293d3bc tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-838507375"}} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 20:15:02.196304 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ccd5405e-cb1b-4d25-aced-94c7c293d3bc tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] [instance: ebe9faba-2b02-4ab6-be69-e7830be3ddf3] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:15:02.204581 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ccd5405e-cb1b-4d25-aced-94c7c293d3bc tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:15:02.205030 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ccd5405e-cb1b-4d25-aced-94c7c293d3bc tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:15:02.205822 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ccd5405e-cb1b-4d25-aced-94c7c293d3bc tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:15:02.206257 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ccd5405e-cb1b-4d25-aced-94c7c293d3bc tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:15:02.337341 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.network.security_group_api [None req-ccd5405e-cb1b-4d25-aced-94c7c293d3bc tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Removing security group 0d5be65d-9c61-4da5-a360-418133ee063c from port f0e96a9c-0442-4c4b-834f-e403d781fcea Jul 20 20:15:02.675634 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ccd5405e-cb1b-4d25-aced-94c7c293d3bc tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] 10.222.0.69 "POST /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3/action" status: 202 len: 0 microversion: 2.1 time: 0.486618 Jul 20 20:15:02.677001 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 2009/2640] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Jul 20 20:15:02 2022] POST /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3/action => generated 0 bytes in 489 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 20:15:02.835704 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [req-c5dfb471-ed88-49fb-a58b-10139476b01c req-3a884b62-3768-4f1b-a23e-7ab03050b9c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebe9faba-2b02-4ab6-be69-e7830be3ddf3", "tag": "f0e96a9c-0442-4c4b-834f-e403d781fcea"}]} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 20:15:02.846758 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-c5dfb471-ed88-49fb-a58b-10139476b01c req-3a884b62-3768-4f1b-a23e-7ab03050b9c3 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:15:02.847318 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-c5dfb471-ed88-49fb-a58b-10139476b01c req-3a884b62-3768-4f1b-a23e-7ab03050b9c3 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:15:02.863866 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.compute.server_external_events [req-c5dfb471-ed88-49fb-a58b-10139476b01c req-3a884b62-3768-4f1b-a23e-7ab03050b9c3 service nova] Creating event network-changed:f0e96a9c-0442-4c4b-834f-e403d781fcea for instance ebe9faba-2b02-4ab6-be69-e7830be3ddf3 on hv-cinder-83538 Jul 20 20:15:02.869776 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [req-c5dfb471-ed88-49fb-a58b-10139476b01c req-3a884b62-3768-4f1b-a23e-7ab03050b9c3 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.183514 Jul 20 20:15:02.871575 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 2010/2641] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 20:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 20:15:04.099827 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-e622615b-85c9-4538-9db1-7ff7b5b4f5c2 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:15:04.100444 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-e622615b-85c9-4538-9db1-7ff7b5b4f5c2 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] [instance: ebe9faba-2b02-4ab6-be69-e7830be3ddf3] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:15:04.106770 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e622615b-85c9-4538-9db1-7ff7b5b4f5c2 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:15:04.107291 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e622615b-85c9-4538-9db1-7ff7b5b4f5c2 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:15:04.108687 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e622615b-85c9-4538-9db1-7ff7b5b4f5c2 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:15:04.109130 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-e622615b-85c9-4538-9db1-7ff7b5b4f5c2 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:15:04.190303 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.objects.instance [None req-e622615b-85c9-4538-9db1-7ff7b5b4f5c2 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lazy-loading 'services' on Instance uuid ebe9faba-2b02-4ab6-be69-e7830be3ddf3 {{(pid=117761) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 20:15:04.263587 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-e622615b-85c9-4538-9db1-7ff7b5b4f5c2 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] 10.222.0.69 "DELETE /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3/os-volume_attachments/b264bb01-4f37-4367-aaaf-ce02a3c5d274" status: 202 len: 0 microversion: 2.1 time: 0.168375 Jul 20 20:15:04.264640 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 2011/2642] 10.222.0.69 () {58 vars in 1415 bytes} [Wed Jul 20 20:15:04 2022] DELETE /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3/os-volume_attachments/b264bb01-4f37-4367-aaaf-ce02a3c5d274 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 20:15:04.273125 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-ac7677d8-049b-43a4-9021-781d0d90bc92 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:15:04.274520 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-ac7677d8-049b-43a4-9021-781d0d90bc92 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] [instance: ebe9faba-2b02-4ab6-be69-e7830be3ddf3] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:15:04.282510 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ac7677d8-049b-43a4-9021-781d0d90bc92 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:15:04.283039 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ac7677d8-049b-43a4-9021-781d0d90bc92 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:15:04.284023 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ac7677d8-049b-43a4-9021-781d0d90bc92 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:15:04.284529 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-ac7677d8-049b-43a4-9021-781d0d90bc92 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:15:04.327626 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-ac7677d8-049b-43a4-9021-781d0d90bc92 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] 10.222.0.69 "GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058516 Jul 20 20:15:04.328398 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 2012/2643] 10.222.0.69 () {58 vars in 1301 bytes} [Wed Jul 20 20:15:04 2022] GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 20:15:04.885791 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [req-9e96ca36-aa57-4ae0-bd44-c3610af3d195 req-75882ffd-6c8a-48df-975b-2970dda795f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebe9faba-2b02-4ab6-be69-e7830be3ddf3", "tag": "f0e96a9c-0442-4c4b-834f-e403d781fcea"}]} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 20:15:04.894274 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-9e96ca36-aa57-4ae0-bd44-c3610af3d195 req-75882ffd-6c8a-48df-975b-2970dda795f1 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:15:04.894723 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-9e96ca36-aa57-4ae0-bd44-c3610af3d195 req-75882ffd-6c8a-48df-975b-2970dda795f1 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:15:04.906552 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.compute.server_external_events [req-9e96ca36-aa57-4ae0-bd44-c3610af3d195 req-75882ffd-6c8a-48df-975b-2970dda795f1 service nova] Creating event network-changed:f0e96a9c-0442-4c4b-834f-e403d781fcea for instance ebe9faba-2b02-4ab6-be69-e7830be3ddf3 on hv-cinder-83538 Jul 20 20:15:04.911569 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [req-9e96ca36-aa57-4ae0-bd44-c3610af3d195 req-75882ffd-6c8a-48df-975b-2970dda795f1 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029486 Jul 20 20:15:04.912341 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 2013/2644] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 20:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 20:15:05.341235 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-801cbe8e-ae70-4edd-b631-32d1b491fd79 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:15:05.342281 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-801cbe8e-ae70-4edd-b631-32d1b491fd79 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] [instance: ebe9faba-2b02-4ab6-be69-e7830be3ddf3] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:15:05.348594 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-801cbe8e-ae70-4edd-b631-32d1b491fd79 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:15:05.349102 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-801cbe8e-ae70-4edd-b631-32d1b491fd79 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:15:05.349913 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-801cbe8e-ae70-4edd-b631-32d1b491fd79 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:15:05.350342 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-801cbe8e-ae70-4edd-b631-32d1b491fd79 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:15:05.378768 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-801cbe8e-ae70-4edd-b631-32d1b491fd79 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] 10.222.0.69 "GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042162 Jul 20 20:15:05.379557 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 2014/2645] 10.222.0.69 () {58 vars in 1301 bytes} [Wed Jul 20 20:15:05 2022] GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 20:15:05.388709 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-10729869-c65e-4e9f-a44c-113b4c363a10 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:15:05.389190 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-10729869-c65e-4e9f-a44c-113b4c363a10 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] [instance: ebe9faba-2b02-4ab6-be69-e7830be3ddf3] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:15:05.396254 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-10729869-c65e-4e9f-a44c-113b4c363a10 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:15:05.396696 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-10729869-c65e-4e9f-a44c-113b4c363a10 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:15:05.397458 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-10729869-c65e-4e9f-a44c-113b4c363a10 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:15:05.397909 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-10729869-c65e-4e9f-a44c-113b4c363a10 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:15:05.478473 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.wsgi [None req-10729869-c65e-4e9f-a44c-113b4c363a10 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] HTTP exception thrown: Instance ebe9faba-2b02-4ab6-be69-e7830be3ddf3 is not attached to volume b264bb01-4f37-4367-aaaf-ce02a3c5d274 Jul 20 20:15:05.480354 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-10729869-c65e-4e9f-a44c-113b4c363a10 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Request method failure captured: Jul 20 20:15:05.480354 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: DELETE /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3/os-volume_attachments/b264bb01-4f37-4367-aaaf-ce02a3c5d274 HTTP/1.1 Jul 20 20:15:05.480354 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 20:15:05.480354 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 20:15:05.480354 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 20:15:05.480354 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 0 Jul 20 20:15:05.480354 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 20:15:05.480354 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 20:15:05.480354 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 20:15:05.480354 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 20:15:05.480354 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2GF8JXvGaPOK3P41Uj4zFXTZ5vWXA9ijeMZ-fxLfdmVyWTFwNUHeTLBpFVY3sSQ9U3_xtc-ljZFJSfhVWo2zzJwmlTS-Npj276mVutUl-21uCtoaJle-1gjsqiDoazvngj3P7tteoxkzEO_lEx6iQw_N4oN6TwcMnBcyz-sddXCdFOA Jul 20 20:15:05.480354 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 20:15:05.480354 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 20:15:05.480354 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 20:15:05.480354 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 20:15:05.480354 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 20:15:05.480354 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 20:15:05.480354 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: cc8b7ce45a7d420c8e80648aef1eb14f Jul 20 20:15:05.480354 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-TestMinimumBasicScenario-1389843331 Jul 20 20:15:05.480354 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 20:15:05.480354 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 20:15:05.481804 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/cc8b7ce45a7d420c8e80648aef1eb14f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/cc8b7ce45a7d420c8e80648aef1eb14f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_cc8b7ce45a7d420c8e80648aef1eb14f", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/cc8b7ce45a7d420c8e80648aef1eb14f"}]}] Jul 20 20:15:05.481804 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-TestMinimumBasicScenario-1389843331 Jul 20 20:15:05.481804 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: cc8b7ce45a7d420c8e80648aef1eb14f Jul 20 20:15:05.481804 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1389843331 Jul 20 20:15:05.481804 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-TestMinimumBasicScenario-1389843331-project Jul 20 20:15:05.481804 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 20:15:05.481804 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 20:15:05.481804 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: e08007dee07e4884b37e4beb78956be5 Jul 20 20:15:05.481804 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-TestMinimumBasicScenario-1389843331-project Jul 20 20:15:05.481804 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: > Jul 20 20:15:05.481804 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Instance ebe9faba-2b02-4ab6-be69-e7830be3ddf3 is not attached to volume b264bb01-4f37-4367-aaaf-ce02a3c5d274 Jul 20 20:15:05.482507 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'server_id': 'ebe9faba-2b02-4ab6-be69-e7830be3ddf3', 'id': 'b264bb01-4f37-4367-aaaf-ce02a3c5d274'} Jul 20 20:15:05.482507 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 20:15:05.482507 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:15:05.482507 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 20 20:15:05.482507 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 20 20:15:05.482507 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 20:15:05.482507 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 20:15:05.482507 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 20 20:15:05.482507 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 20 20:15:05.482507 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id b264bb01-4f37-4367-aaaf-ce02a3c5d274. Jul 20 20:15:05.482507 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:15:05.482507 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:15:05.482507 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:15:05.482507 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:15:05.482507 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:15:05.482507 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:15:05.482507 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 20:15:05.482507 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 20:15:05.482507 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 20:15:05.483648 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 20:15:05.483648 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 20 20:15:05.483648 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 20:15:05.483648 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebe9faba-2b02-4ab6-be69-e7830be3ddf3 is not attached to volume b264bb01-4f37-4367-aaaf-ce02a3c5d274 Jul 20 20:15:05.483648 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:15:05.483648 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:15:05.483648 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:15:05.483648 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:15:05.483648 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:15:05.483648 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:15:05.483648 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 20:15:05.483648 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 20:15:05.483648 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebe9faba-2b02-4ab6-be69-e7830be3ddf3 is not attached to volume b264bb01-4f37-4367-aaaf-ce02a3c5d274 Jul 20 20:15:05.483648 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:15:05.483648 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-10729869-c65e-4e9f-a44c-113b4c363a10 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Returning 404 to user: Instance ebe9faba-2b02-4ab6-be69-e7830be3ddf3 is not attached to volume b264bb01-4f37-4367-aaaf-ce02a3c5d274 {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 20:15:05.484466 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-10729869-c65e-4e9f-a44c-113b4c363a10 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] 10.222.0.69 "DELETE /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3/os-volume_attachments/b264bb01-4f37-4367-aaaf-ce02a3c5d274" status: 404 len: 154 microversion: 2.1 time: 0.096795 Jul 20 20:15:05.484466 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 2015/2646] 10.222.0.69 () {58 vars in 1415 bytes} [Wed Jul 20 20:15:05 2022] DELETE /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3/os-volume_attachments/b264bb01-4f37-4367-aaaf-ce02a3c5d274 => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 20:15:06.621420 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-352de25e-662b-4aa0-8697-1fd8f70813a3 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:15:06.622077 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-352de25e-662b-4aa0-8697-1fd8f70813a3 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] [instance: ebe9faba-2b02-4ab6-be69-e7830be3ddf3] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:15:06.629225 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-352de25e-662b-4aa0-8697-1fd8f70813a3 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:15:06.629724 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-352de25e-662b-4aa0-8697-1fd8f70813a3 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:15:06.630488 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-352de25e-662b-4aa0-8697-1fd8f70813a3 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:15:06.630923 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-352de25e-662b-4aa0-8697-1fd8f70813a3 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:15:06.655917 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-352de25e-662b-4aa0-8697-1fd8f70813a3 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] [instance: ebe9faba-2b02-4ab6-be69-e7830be3ddf3] Going to try to terminate instance {{(pid=117761) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 20:15:06.728767 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-352de25e-662b-4aa0-8697-1fd8f70813a3 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] 10.222.0.69 "DELETE /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3" status: 204 len: 0 microversion: 2.1 time: 0.111161 Jul 20 20:15:06.729348 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 2016/2647] 10.222.0.69 () {58 vars in 1238 bytes} [Wed Jul 20 20:15:06 2022] DELETE /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 20:15:06.739905 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-aa826972-ebe1-4e77-a8b6-ba53df748909 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:15:06.740635 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-aa826972-ebe1-4e77-a8b6-ba53df748909 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] [instance: ebe9faba-2b02-4ab6-be69-e7830be3ddf3] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:15:06.746720 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aa826972-ebe1-4e77-a8b6-ba53df748909 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:15:06.747173 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aa826972-ebe1-4e77-a8b6-ba53df748909 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:15:06.747932 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aa826972-ebe1-4e77-a8b6-ba53df748909 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:15:06.748367 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-aa826972-ebe1-4e77-a8b6-ba53df748909 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:15:06.875790 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-aa826972-ebe1-4e77-a8b6-ba53df748909 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08007dee07e4884b37e4beb78956be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8b7ce45a7d420c8e80648aef1eb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:15:06.883172 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-aa826972-ebe1-4e77-a8b6-ba53df748909 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] 10.222.0.69 "GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3" status: 200 len: 1553 microversion: 2.1 time: 0.147555 Jul 20 20:15:06.883730 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 2017/2648] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:15:06 2022] GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3 => generated 1553 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:15:07.900101 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-9fa1316f-bb2b-4dcc-809b-fefd66a6f187 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:15:07.900707 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-9fa1316f-bb2b-4dcc-809b-fefd66a6f187 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] [instance: ebe9faba-2b02-4ab6-be69-e7830be3ddf3] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:15:07.907863 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9fa1316f-bb2b-4dcc-809b-fefd66a6f187 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:15:07.908310 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9fa1316f-bb2b-4dcc-809b-fefd66a6f187 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:15:07.909063 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9fa1316f-bb2b-4dcc-809b-fefd66a6f187 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:15:07.909492 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-9fa1316f-bb2b-4dcc-809b-fefd66a6f187 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:15:08.035986 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-9fa1316f-bb2b-4dcc-809b-fefd66a6f187 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08007dee07e4884b37e4beb78956be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8b7ce45a7d420c8e80648aef1eb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:15:08.043500 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-9fa1316f-bb2b-4dcc-809b-fefd66a6f187 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] 10.222.0.69 "GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3" status: 200 len: 1553 microversion: 2.1 time: 0.147236 Jul 20 20:15:08.044063 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 2018/2649] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:15:07 2022] GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3 => generated 1553 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:15:09.060179 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-3eaa7962-0bcf-4a80-804b-4ee953d8b40d tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:15:09.060841 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-3eaa7962-0bcf-4a80-804b-4ee953d8b40d tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] [instance: ebe9faba-2b02-4ab6-be69-e7830be3ddf3] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:15:09.067381 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3eaa7962-0bcf-4a80-804b-4ee953d8b40d tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:15:09.067831 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3eaa7962-0bcf-4a80-804b-4ee953d8b40d tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:15:09.068600 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3eaa7962-0bcf-4a80-804b-4ee953d8b40d tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:15:09.069030 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-3eaa7962-0bcf-4a80-804b-4ee953d8b40d tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:15:09.273046 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.policy [None req-3eaa7962-0bcf-4a80-804b-4ee953d8b40d tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e08007dee07e4884b37e4beb78956be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8b7ce45a7d420c8e80648aef1eb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117761) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 20:15:09.280954 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-3eaa7962-0bcf-4a80-804b-4ee953d8b40d tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] 10.222.0.69 "GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3" status: 200 len: 1553 microversion: 2.1 time: 0.224076 Jul 20 20:15:09.281542 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 2019/2650] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:15:09 2022] GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3 => generated 1553 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 20:15:09.418872 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [req-5d0669d0-0fab-4803-b7d7-96f0bee2897e req-992ea7e2-6016-4328-b312-5224ca94cfc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebe9faba-2b02-4ab6-be69-e7830be3ddf3", "name": "network-vif-deleted", "tag": "f0e96a9c-0442-4c4b-834f-e403d781fcea"}]} {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 20:15:09.429891 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-5d0669d0-0fab-4803-b7d7-96f0bee2897e req-992ea7e2-6016-4328-b312-5224ca94cfc7 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:15:09.430848 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [req-5d0669d0-0fab-4803-b7d7-96f0bee2897e req-992ea7e2-6016-4328-b312-5224ca94cfc7 service nova] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:15:09.443817 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.compute.server_external_events [req-5d0669d0-0fab-4803-b7d7-96f0bee2897e req-992ea7e2-6016-4328-b312-5224ca94cfc7 service nova] Creating event network-vif-deleted:f0e96a9c-0442-4c4b-834f-e403d781fcea for instance ebe9faba-2b02-4ab6-be69-e7830be3ddf3 on hv-cinder-83538 Jul 20 20:15:09.449785 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [req-5d0669d0-0fab-4803-b7d7-96f0bee2897e req-992ea7e2-6016-4328-b312-5224ca94cfc7 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034485 Jul 20 20:15:09.450314 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 2020/2651] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Jul 20 20:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 20:15:10.298987 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-77409c48-9ed9-4e54-8c78-953984362cc7 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Calling method '>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:15:10.299677 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.compute.api [None req-77409c48-9ed9-4e54-8c78-953984362cc7 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] [instance: ebe9faba-2b02-4ab6-be69-e7830be3ddf3] Fetching instance by UUID {{(pid=117761) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 20:15:10.306560 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-77409c48-9ed9-4e54-8c78-953984362cc7 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:15:10.307003 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-77409c48-9ed9-4e54-8c78-953984362cc7 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:15:10.307755 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-77409c48-9ed9-4e54-8c78-953984362cc7 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 20:15:10.308180 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG oslo_concurrency.lockutils [None req-77409c48-9ed9-4e54-8c78-953984362cc7 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Lock "691618a6-9620-40ee-ad72-b687b651ed73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 20:15:10.322995 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.wsgi [None req-77409c48-9ed9-4e54-8c78-953984362cc7 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] HTTP exception thrown: Instance ebe9faba-2b02-4ab6-be69-e7830be3ddf3 could not be found. Jul 20 20:15:10.325743 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-77409c48-9ed9-4e54-8c78-953984362cc7 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Request method failure captured: Jul 20 20:15:10.325743 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: request: GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3 HTTP/1.1 Jul 20 20:15:10.325743 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept: application/json Jul 20 20:15:10.325743 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Accept-Encoding: identity Jul 20 20:15:10.325743 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Connection: close Jul 20 20:15:10.325743 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Length: 0 Jul 20 20:15:10.325743 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Content-Type: application/json Jul 20 20:15:10.325743 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Host: 10.222.0.69 Jul 20 20:15:10.325743 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Openstack-System-Scope: None Jul 20 20:15:10.325743 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: User-Agent: python-urllib3/1.26.9 Jul 20 20:15:10.325743 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Auth-Token: gAAAAABi2GF8JXvGaPOK3P41Uj4zFXTZ5vWXA9ijeMZ-fxLfdmVyWTFwNUHeTLBpFVY3sSQ9U3_xtc-ljZFJSfhVWo2zzJwmlTS-Npj276mVutUl-21uCtoaJle-1gjsqiDoazvngj3P7tteoxkzEO_lEx6iQw_N4oN6TwcMnBcyz-sddXCdFOA Jul 20 20:15:10.325743 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Id: None Jul 20 20:15:10.325743 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Domain-Name: None Jul 20 20:15:10.325743 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Identity-Status: Confirmed Jul 20 20:15:10.325743 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Is-Admin-Project: True Jul 20 20:15:10.325743 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Id: default Jul 20 20:15:10.325743 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Domain-Name: Default Jul 20 20:15:10.325743 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Id: cc8b7ce45a7d420c8e80648aef1eb14f Jul 20 20:15:10.325743 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Project-Name: tempest-TestMinimumBasicScenario-1389843331 Jul 20 20:15:10.325743 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Role: reader,member Jul 20 20:15:10.325743 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Roles: reader,member Jul 20 20:15:10.327878 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/cc8b7ce45a7d420c8e80648aef1eb14f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/cc8b7ce45a7d420c8e80648aef1eb14f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_cc8b7ce45a7d420c8e80648aef1eb14f", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/cc8b7ce45a7d420c8e80648aef1eb14f"}]}] Jul 20 20:15:10.327878 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant: tempest-TestMinimumBasicScenario-1389843331 Jul 20 20:15:10.327878 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Id: cc8b7ce45a7d420c8e80648aef1eb14f Jul 20 20:15:10.327878 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1389843331 Jul 20 20:15:10.327878 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User: tempest-TestMinimumBasicScenario-1389843331-project Jul 20 20:15:10.327878 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Id: default Jul 20 20:15:10.327878 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Domain-Name: Default Jul 20 20:15:10.327878 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Id: e08007dee07e4884b37e4beb78956be5 Jul 20 20:15:10.327878 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: X-User-Name: tempest-TestMinimumBasicScenario-1389843331-project Jul 20 20:15:10.327878 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: method: > Jul 20 20:15:10.327878 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: exception: Instance ebe9faba-2b02-4ab6-be69-e7830be3ddf3 could not be found. Jul 20 20:15:10.327878 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: action_args: {'id': 'ebe9faba-2b02-4ab6-be69-e7830be3ddf3'} Jul 20 20:15:10.328729 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 20:15:10.328729 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:15:10.328729 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 20:15:10.328729 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 20:15:10.328729 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 20:15:10.328729 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 20:15:10.328729 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 20:15:10.328729 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 20:15:10.328729 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 20:15:10.328729 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 20:15:10.328729 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebe9faba-2b02-4ab6-be69-e7830be3ddf3 could not be found. Jul 20 20:15:10.328729 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:15:10.328729 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:15:10.328729 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:15:10.328729 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:15:10.328729 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:15:10.328729 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:15:10.328729 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 20:15:10.328729 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 20:15:10.328729 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 20:15:10.330088 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 20:15:10.330088 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 20:15:10.330088 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 20:15:10.330088 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 20:15:10.330088 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 20:15:10.330088 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 20:15:10.330088 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 20:15:10.330088 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebe9faba-2b02-4ab6-be69-e7830be3ddf3 could not be found. Jul 20 20:15:10.330088 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:15:10.330088 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 20:15:10.330088 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:15:10.330088 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 20:15:10.330088 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 20:15:10.330088 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 20:15:10.330088 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 20:15:10.330088 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 20:15:10.330088 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebe9faba-2b02-4ab6-be69-e7830be3ddf3 could not be found. Jul 20 20:15:10.330088 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: ERROR nova.api.openstack.wsgi Jul 20 20:15:10.331348 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-77409c48-9ed9-4e54-8c78-953984362cc7 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Returning 404 to user: Instance ebe9faba-2b02-4ab6-be69-e7830be3ddf3 could not be found. {{(pid=117761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 20:15:10.331348 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-77409c48-9ed9-4e54-8c78-953984362cc7 tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] 10.222.0.69 "GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3" status: 404 len: 111 microversion: 2.1 time: 0.032545 Jul 20 20:15:10.331348 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 2021/2652] 10.222.0.69 () {58 vars in 1235 bytes} [Wed Jul 20 20:15:10 2022] GET /compute/v2.1/servers/ebe9faba-2b02-4ab6-be69-e7830be3ddf3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 20:15:10.335973 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: DEBUG nova.api.openstack.wsgi [None req-9c244e7a-81e3-4d55-9a46-798f58b916ea tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] Calling method '.version_select at 0x7ff60a10f1f0>' {{(pid=117761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 20:15:10.354187 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO nova.api.openstack.requestlog [None req-9c244e7a-81e3-4d55-9a46-798f58b916ea tempest-TestMinimumBasicScenario-1389843331 tempest-TestMinimumBasicScenario-1389843331-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-466886681" status: 202 len: 0 microversion: 2.1 time: 0.021689 Jul 20 20:15:10.354738 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: [pid: 117761|app: 0|req: 2022/2653] 10.222.0.69 () {58 vars in 1268 bytes} [Wed Jul 20 20:15:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-466886681 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 20:17:05.144090 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 20:17:05.145281 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Wed Jul 20 20:17:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 20:17:23.179087 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 20:17:23.179711 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Wed Jul 20 20:17:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 20:20:25.153185 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 20:20:25.154046 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Wed Jul 20 20:20:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 20:20:27.241796 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 20:20:27.242355 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Wed Jul 20 20:20:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 20:20:43.187766 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 20:20:43.188364 dv-cinder-835384-16-iscsi devstack@n-api.service[117761]: Wed Jul 20 20:20:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!